Abstract

Sampling-based methods are widely adopted solutions for robot motion planning. The methods are straightforward to implement, effective in practice for many robotic systems. It is often possible to prove that they have desirable properties, such as probabilistic completeness and asymptotic optimality. Nevertheless, they still face challenges as the complexity of the underlying planning problem increases, especially under tight computation time constraints, which impact the quality of returned solutions or given inaccurate models. This has motivated machine learning to improve the computational efficiency and applicability of Sampling- Based Motion Planners (SBMPs). This survey reviews such integrative efforts and aims to provide a classification of the alternative directions that have been explored in the literature. It first discusses how learning has been used to enhance key components of SBMPs, such as node sampling, collision detection, distance or nearest neighbor computation, local planning, and termination conditions. Then, it highlights planners that use learning to adaptively select between different implementations of such primitives in response to the underlying problem’s features. It also covers emerging methods, which build complete machine learning pipelines that reflect the traditional structure of SBMPs. It also discusses how machine learning has been used to provide data-driven models of robots, which can then be used by a SBMP. Finally, it provides a comparative discussion of the advantages and disadvantages of the approaches covered, and insights on possible future directions of research. An online version of this survey can be found at: https://prx-kinodynamic.github.io

A Survey on the Integration of Machine Learning with Sampling-based Motion Planning

Motion planning is the problem of finding valid paths, expressed as sequences of configurations, or trajectories, expressed as sequences of controls, which move a robot from a given start state to a desired goal state while avoiding obstacles. Sampling-based methods are widely adopted solutions for robot motion planning. The methods are straightforward to implement, and effective in practice for many robotic systems. Furthermore, they have numerous desirable properties, such as probabilistic completeness and asymptotic optimality. Nevertheless, sampling-based methods still face challenges as the complexity of the underlying planning problem increases, especially under tight computation time constraints, which impact the quality of returned solutions or given inaccurate models. This has motivated machine learning to improve the computational efficiency and applicability of Sampling-Based Motion Planners (SBMPs).

There are numerous publications on the use of machine learning algorithms to improve the efficiency of robotic systems in general. Recently, attention has focussed on the progress of deep learning methods, which has resulted in many efforts to utilize the corresponding tools in robotics. This monograph focuses specifically on integrating machine learning tools to improve the efficiency, convergence, and applicability of SBMPs. The publication covers a wide range of robotic applications, including, but not limited to, manipulation planning, and planning for systems with dynamic constraints. In particular, this manuscript first reviews the attempts to use machine learning to improve the performance of individual primitives used by SBMPs. It also studies a series of planners that use machine learning to adaptively select from a set of motion planning primitives. The monograph then proceeds to study a series of integrated architectures that learn an end-to-end mapping of sensor inputs to robot trajectories or controls. Finally, the monograph shows how SBMPs can operate over learned models of robotic system due to the presence of noise and uncertainty, and it concludes with a comparative discussion of the different approaches covered in terms of their impact on computational efficiency of the planner, quality of the computed paths as well as the usability of SBMPs. Also outlined are the broad difficulties and limitations of these methods, as well as potential directions of future work.