Online and Robust Intermittent Motion Planning in Dynamic and Changing Environments. Xu, Z., Kontoudis, G., P., & Vamvoudakis, K., G. IEEE Transactions on Neural Networks and Learning Systems, PP:1-15, IEEE, 2023.
Online and Robust Intermittent Motion Planning in Dynamic and Changing Environments [pdf]Paper  doi  abstract   bibtex   19 downloads  
In this paper, we present a real-time kinodynamic motion planning methodology for dynamic environments, denoted as RRT-Q X ∞. We leverage RRT X for global path planning and rapid replanning to produce a set of boundary value problems. A Q-learning optimal controller is proposed for waypoint navigation with completely unknown system dynamics, external disturbances, and intermittent communication. The problem is formulated as a finite-horizon, continuous-time zero-sum game, where the control input is the minimizer, and the worst-case disturbance is the maximizer. To reduce the communication overhead , we allow intermittent transmission of control inputs. Moreover , a relaxed persistence of excitation technique is employed to improve the convergence speed of the Q-learning controller. We provide rigorous Lyapunov-based proofs to guarantee the closed-loop stability of the equilibrium point. The efficacy of the proposed RRT-Q X ∞ is illustrated in several scenarios.

Downloads: 19