Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

航路点 强化学习 计算机科学 弹道 人工智能 深度学习 人工神经网络 运动规划 移动机器人 任务(项目管理) 机器人 实时计算 机器学习 模拟 工程类 物理 系统工程 天文
作者
Runqi Chai,Hanlin Niu,Joaquín Carrasco,Farshad Arvin,Hujun Yin,Barry Lennox
出处
期刊:IEEE transactions on neural networks and learning systems [Institute of Electrical and Electronics Engineers]
卷期号:35 (4): 5778-5792 被引量:358
标识
DOI:10.1109/tnnls.2022.3209154
摘要

This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
权瑞松发布了新的文献求助10
刚刚
暴躁的冬易完成签到 ,获得积分10
刚刚
PENGQIDU完成签到 ,获得积分10
刚刚
1秒前
科研通AI6.4的应助被sui采纳,获得10
1秒前
1秒前
英姑的应助被LUXURY采纳,获得10
3秒前
3秒前
英俊的铭的应助被Ian采纳,获得10
3秒前
匀加速发布了新的文献求助10
4秒前
阿盛发布了新的文献求助10
5秒前
5秒前
科目三的应助被momo采纳,获得10
5秒前
Stella完成签到,获得积分10
5秒前
6秒前
6秒前
6秒前
TRY发布了新的文献求助10
9秒前
安静稚晴关注了科研通微信公众号
10秒前
2953685951发布了新的文献求助10
10秒前
天天快乐的应助被rootree采纳,获得10
10秒前
10秒前
马秀玲完成签到,获得积分10
10秒前
Jane完成签到 ,获得积分10
11秒前
饼的书发布了新的文献求助30
11秒前
我要资料啊完成签到,获得积分10
11秒前
12秒前
12秒前
QQ完成签到,获得积分10
12秒前
在水一方的应助被大大咧咧采纳,获得10
12秒前
Light完成签到,获得积分10
13秒前
13秒前
13秒前
天天快乐的应助被LML采纳,获得10
14秒前
14秒前
科研通AI6.3的应助被ww采纳,获得30
15秒前
杨旺旺完成签到,获得积分10
15秒前
16秒前
ccc完成签到,获得积分10
16秒前
dong发布了新的文献求助10
16秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
Improving the wear resistance of vehicle gear oil by oil soluble LaF3 nanoparticles and typical additives of gear oil 500
Boundaries and Bodhisattvas 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8183263
求助须知:如何正确求助?哪些是违规求助? 9572532
关于积分的说明 21826339
捐赠科研通 7780187
什么是DOI,文献DOI怎么找? 3433993
关于科研通互助平台的介绍 2558131
邀请新用户注册赠送积分活动 2480239