计算机科学
弹道
干扰
初始化
实时计算
上传
卫星
任务(项目管理)
过程(计算)
马尔可夫决策过程
马尔可夫过程
工程类
统计
操作系统
热力学
物理
航空航天工程
程序设计语言
系统工程
数学
天文
作者
Chen Han,Aijun Liu,Kang An,Haichao Wang,Gan Zheng,Symeon Chatzinotas,Liangyu Huo,Xinhai Tong
出处
期刊:IEEE Transactions on Vehicular Technology
[Institute of Electrical and Electronics Engineers]
日期:2022-04-01
卷期号:71 (4): 3760-3775
被引量:6
标识
DOI:10.1109/tvt.2021.3136187
摘要
Satellite and unmanned aerial vehicle (UAV) networks have been introduced as enhanced approaches to provide dynamic control, massive connections and global coverage for future wireless communication systems. This paper considers a coordinated satellite-UAV communication system, where the UAV performs the environmental reconnaissance task with the assistance of satellites in a hostile jamming environment. To fulfill this task, the UAV needs to realize autonomous trajectory control and upload the collected data to the satellite. With the aid of the uploading data, the satellite builds the environment situation map integrating the beam quality, jamming status, and traffic distribution. Accordingly, we propose a closed-loop anti-jamming dynamic trajectory optimization approach, which is divided into three stages. Firstly, a coarse trajectory planning is made according to the limited prior information and preset points. Secondly, the flight control between two adjacent preset points is formulated as a Markov decision process, and reinforcement learning (RL) based automatic flying control algorithms are proposed to explore the unknown hostile environment and realize autonomous and precise trajectory control. Thirdly, based on the collected data during the UAV’s flight, the satellite utilizes an environment situation estimating algorithm to build an environment situation map, which is used to reselect the preset points for the first stage and provide better initialization for the RL process in the second stage. Simulation results verify the validity and superiority of the proposed approach.
科研通智能强力驱动
Strongly Powered by AbleSci AI