A DRL Strategy for Optimal Resource Allocation Along With 3D Trajectory Dynamics in UAV-MEC Network

计算机科学 强化学习 移动边缘计算 弹道 资源配置 资源管理(计算) 任务(项目管理) 轨迹优化 分布式计算 数学优化 实时计算 模拟 GSM演进的增强数据速率 最优控制 人工智能 计算机网络 物理 数学 天文 管理 经济
作者
Tayyaba Khurshid,Waqas Ahmed,Muhammad Rehan,Rizwan Ahmad,Muhammad Mahtab Alam,Ayman Radwan
出处
期刊:IEEE Access [Institute of Electrical and Electronics Engineers]
卷期号:11: 54664-54678 被引量:9
标识
DOI:10.1109/access.2023.3278591
摘要

Advances in Unmanned Air Vehicle (UAV) technology have paved a way for numerous configurations and applications in communication systems. However, UAV dynamics play an important role in determining its effective use. In this article, while considering UAV dynamics, we evaluate the performance of a UAV equipped with a Mobile-Edge Computing (MEC) server that provides services to End-user Devices (EuDs). The EuDs due to their limited energy resources offload a portion of their computational task to nearby MEC-based UAV. To this end, we jointly optimize the computational cost and 3D UAV placement along with resource allocation subject to the network, communication, and environment constraints. A Deep Reinforcement Learning (DRL) technique based on a continuous action space approach, namely Deep Deterministic Policy Gradient (DDPG) is utilized. By exploiting DDPG, we propose an optimization strategy to obtain an optimal offloading policy in the presence of UAV dynamics, which is not considered in earlier studies. The proposed strategy can be classified into three cases namely; training through an ideal scenario, training through error dynamics, and training through extreme values. We compared the performance of these individual cases based on cost percentage and concluded that case II (training through error dynamics) achieves minimum cost i.e., 37.75 %, whereas case I and case III settles at 67.25% and 67.50% respectively. Numerical simulations are performed, and extensive results are obtained which shows that the advanced DDPG based algorithm along with error dynamic protocol is able to converge to near optimum. To validate the efficacy of the proposed algorithm, a comparison with state-of-the-art Deep Q-Network (DQN) is carried out, which shows that our algorithm has significant improvements.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
丘比特的应助被igor1982采纳,获得10
刚刚
cdercder的应助被年轻新儿采纳,获得30
刚刚
陈华伟完成签到,获得积分10
刚刚
刚刚
1秒前
何曼慈发布了新的文献求助10
2秒前
mm发布了新的文献求助10
2秒前
Fanss完成签到,获得积分20
2秒前
oy完成签到,获得积分20
2秒前
绿色番茄酱完成签到,获得积分20
3秒前
xiaomeng发布了新的文献求助30
3秒前
zt完成签到,获得积分10
3秒前
梨那个李完成签到,获得积分10
3秒前
xing_xing的应助被Fair采纳,获得30
3秒前
kuolong发布了新的文献求助10
3秒前
dddddd完成签到 ,获得积分10
4秒前
大个的应助被111111采纳,获得10
4秒前
5秒前
Laure完成签到,获得积分10
5秒前
彭于晏的应助被shelly采纳,获得10
5秒前
5秒前
pppyy发布了新的文献求助10
6秒前
Orange的应助被归海听云采纳,获得10
6秒前
6秒前
会笑的猪猪猫完成签到,获得积分10
6秒前
张晓宇完成签到,获得积分10
6秒前
6秒前
7秒前
sehnhsu发布了新的文献求助10
7秒前
香蕉觅云的应助被傲娇诗珊采纳,获得10
7秒前
7秒前
Lemonhead的应助被bowenguan采纳,获得150
8秒前
kevin231的应助被111采纳,获得10
8秒前
szy完成签到,获得积分10
8秒前
小c发布了新的文献求助20
9秒前
9秒前
9秒前
10秒前
lydy1993完成签到,获得积分10
10秒前
整齐冬菱发布了新的文献求助10
10秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
高分子基功能界面水蒸发材料与应用研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8177063
求助须知:如何正确求助?哪些是违规求助? 9568127
关于积分的说明 21797295
捐赠科研通 7771741
什么是DOI,文献DOI怎么找? 3432249
关于科研通互助平台的介绍 2556506
邀请新用户注册赠送积分活动 2477791