收稿:2025-05-09,
修回:2025-06-07,
录用:2025-06-16,
移动端阅览
基于MADRL的海上物联网任务卸载优化方案[J/OL]. 物联网学报, 2026.
Research on Task Offloading Optimization Scheme Based on MADRL for Maritime IoT[J/OL]. Chinese Journal on Internet of Things, 2026.
为解决海上网络覆盖范围小、计算能力弱的问题,引入了空天地海一体化网络场景下的任务卸载决策。考虑计算任务的卸载成功率、能耗约束、近海场景与远海场景的环境差异以及空天地海一体化场景的动态性,构建了一种适用于空天地海一体化网络的任务卸载架构,提出了一种基于深度强化学习的多智能体协同任务卸载方案。实验结果表明,相较于基于MADQN算法的卸载方案、基于DDPG算法的卸载方案和随机策略的卸载方案,所提方案在卸载成功率方面分别提高5.08%、21.71%和60.48%,在时延方面分别降低11.65%、18.64%和64.60%,在能耗方面分别降低11.57%、9.66%和10.38%。
To address the issues of limited network coverage and weak computing capabilities in maritime environments
a task offloading scheme in the space-air-ground-sea integrated network scenario was introduced. Considering factors such as the offloading success rate of computational tasks
energy consumption constraints
environmental differences between near-shore and offshore scenarios
and the dynamic nature of the integrated space-air-ground-sea environment
a task offloading framework suitable for space-air-ground-sea integrated networks was constructed. A multi-agent collaborative task offloading scheme based on deep reinforcement learning was proposed. Experimental results demonstrate that
compared to offloading schemes based on the MADQN algorithm
the DDPG algorithm
and random policy
the proposed scheme improves the offloading success rate by 3.09%
18.42%
and 66.42%
respectively
reduces delay by 19.07%
21.53%
and 65.02%
respectively
and lowers energy consumption by 10.59%
8.20%
and 8.75%
respectively.
NOMIKOS N , GKONIS P K , BITHAS P S , et al . A survey on UAV-aided maritime communications: Deployment considerations, applications, and future challenges [J ] . IEEE Open J. Commun , 2023 , 4 : 6 – 78 .
李智勇 , 王琦 , 陈一凡 , 等 . 车辆边缘计算环境下任务卸载研究综述 [J ] . 计算机学报 , 2021 , 44 ( 05 ): 963 - 982 .
LI Z Y , WANG Q , CHEN Y F , et al . A Survey on Task Offloading Research in Vehicular Edge Computing [J ] . Chinese Journal of Computers , 2021 , 44 ( 05 ): 963 - 982
刘雷 , 陈晨 , 冯杰 , 等 . 车载边缘计算中任务卸载和服务缓存的联合智能优化 [J ] . 通信学报 , 2021 , 42 ( 01 ): 18 - 26 .
LIU L , CHEN C , FENG J , et al . Joint intelligent optimization of task offloading andservice caching for vehicular edge computing [J ] . Journal on Communications , 2021 , 42 ( 01 ): 18 - 26
ZHANG J , GUO H Z , LIU J J , et al . Task Offloading in Vehicular Edge Computing Networks: A Load-Balancing Solution [J ] . IEEE Transactions on Vehicular Technology , 2020 , 69 ( 2 ): 2092 - 2104 .
HEVESLI M , SEID A M , ERBAD A , et al . Multi-Agent DRL for Queue-Aware Task Offloading in Hierarchical MEC-Enabled Air-Ground Networks [J ] . IEEE Transactions on Cognitive Communications and Networking , 2025 .
BARICK S , SINGHAL C . UAV-Assisted MEC Architecture for Collaborative Task Offloading in Urban IoT Environment [J ] . IEEE Transactions on Network and Service Management , 2025 , 22 ( 1 ): 732 - 743 .
CHEN Z Y , HUANG Z Q , ZHANG J J , et al . Resource Allocation and Collaborative Offloading in Multi-UAV-Assisted IoV With Federated Deep Reinforcement Learning [J ] . IEEE Internet of Things Journal , 2024 , 12 ( 5 ): 4629 - 4640 .
CHAI Z Y , KANG H S , LI Y L , et al . Computation Offloading for Integrated Satellite-Terrestrial Internet of Vehicles in 6G Edge Network: A Cooperative Stackelberg Game [J ] . IEEE Transactions on Intelligent Transportation Systems , 2024 , 25 ( 8 ): 10389 - 10404 .
LAN W J , CHEN K Y , CAO J N , et al . Security-Sensitive Task Offloading in Integrated Satellite-Terrestrial Networks [J ] . IEEE Transactions on Mobile Computing , 2025 , 24 ( 3 ): 2220 - 2233 .
LI A , ZHOU T , XU T H , et al . LEO Satellite Assisted Edge Computing with Latency and Energy Optimization [J ] . IEEE Transactions on Network Science and Engineering , 2025 .
曾锋 , 张政 , 陈志刚 . 基于深度强化学习的计算卸载与资源分配策略 [J ] . 通信学报 , 2023 , 44 ( 07 ): 124 - 135 .
ZENG F , ZHANG Z , CHEN Z G . Computation offloading and resource allocation strategybased on deep reinforcement learning [J ] . Journal on Communications , 2023 , 44 ( 07 ): 124 - 135 .
LI J L , SHI W S , WU H Q , et al . Cost-Aware Dynamic SFC Mapping and Scheduling in SDN/NFV-Enabled Space–Air–Ground-Integrated Networks for Internet of Vehicles [J ] . IEEE Internet of Things Journal , 2022 , 9 ( 8 ): 5824 - 5838 .
XIE W X , CHEN C , JU Y , et al . Deep Reinforcement Learning-Based Computation Computational Offloading for Space–Air–Ground Integrated Vehicle Networks [J ] . IEEE Transactions on Intelligent Transportation Systems , 2025 , 26 ( 5 ): 5804 - 5815 .
LIN Z J , YANG J J , CHEN Y Y , et al . Maritime Distributed Computation Offloading in Space-Air-Ground-Sea Integrated Networks [J ] . IEEE Communications Letters , 2024 , 28 ( 7 ): 1614 - 1618 .
XU F M , YANG F , ZHAO C L , et al . Deep reinforcement learning based joint edge resource management in maritime network [J ] . China Communications , 2020 , 17 ( 5 ): 211 - 222 .
MENG S Q , WU S H , WU H Y , et al . Effectiveness-Oriented SAGSIN: Unveiling a Unified Metric and a Comprehensive Framework [J ] . IEEE Network , 2020 , 38 ( 6 ): 39 - 47 .
XU J J , KISHK M A , ALOUINI M S , Space-Air-Ground-Sea Integrated Networks : Modeling and Coverage Analysis [J ] . IEEE Transactions on Wireless Communications , 2023 , 22 ( 9 ): 6298 - 6313 .
YU S , GONG X W , SHI Q , et al . EC-SAGINs: Edge-Computing-Enhanced Space Air Ground Integrated Networks for Internet of Vehicles [J ] . IEEE Internet of Things Journal , 2022 , 9 ( 8 ): 5742 - 5754 .
WANG J , ZHOU H F , LI Y , et al . Wireless Channel Models for Maritime Communications [J ] . IEEE Access , 2018 , 6 : 68070 - 68088 .
MAO Y Y , YOU C S , ZHANG J , et al . A Survey on Mobile Edge Computing: The Communication Perspective [J ] . IEEE Communications Surveys & Tutorials , 2017 , 19 ( 4 ): 2322 - 2358 .
LIN Z J , CHEN X P , CHEN P P . Energy harvesting space-air-sea integrated networks for MEC-enabled maritime Internet of Things [J ] . China Communications , 2022 , 19 ( 9 ): 47 - 57 .
LIU Z X , CHEN Y , YUAN Y Z , et al . A Dynamic Power Allocation Scheme Based on Multiagent Deep Q-Network With Environmental Awareness for 5G Dense Networks [J ] . IEEE Internet of Things Journal , 2025 , 12 ( 4 ): 4220 - 4231 .
BETALO M L , LENG S P , ABISHU H N , et al . Multi-Agent DRL-Based Energy Harvesting for Freshness of Data in UAV-Assisted Wireless Sensor Networks [J ] . IEEE Transactions on Network and Service Management , 2024 , 21 ( 6 ): 6527 - 6541 .
HE J Y , LIU Z Y , ZHANG Y K , et al . Power Allocation Based on Federated Multiagent Deep Reinforcement Learning for NOMA Maritime Networks [J ] . IEEE Internet of Things Journal , 2025 , 19 ( 9 ): 12869 - 12884 .
XIAO H , HU Z G , ZHANG X Y , et al . Federated Deep Reinforcement Learning for Task Offloading in MEC-Enabled Heterogeneous Networks [J ] . IEEE Internet of Things Journal , 2025 , 12 ( 8 ): 10238 - 10252 .
ZHAO H , LU G Y , LIU Y , et al . Safe DQN-Based AoI-Minimal Task Offloading for UAV-Aided Edge Computing System [J ] . IEEE Internet of Things Journal , 2024 , 11 ( 19 ): 32012 - 32024 .
WANG X , LV J H , SLOWIK A , et al . Augmented Intelligence of Things for Priority-Aware Task Offloading in Vehicular Edge Computing [J ] . IEEE Internet of Things Journal , 2024 , 11 ( 22 ): 36002 - 36013 .
MIN J , JIAN W , LIANG Z , et al . DDPG-based intelligent computation offloading and resource allocation for LEO satellite edge computing network [J ] . China Communications , 2025 , 22 ( 5 ): 1 - 15 .
CHEN H S , CUI H X , WANG J H , et al . Computation Offloading Optimization for UAV-Based Cloud-Edge Collaborative Task Scheduling Strategy [J ] . IEEE Transactions on Cognitive Communications and Networking , 2025 .
THAT V , CHHEA K H and LEE J R . Optimizing Energy Consumption and Latency in IoT Through Edge Computing in Air–Ground Integrated Network With Deep Reinforcement Learning [J ] . IEEE Open Journal of Vehicular Technology , 2025 , 6 : 412 - 425 .
DU J B , WANG J X , SUN A J , et al . Joint Optimization in Blockchain- and MEC-Enabled Space–Air–Ground Integrated Networks [J ] . IEEE Internet of Things Journal , 2024 , 11 ( 19 ): 31862 - 31877 .
0
浏览量
3
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621