基于标签量信息的联邦学习节点选择算法

马嘉华; 孙兴华; 夏文超; 王玺钧; 谭洪舟; 朱洪波

doi:10.11959/j.issn.2096-3750.2021.00249

您当前的位置：

首页 >

文章列表页 >

基于标签量信息的联邦学习节点选择算法

理论与技术 | 更新时间：2024-06-05

- 基于标签量信息的联邦学习节点选择算法
- Node selection based on label quantity information in federated learning
- 物联网学报 2021年5卷第4期页码：46-53
- 作者机构：
  
  1. 中山大学，广东广州510006
  2. 南京邮电大学，江苏南京 210023
- 作者简介：
  
  [ "马嘉华（1997− ），男，中山大学电子与通信工程学院硕士生，主要研究方向为无线通信、联邦学习、人工智能、边缘计算等" ]
  [ "孙兴华（1985− ），男，博士，中山大学电子与通信工程学院副教授，主要研究方向为下一代无线通信网络、智能通信等" ]
  [ "夏文超（1991− ），男，博士，南京邮电大学副教授，主要研究方向为边缘智能、大规模MIMO、云无线接入网" ]
  [ "王玺钧（1984− ），男，博士，中山大学电子与信息工程学院副教授，主要研究方向为信息年龄、强化学习等" ]
  [ "谭洪舟（1965− ），男，博士，中山大学电子与信息工程学院教授，主要研究方向为物联网芯片与系统技术" ]
  [ "朱洪波（1956− ），男，博士，南京邮电大学教授、博士生导师，南京邮电大学原副校长、物联网研究院院长，江苏省“泛在无线通信与物联网”科技创新团队带头人，主要研究方向为物联网、移动通信网络等" ]
- 基金信息：
  
  国家重点研发计划;The National Key Research and Development Program of China(2019YFE0114000);国家自然科学基金资助项目;The National Natural Science Foundation of China(92067201);江苏省自然科学基金资助项目;The Natural Science Foundation of Jiangsu Province(BK20212001);广东省基础与应用基础研究基金资助项目;The Guang-dong Basic and Applied Basic Research Foundation(2021A1515012631);广东省基础与应用基础研究基金资助项目;The Guang-dong Basic and Applied Basic Research Foundation(2019A1515011906)
- DOI：10.11959/j.issn.2096-3750.2021.00249
  中图分类号： TP391.4
- 纸质出版日期：2021-12-30，
  
  网络出版日期：2021-12，
- 稿件说明：
移动端阅览
马嘉华, 孙兴华, 夏文超, 等. 基于标签量信息的联邦学习节点选择算法[J]. 物联网学报, 2021,5(4):46-53.

JIAHUA MA, XINGHUA SUN, WENCHAO XIA, et al. Node selection based on label quantity information in federated learning. [J]. Chinese journal on internet of things, 2021, 5(4): 46-53.
马嘉华, 孙兴华, 夏文超, 等. 基于标签量信息的联邦学习节点选择算法[J]. 物联网学报, 2021,5(4):46-53. DOI： 10.11959/j.issn.2096-3750.2021.00249.

JIAHUA MA, XINGHUA SUN, WENCHAO XIA, et al. Node selection based on label quantity information in federated learning. [J]. Chinese journal on internet of things, 2021, 5(4): 46-53. DOI： 10.11959/j.issn.2096-3750.2021.00249.

摘要

针对节点数据分布差异给联邦学习算法性能带来不良影响的问题，提出了一个基于标签量信息的节点选择算法。算法设计了一个关于节点标签量信息的优化目标，考虑在一定时耗限制下选择标签分布尽可能均衡的节点组合优化问题。根据节点组合的综合标签分布与模型收敛的相关性，新算法降低了全局模型的权重偏移上界以改善算法的收敛稳定性。仿真验证了新算法与现有的节点选择算法相比拥有更高的收敛效率。

Abstract

Aiming at the problem that the difference of node data distribution has adverse effect on the performance of federated learning algorithm

a node selection algorithm based on label quantity information was proposed.An optimization objective based on the label quantity information of nodes was designed

considering the optimization problem of selecting the nodes with balanced label distribution under a certain time consumption limit.According to the correlation between the aggregated label distribution of selected nodes and the convergence of the global model

the upper bound of the weight divergence of the global model was reduced to improve the convergence stability of the algorithm.Simulation results shows that the new algorithm had higher convergence efficiency than the existing node selection algorithm.

关键词

联邦学习节点选择通信时延

Keywords

federated learningnode selectioncommunication delay

references

MCMAHAN H B, MOORE E, RAMAGE D ,et al. Communication-efficient learning of deep networks from decentralized data[EB]. 2016.

YANG H H, LIU Z Z, QUEK T Q S ,et al. Scheduling policies for federated learning in wireless networks[J]. IEEE Transactions on Communications, 2020,68(1): 317-333.

NISHIO T, YONETANI R . Client selection for federated learning with heterogeneous resources in mobile edge[C]// Proceedings of ICC 2019- 2019 IEEE International Conference on Communications (ICC). Piscataway:IEEE Press, 2019: 1-7.

REN J K, HE Y H, WEN D Z ,et al. Scheduling for cellular federated edge learning with importance and channel awareness[J]. IEEE Transactions on Wireless Communications, 2020,19(11): 7690-7703.

HUANG T S, LIN W W, WU W T ,et al. An efficiency-boosting client selection scheme for federated learning with fairness guarantee[J]. IEEE Transactions on Parallel and Distributed Systems, 2021,32(7): 1552-1564.

XU J, WANG H Q . Client selection and bandwidth allocation in wireless federated learning networks:a long-term perspective[J]. IEEE Transactions on Wireless Communications, 2021,20(2): 1188-1200.

SHI W Q, ZHOU S, NIU Z S ,et al. Joint device scheduling and resource allocation for latency constrained wireless federated learning[J]. IEEE Transactions on Wireless Communications, 2021,20(1): 453-467.

ZHANG W Y, WANG X M, ZHOU P ,et al. Client selection for federated learning with non-IID data in mobile edge computing[J]. IEEE Access, 2021,9: 24462-24474.

RIBERO M, VIKALO H . Communication-efficient federated learning via optimal client sampling[EB]. 2020.

WU W T, HE L G, LIN W W ,et al. Accelerating federated learning over reliability-agnostic clients in mobile edge computing systems[J]. IEEE Transactions on Parallel and Distributed Systems, 2021,32(7): 1539-1551.

NGUYEN H T, SEHWAG V, HOSSEINALIPOUR S ,et al. Fast-convergent federated learning[J]. IEEE Journal on Selected Areas in Communications, 2021,39(1): 201-218.

YEGANEH Y, FARSHAD A, NAVAB N ,et al. Inverse distance aggregation for federated learning with non-IID data[M]// Domain Adaptation and Representation Transfer,and Distributed and Collaborative Learning. Cham: Springer International Publishing, 2020: 150-159.

ZHAO Y, LI M, LAI L Z ,et al. Federated learning with non-IID data[EB]. 2018.

MA J H, SUN X H, XIA W C ,et al. Client selection based on label quantity information for federated learning[C]// PIMRC:Workshop on Native-AI Empowered Wireless Networks. 2021.

CALDAS S, WU P, LI T ,et al. LEAF:a benchmark for federated settings[EB]. 2018.

AKDENIZ M R, LIU Y P, SAMIMI M K ,et al. Millimeter wave channel modeling and cellular capacity evaluation[J]. IEEE Journal on Selected Areas in Communications, 2014,32(6): 1164-1179.

浏览量

478

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于选举策略的低空物联网稳定联邦学习方法

移动边缘计算中通信高效的联邦学习模型剪枝算法

联邦学习赋能6G网络综述

基于背包模型的联邦学习客户端选择方法

一种基于带宽分配的联邦学习激励机制