A multi-armed bandits empowered transmission scheme for IRS-assisted MISO system

SONG Yunchao; LI Hao; LIANG Huibin; WANG Ge

doi:10.11959/j.issn.2096-3750.2025.00386

您当前的位置：

首页 >

文章列表页 >

A multi-armed bandits empowered transmission scheme for IRS-assisted MISO system

Theory and Technology | 更新时间：2025-04-21

- A multi-armed bandits empowered transmission scheme for IRS-assisted MISO system
- Chinese Journal on Internet of Things Vol. 9, Issue 1, Pages: 128-137(2025)
- 作者机构：
  
  南京邮电大学电子与光学工程学院、柔性电子（未来技术）学院，江苏南京 210023
- 作者简介：
- 基金信息：
  
  The National Natural Science Foundation of China(62101282)
- DOI：10.11959/j.issn.2096-3750.2025.00386
  CLC： TN929.5;
- Received：25 August 2023，
  
  Revised：2024-01-23，
  
  Published：30 March 2025
- 稿件说明：
移动端阅览
宋云超,李浩,梁汇彬等.多臂赌博机赋能的IRS辅助MISO系统传输方案设计[J].物联网学报,2025,09(01):128-137.

SONG Yunchao,LI Hao,LIANG Huibin,et al.A multi-armed bandits empowered transmission scheme for IRS-assisted MISO system[J].Chinese Journal on Internet of Things,2025,09(01):128-137.
宋云超,李浩,梁汇彬等.多臂赌博机赋能的IRS辅助MISO系统传输方案设计[J].物联网学报,2025,09(01):128-137. DOI： 10.11959/j.issn.2096-3750.2025.00386.

SONG Yunchao,LI Hao,LIANG Huibin,et al.A multi-armed bandits empowered transmission scheme for IRS-assisted MISO system[J].Chinese Journal on Internet of Things,2025,09(01):128-137. DOI： 10.11959/j.issn.2096-3750.2025.00386.

摘要

智能反射面（IRS

intelligent reflecting surface）是一种能够提升毫米波通信性能并应对传输挑战的技术。然而，传统方法在联合优化预编码和IRS相移时需要准确的信道状态信息，导频消耗随着基站天线数和IRS元件数的增加而增大。为降低导频，提出了一种基于多臂赌博机（MAB

multi-armed bandit）的传输设计方案。具体而言，在IRS辅助单天线用户下行通信系统中，通过双时间尺度的方法，将IRS相移和预编码波束成形问题解耦。利用强化学习中的上下文MAB算法，在每个相干时间块内根据上下文信息和奖励反馈来设计IRS相移矩阵。接着，采用迫零方法设计预编码，并引入贪婪法来选择每一时刻的动作，以避免陷入局部最优。仿真结果表明，与现有的算法相比，所提算法能够实现更高的有效频谱效率。

Abstract

Intelligent reflecting surface (IRS) is an effective technology that can enhance millimeter-wave communication performance and address transmission challenges. However

conventional methods require accurate channel state information when jointly optimizing precoding and IRS phase shifting

and pilot consumption increases with the number of base station antennas and IRS components. To reduce pilot overhead

a transmission design scheme based on multi-armed bandit (MAB) was proposed. Specifically

in IRS-assisted single antenna user downlink communication systems

the problem of IRS phase shift design and precoding beamforming was decoupled through a dual time scale approach. Using the contextual MAB algorithm in reinforcement learning

the IRS phase shift matrix was designed within each coherent time block based on contextual information and reward feedback. Next

the zero forcing method was used to design precoding

and the greedy method was introduced to select actions at each moment to avoid getting stuck in local optima. The simulation results show that the proposed algorithm can achieve higher effective spectral efficiency than the existing algorithms.

关键词

Keywords

references

王长江 , 傅友华 . IRS辅助毫米波MIMO系统波束成形优化的低复杂度方案 [J ] . 信号处理 , 2022 , 38 ( 9 ): 1965 - 1974 .

WANG C J , FU Y H . A low-complexity scheme for beamforming optimization of IRS-assisted mmWave MIMO system [J ] . Journal of Signal Processing , 2022 , 38 ( 9 ): 1965 - 1974 .

范敏 , 邵思源 , 贺超 , 等 . 下一代毫米波无线局域网: 愿景与关键使能技术 [J ] . 物联网学报 , 2023 , 7 ( 3 ): 1 - 14 .

FAN M , SHAO S Y , HE C , et al . Next-generation mmWave WLAN: vision and key enabling technologies [J ] . Chinese Journal on Internet of Things , 2023 , 7 ( 3 ): 1 - 14 .

蒲旭敏 , 邓凯元 , 陈前斌 . 超大规模MIMO-OTFS系统上行辅助的下行信道估计方法 [J ] . 物联网学报 , 2023 , 7 ( 4 ): 28 - 38 .

PU X M , DENG K Y , CHEN Q B . Uplink assisted downlink channel estimation method of extra-large scale MIMO-OTFS system [J ] . Chinese Journal on Internet of Things , 2023 , 7 ( 4 ): 28 - 38 .

江玉涵 , 邹玉龙 , 郑宝玉 . 新一代超密集异构蜂窝无线网络研究 [J ] . 信号处理 , 2020 , 36 ( 2 ): 159 - 167 .

JIANG Y H , ZOU Y L , ZHENG B Y . Research on new generation of ultra-dense heterogeneous cellular wireless networks [J ] . Journal of Signal Processing , 2020 , 36 ( 2 ): 159 - 167 .

ABID W , HAJJAJ M , MEJRI A , et al . Weighted Kalman based detection for uplink MIMO systems [C ] // Proceedings of the 2020 International Conference on Software, Telecommunications and Computer Networks (SoftCOM) . Piscataway : IEEE Press , 2020 : 1 - 6 .

PAHLAVAN K , KRISHNAMURTHY P . Evolution and impact of Wi-Fi technology and applications: a historical perspective [J ] . International Journal of Wireless Information Networks , 2021 , 28 ( 1 ): 3 - 19 .

GUO H Y , LIANG Y C , CHEN J , et al . Weighted sum-rate maximization for intelligent reflecting surface enhanced wireless networks [C ] // Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM) . Piscataway : IEEE Press , 2019 : 1 - 6 .

ZHANG S W , ZHANG R . Capacity characterization for intelligent reflecting surface aided MIMO communication [J ] . IEEE Journal on Selected Areas in Communications , 2020 , 38 ( 8 ): 1823 - 1838 .

LI Y Q , JIANG M , ZHANG Q , et al . Joint beamforming design in multi-cluster MISO NOMA reconfigurable intelligent surface-aided downlink communication networks [J ] . IEEE Transactions on Communications , 2021 , 69 ( 1 ): 664 - 674 .

傅友华 , 陈栋 . 混合智能反射表面结构辅助的毫米波通信信道估计 [J ] . 通信学报 , 2021 , 42 ( 10 ): 189 - 196 .

FU Y H , CHEN D . Channel estimation for hybrid intelligent reflecting surface structure assisted mmWave communications [J ] . Journal on Communications , 2021 , 42 ( 10 ): 189 - 196 .

GAO J B , ZHONG C J , LI G Y , et al . Online deep neural network for optimization in wireless communications [J ] . IEEE Wireless Communications Letters , 2022 , 11 ( 5 ): 933 - 937 .

李国权 , 徐永海 , 林金朝 , 等 . 基于Res-DNN的端到端MIMO系统信号检测算法 [J ] . 物联网学报 , 2022 , 6 ( 1 ): 65 - 72 .

LI G Q , XU Y H , LIN J Z , et al . Res-DNN based signal detection algorithm for end-to-end MIMO systems [J ] . Chinese Journal on Internet of Things , 2022 , 6 ( 1 ): 65 - 72 .

LI K Y , HUANG C , GONG Y , et al . Double deep learning for joint phase-shift and beamforming based on cascaded channels in RIS-assisted MIMO networks [J ] . IEEE Wireless Communications Letters , 2023 , 12 ( 4 ): 659 - 663 .

LEE Y , LEE J H , KO Y C . Beamforming optimization for IRS-assisted mmWave V2I communication systems via reinforcement learning [J ] . IEEE Access , 2022 , 10 : 60521 - 60533 .

XU C , SI Y Y , ZHU L H , et al . Dynamic data transaction in crowdsensing based on multi-armed bandits and shapley value [J ] . IEEE Transactions on Sustainable Computing , 2022 , 7 ( 3 ): 609 - 618 .

LUO Z Q , MA W K , SO A M C , et al . Semidefinite relaxation of quadratic optimization problems [J ] . IEEE Signal Processing Magazine , 2010 , 27 ( 3 ): 20 - 34 .

JALDEN J , OTTERSTEN B . The diversity order of the semidefinite relaxation detector [J ] . IEEE Transactions on Information Theory , 2008 , 54 ( 4 ): 1406 - 1422 .

WU Q Q , ZHANG R . Intelligent reflecting surface enhanced wireless network via joint active and passive beamforming [J ] . IEEE Transactions on Wireless Communications , 2019 , 18 ( 11 ): 5394 - 5409 .

HAN Y , JIN S , WEN C K , et al . Channel estimation for extremely large-scale massive MIMO systems [J ] . IEEE Wireless Communications Letters , 2020 , 9 ( 5 ): 633 - 637 .

QIN Z A , YIN H F , CAO Y D , et al . A partial reciprocity-based channel prediction framework for FDD massive MIMO with high mobility [J ] . IEEE Transactions on Wireless Communications , 2022 , 21 ( 11 ): 9638 - 9652 .

HAN Y , LIU Q , WEN C K , et al . Tracking FDD massive MIMO downlink channels by exploiting delay and angular reciprocity [J ] . IEEE Journal of Selected Topics in Signal Processing , 2019 , 13 ( 5 ): 1062 - 1076 .

HUGL K , KALLIOLA K , LAURILA J . Spatial reciprocity of uplink and downlink radio channels in FDD systems [C ] // Proceedings of the Eur . Cooper . Sci . Technol. (EURO-COST). Piscataway : IEEE Press , 2002 , 273 ( 2 ): 066 .

LI X , JIN S , SURAWEERA H A , et al . Statistical 3-D beamforming for large-scale MIMO downlink systems over Rician fading channels [J ] . IEEE Transactions on Communications , 2016 , 64 ( 4 ): 1529 - 1543 .

SALHAB A M , SAMUH M H . Accurate performance analysis of reconfigurable intelligent surfaces over Rician fading channels [J ] . IEEE Wireless Communications Letters , 2021 , 10 ( 5 ): 1051 - 1055 .

PENG Z J , WANG S X , PAN C H , et al . Multi-pair two-way massive MIMO DF relaying over rician fading channels under imperfect CSI [J ] . IEEE Wireless Communications Letters , 2022 , 11 ( 2 ): 225 - 229 .

KIM D , POOR H V , LEE N . Online learning to precode for FDD massive MIMO systems [C ] // Proceedings of the 2020 IEEE Globecom Workshops (GC Wkshps) . Piscataway : IEEE Press , 2020 : 1 - 6 .

JI S P , WANG Q S , WU S Y , et al . Deep learning based user grouping for FD-MIMO systems exploiting statistical channel state information [J ] . China Communications , 2021 , 18 ( 7 ): 183 - 196 .

ZHENG Z T , ZHU C Z , JIANG B , et al . Statistical channel state information acquisition for massive MIMO communications [C ] // Proceedings of the 2015 International Conference on Wireless Communications & Signal Processing (WCSP) . Piscataway : IEEE Press , 2015 : 1 - 5 .

SONG Y C , LIU C , LIU Y L , et al . Joint spatial division and multiplexing in massive MIMO: a neighbor-based approach [J ] . IEEE Transactions on Wireless Communications , 2020 , 19 ( 11 ): 7392 - 7406 .

SONG Y C , LIU C , WANG W , et al . Domain selective precoding in 3-D massive MIMO systems [J ] . IEEE Journal of Selected Topics in Signal Processing , 2019 , 13 ( 5 ): 1103 - 1118 .

SONG Y C , LIU C , WANG W , et al . Cluster-group-based two-stage beamforming for massive MIMO [J ] . IEEE Transactions on Communications , 2022 , 70 ( 3 ): 1984 - 1998 .

CHENG X R , LI L H , DU L T . ADMM-based channel estimation for mmWave massive MIMO systems [C ] // Proceedings of the 2017 3rd IEEE International Conference on Computer and Communications (ICCC) . Piscataway : IEEE Press , 2017 : 152 - 157 .

LIU H , ZHANG J Y , WU Q Q , et al . ADMM based channel estimation for RISs aided millimeter wave communications [J ] . IEEE Communications Letters , 2021 , 25 ( 9 ): 2894 - 2898 .

Views

176

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Outage performance analysis for vehicular communications assisted by intelligent reflecting surfaces

Exploring the nonlinear coded superposed modulation MISO visible light communication system

Related Author

ZHOU Momiao

WU Fan

SUN Yanshi

WANG Kan

Zengyi XU

Wenqing NIU

Hui CHEN

Zhixue HE

Related Institution

School of Computer Science and Information Engineering, Hefei University of Technology

Hubei Key Laboratory of Transportation Internet of Things (Wuhan University of Technology)

Faculty of Computer Science and Engineering, Xi'an University of Technology

Key Laboratory of EMW Information, Fudan University

Shanghai Engineering Research Center of Low-Earth-Orbit Satellite Communication and Applications

⁰