Alert button
Picture for Long D. Nguyen

Long D. Nguyen

Alert button

Deep Reinforcement Learning for Intelligent Reflecting Surface-assisted D2D Communications

Add code
Bookmark button
Alert button
Aug 06, 2021
Khoi Khac Nguyen, Antonino Masaracchia, Cheng Yin, Long D. Nguyen, Octavia A. Dobre, Trung Q. Duong

Figure 1 for Deep Reinforcement Learning for Intelligent Reflecting Surface-assisted D2D Communications
Figure 2 for Deep Reinforcement Learning for Intelligent Reflecting Surface-assisted D2D Communications
Figure 3 for Deep Reinforcement Learning for Intelligent Reflecting Surface-assisted D2D Communications
Figure 4 for Deep Reinforcement Learning for Intelligent Reflecting Surface-assisted D2D Communications

In this paper, we propose a deep reinforcement learning (DRL) approach for solving the optimisation problem of the network's sum-rate in device-to-device (D2D) communications supported by an intelligent reflecting surface (IRS). The IRS is deployed to mitigate the interference and enhance the signal between the D2D transmitter and the associated D2D receiver. Our objective is to jointly optimise the transmit power at the D2D transmitter and the phase shift matrix at the IRS to maximise the network sum-rate. We formulate a Markov decision process and then propose the proximal policy optimisation for solving the maximisation game. Simulation results show impressive performance in terms of the achievable rate and processing time.

* 5 pages, Intelligent reflecting surface (IRS), D2D communications, deep reinforcement learning 
Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

Intelligent Reconfigurable Surface-assisted Multi-UAV Networks: Efficient Resource Allocation with Deep Reinforcement Learning

Add code
Bookmark button
Alert button
May 28, 2021
Khoi Khac Nguyen, Saeed Khosravirad, Long D. Nguyen, Tuan Thanh Nguyen, Trung Q. Duong

Figure 1 for Intelligent Reconfigurable Surface-assisted Multi-UAV Networks: Efficient Resource Allocation with Deep Reinforcement Learning
Figure 2 for Intelligent Reconfigurable Surface-assisted Multi-UAV Networks: Efficient Resource Allocation with Deep Reinforcement Learning
Figure 3 for Intelligent Reconfigurable Surface-assisted Multi-UAV Networks: Efficient Resource Allocation with Deep Reinforcement Learning
Figure 4 for Intelligent Reconfigurable Surface-assisted Multi-UAV Networks: Efficient Resource Allocation with Deep Reinforcement Learning

In this paper, we propose intelligent reconfigurable surface (IRS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of agility and reflection for enhancing the network's performance. To aim at maximising the energy efficiency (EE) of the considered networks, we jointly optimise the power allocation of the UAVs and the phaseshift matrix of the IRS. A deep reinforcement learning (DRL) approach is proposed for solving the continuous optimisation problem with time-varying channel gain in a centralised fashion. Moreover, a parallel learning approach is also proposed for reducing the information transmission requirement of the centralised approach. Numerical results show a significant improvement of our proposed schemes compared with the conventional approaches in terms of EE, flexibility, and processing time. Our proposed DRL methods for IRS-assisted UAV networks can be used for real-time applications due to their capability of instant decision-making and handling the time-varying channel with the dynamic environmental setting.

* 10 pages, Resource allocation, multi-UAV, intelligent reconfigurable surface and deep reinforcement learning 
Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon