SeqDQN: Multi-Agent Deep Reinforcement Learning for Uplink URLLC with Strict Deadlines - Equipe Réseaux, Mobilité et Services Access content directly
Conference Papers Year : 2023

SeqDQN: Multi-Agent Deep Reinforcement Learning for Uplink URLLC with Strict Deadlines

Abstract

Recent studies suggest that Multi-Agent Reinforcement Learning (MARL) can be a promising approach to tackle wireless telecommunication problems and Multiple Access (MA) in particular. The most relevant MARL algorithms for distributed MA are those with "decentralized execution", where an agent's actions are only functions of their own local observation history and agents cannot exchange any information. Centralized-Training-Decentralized-Execution (CTDE) and Independent Learning (IL) are the two main families in this category. However, while the former suffers from high communication overhead during the centralized training, the latter suffers from various theoretical shortcomings. In this paper, we first study the performance of these two MARL frameworks in the context of Ultra Reliable Low Latency Communication (URLLC), where MA is constrained by strict deadlines. Second, we propose a new distributed MARL framework, namely SeqDQN, leveraging the constraints of our URLLC problem to train agents in a more efficient way. We demonstrate that not only does our solution outperform the traditional random access baselines, but it also outperforms state-of-the-art MARL algorithms in terms of performance and convergence time.
Fichier principal
Vignette du fichier
eucnc23.pdf (1.81 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
licence : CC BY - Attribution

Dates and versions

hal-04082578 , version 1 (26-04-2023)

Licence

Attribution

Identifiers

  • HAL Id : hal-04082578 , version 1

Cite

Benoît-Marie Robaglia, Marceau Coupechoux, Dimitrios Tsilimantos, Apostolos Destounis. SeqDQN: Multi-Agent Deep Reinforcement Learning for Uplink URLLC with Strict Deadlines. EuCNC & 6G Summit, Jun 2023, Gothenburg, Sweden. ⟨hal-04082578⟩
122 View
56 Download

Share

Gmail Facebook X LinkedIn More