Abstract: Efficient and scalable radio resource allocation is essential for the success of wireless cellular networks. This paper presents a fully scalable multi-agent reinforcement learning (MARL) ...