Group-Agent Reinforcement Learning
It can largely benefit the reinforcement learning process of each agent if multiple agents perform their separate reinforcement learning tasks cooperatively. Different from multi-agent reinforcement learning where multiple agents are in a common environment and should learn to cooperate or compete with each other, in this case each agent has its separate environment and only communicate with others to share knowledge without any cooperative or competitive behaviour as a learning outcome. In fact, this learning scenario is not well understood yet and not well formulated. As the first effort, we propose group-agent reinforcement learning as a formulation of this scenario and the third type of reinforcement learning problem with respect to single-agent and multi-agent reinforcement learning. We then propose the first distributed reinforcement learning framework called DDAL (Decentralised Distributed Asynchronous Learning) designed for group-agent reinforcement learning. We show through experiments that DDAL achieved desirable performance with very stable training and has good scalability.