Formal Modelling for Multi-Robot Systems Under Uncertainty
Not on the map. Why?
Abstract (arXiv)
Purpose of Review: To effectively synthesise and analyse multi-robot behaviour, we require formal task-level models which accurately capture multi-robot execution. In this paper, we review modelling formalisms for multi-robot systems under uncertainty, and discuss how they can be used for planning, reinforcement learning, model checking, and simulation. Recent Findings: Recent work has investigated models which more accurately capture multi-robot execution by considering different forms of uncertainty, such as temporal uncertainty and partial observability, and modelling the effects of robot interactions on action execution. Other strands of work have presented approaches for reducing the size of multi-robot models to admit more efficient solution methods. This can be achieved by decoupling the robots under independence assumptions, or reasoning over higher level macro actions. Summary: Existing multi-robot models demonstrate a trade off between accurately capturing robot dependencies and uncertainty, and being small enough to tractably solve real world problems. Therefore, future research should exploit realistic assumptions over multi-robot behaviour to develop smaller models which retain accurate representations of uncertainty and robot interactions; and exploit the structure of multi-robot problems, such as factored state spaces, to develop scalable solution methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 125 references that are in the map. First posted on arXiv 26 May 2023.
Builds on
25 of 125 references.
References · 25
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 708
- 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 485
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 231
- 2020FACMAC: Factored Multi-Agent Centralised Policy Gradientscited by 178
- 2018Learning to Teach in Cooperative Multiagent Reinforcement Learningcited by 45
- 2020UneVEn: Universal Value Exploration for Multi-Agent Reinforcement Learningcited by 33
- 2018STyLuS*: A Temporal Logic Optimal Control Synthesis Algorithm for Large-Scale Multi-Robot Systemscited by 24
- 2021Regularized Softmax Deep Multi-Agent Q-Learningcited by 19
- 2016Multi-Agent Path Finding with Delay Probabilitiescited by 18
- 2020Macro-Action-Based Deep Multi-Agent Reinforcement Learningcited by 18
- 2022Asynchronous Actor-Critic for Multi-Agent Reinforcement Learningcited by 18
- 2021MAMBPO: Sample-efficient multi-robot reinforcement learning using learned world modelscited by 16
13 more
- 2019Learning Multi-Robot Decentralized Macro-Action-Based Policies via a Centralized Q-Netcited by 12
- 2017Learning for Multi-robot Cooperation in Partially Observable Stochastic Environments with Macro-actionscited by 8
- 2019A Sufficient Statistic for Influence in Structured Multiagent Environmentscited by 8
- 2014Planning for Decentralized Control of Multiple Robots Under Uncertaintycited by 7
- 2018Simultaneous Task Allocation and Planning Under Uncertaintycited by 5
- 2020Multi-agent active perception with prediction rewardscited by 5
- 2021MT* : Multi-Robot Path Planning for Temporal Logic Specificationscited by 5
- 2015Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version)cited by 4
- 2017Near-Optimal Adversarial Policy Switching for Decentralized Asynchronous Multi-Agent Systemscited by 3
- 2021Local Advantage Actor-Critic for Robust Multi-Agent Deep Reinforcement Learningcited by 3
- 2017Semantic-level Decentralized Multi-Robot Decision-Making using Probabilistic Macro-Observationscited by 2
- 2017Scalable Accelerated Decentralized Multi-Robot Policy Search in Continuous Observation Spacescited by 1
- 2017Probabilistic Plan Synthesis for Coupled Multi-Agent Systemscited by 1
Built on by
Not cited yet.