mlsanityData to 14 Oct 2026

Inaugural MOASEI Competition at AAMAS'2025: A Technical Report

arXiv 2507.05469 ↗First posted 7 Jul 2025cs.MA cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

We present the Methods for Open Agent Systems Evaluation Initiative (MOASEI) Competition, a multi-agent AI benchmarking event designed to evaluate decision-making under open-world conditions. Built on the free-range-zoo environment suite, MOASEI introduced dynamic, partially observable domains with agent and task openness--settings where entities may appear, disappear, or change behavior over time. The 2025 competition featured three tracks--Wildfire, Rideshare, and Cybersecurity--each highlighting distinct dimensions of openness and coordination complexity. Eleven teams from international institutions participated, with four of those teams submitting diverse solutions including graph neural networks, convolutional architectures, predictive modeling, and large language model--driven meta--optimization. Evaluation metrics centered on expected utility, robustness to perturbations, and responsiveness to environmental change. The results reveal promising strategies for generalization and adaptation in open environments, offering both empirical insight and infrastructure for future research. This report details the competition's design, findings, and contributions to the open-agent systems research community.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 0 of its 2 references that are in the map. First posted on arXiv 7 Jul 2025.

Builds on

0 of 2 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.