Hierarchical Belief Modeling for Zero-Shot Opponent Adaptation in Partially Observable Multi-Agent Navigation
Not on the map. Why?
Abstract (arXiv)
Lux AI Season 3 requires agents to act under partial observability, randomized episode level dynamics, and a best of five match structure that rewards both tactical execution and fast adaptation. We present HORIZON, a hierarchical agent that combines symmetry aware spatial perception, dual memory belief tracking, relic centric graph attention, information gain driven exploration, and an opponent conditioned policy mixture. HORIZON separates short horizon control from cross match meta reasoning, while auxiliary belief and world model objectives stabilize learning. Trained with PPO in a large scale JAX simulator, the resulting agent explicitly infers hidden game parameters and opponent style. Experiments show consistent gains in match win rate, episode win rate, adaptation gain, and league rating over strong recurrent and feed forward baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 14 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
6 of 14 references.
References · 6
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2018Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learningcited by 276
- 2018Meta Reinforcement Learning with Latent Variable Gaussian Processescited by 44
- 2026Architecture Matters More Than Scale: A Comparative Study of Retrieval and Memory Augmentation for Financial QA Under SME Compute Constraintscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Society of Mind Meets Real-Time Strategy: A Hierarchical Multi-Agent Framework for Strategic Reasoning
- 2024Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planning
- 2026Differentiable Belief-based Opponent Shaping
- 2026When Does Opponent Modeling Pay Off? Spatial Inference Stabilises Reinforcement Learning under Partial Observability
- 2026Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competition
- 2026Evolving in the Agent Jungle via History-Informed Opponent Awareness
- 2026ORION: Option-Regularized Deep Reinforcement Learning for Cooperative Multi-Agent Online Navigation
- 2023Mimicking To Dominate: Imitation Learning Strategies for Success in Multiagent Competitive Games