Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning
Not on the map. Why?
Abstract (arXiv)
Recent works train agents by constructing large-scale multimodal environment pools. However, we find that simply increasing the number of multimodal environments does not always benefit. We further analyze the limitations in current multimodal environment distributions through a series of experiments. Based on these findings, we study how to build more effective training environment distributions from two dimensions: **diversity** and **difficulty structure**. For diversity, we propose **Ability-aware Environment Selection (AES)** to obtain diverse environment sets. For difficulty structure, we propose **Hierarchical Difficulty Curriculum (HDC)**, which organizes curriculum learning through two difficulty levels: harness weakening and state-scale progression. Experiments show that AES and HDC effectively improve multimodal agent training.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 47 of its 67 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
47 of 67 references.
References · 47
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
- 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 260
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 168
- 2022Evolving Curricula with Regret-Based Environment Designcited by 166
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
35 more
- 2021Replay-Guided Adversarial Environment Designcited by 108
- 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Serverscited by 89
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agentscited by 60
- 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 51
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 46
- 2025RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environmentscited by 43
- 2025Planning with Reasoning using Vision Language World Modelcited by 36
- 2025VCRL: Variance-based Curriculum Reinforcement Learning for Large Language Modelscited by 35
- 2026ARC-AGI-3: A New Challenge for Frontier Agentic Intelligencecited by 29
- 2025OSWorld-MCP: Benchmarking MCP Tool Invocation In Computer-Use Agentscited by 25
- 2026Gym-Anything: Turn any Software into an Agent Environmentcited by 24
- 2026GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agentscited by 22
- 2025Measuring General Intelligence with Generated Gamescited by 21
- 2026MobileDreamer: Generative Sketch World Model for GUI Agentcited by 21
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 21
- 2025Learning Like Humans: Advancing LLM Reasoning Capabilities via Adaptive Difficulty Curriculum Learning and Expert-Guided Self-Reformulationcited by 20
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 20
- 2025Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agentscited by 19
- 2025AdaCuRL: Adaptive Curriculum Reinforcement Learning with Invalid Sample Mitigation and Historical Revisitingcited by 17
- 2025AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learningcited by 14
- 2025Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferencescited by 11
- 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Gamescited by 10
- 2023Generalization through Diversity: Improving Unsupervised Environment Designcited by 9
- 2025Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedbackcited by 9
- 2026VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agentscited by 9
- 2026MMR-Life: Piecing Together Real-life Scenes for Multimodal Multi-image Reasoningcited by 8
- 2026Why Multi-Step Tool-Use Reinforcement Learning Collapses and How Supervisory Signals Fix Itcited by 6
- 2026LOGIGEN: Logic-Driven Generation of Verifiable Agentic Taskscited by 5
- 2025Improving Environment Novelty Quantification for Effective Unsupervised Environment Designcited by 4
- 2026Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planningcited by 4
- 2026Gym-V: A Unified Vision Environment System for Agentic Vision Researchcited by 3
- 2026Pushing the Limits of LLM Tool Calling via Experiential Knowledge Integration and Activationcited by 3
- 2026The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillationcited by 3
- 2026Odysseus: Scaling VLMs to 100+ Turn Decision-Making in Games via Reinforcement Learningcited by 2
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shadingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.