InfiniteWorld: A Unified Scalable Simulation Framework for General Visual-Language Robot Interaction
Not on the map. Why?
Abstract (arXiv)
Realizing scaling laws in embodied AI has become a focus. However, previous work has been scattered across diverse simulation platforms, with assets and models lacking unified interfaces, which has led to inefficiencies in research. To address this, we introduce InfiniteWorld, a unified and scalable simulator for general vision-language robot interaction built on Nvidia Isaac Sim. InfiniteWorld encompasses a comprehensive set of physics asset construction methods and generalized free robot interaction benchmarks. Specifically, we first built a unified and scalable simulation framework for embodied learning that integrates a series of improvements in generation-driven 3D asset construction, Real2Sim, automated annotation framework, and unified 3D asset processing. This framework provides a unified and scalable platform for robot interaction and learning. In addition, to simulate realistic robot interaction, we build four new general benchmarks, including scene graph collaborative exploration and open-world social mobile manipulation. The former is often overlooked as an important task for robots to explore the environment and build scene knowledge, while the latter simulates robot interaction tasks with different levels of knowledge agents based on the former. They can more comprehensively evaluate the embodied agent's capabilities in environmental understanding, task planning and execution, and intelligent interaction. We hope that this work can provide the community with a systematic asset interface, alleviate the dilemma of the lack of high-quality assets, and provide a more comprehensive evaluation of robot interactions.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Dec 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 1; 2025: 10; 2026: 4.
15 papers.
Sort:
By area:
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 67
- 2025RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learningcited by 54
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 40
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 38
- 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalizationcited by 30
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulationcited by 15
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Modelcited by 8
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenescited by 3
- 2025Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generationcited by 2
- 2025Image Recognition with Online Lightweight Vision Transformer: A Surveycited by 2
- 2025FDBPL: Faster Distillation-Based Prompt Learning for Region-Aware Vision-Language Models Adaptationcited by 1
3 more
- 2025FreeAskWorld: An Interactive and Closed-Loop Simulator for Human-Centric Embodied AIcited by 1
- 2026Intelligent Automation for Embodied Benchmark Construction: Pipelines, Embodiments, Simulators, and Trendscited by 1
- 2025Physics-Informed Spiking Neural Networks via Conservative Flux Quantizationcited by 0
- 2026Intelligent Automation for Embodied Benchmark Construction: Pipelines, Embodiments, Simulators, and Trends10 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model7 Apr 2026
- 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalization3 Feb 2026
- 2025Physics-Informed Spiking Neural Networks via Conservative Flux Quantization26 Nov 2025
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation22 Nov 2025
- 2025FreeAskWorld: An Interactive and Closed-Loop Simulator for Human-Centric Embodied AI17 Nov 2025
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenes17 Nov 2025
- 2025FDBPL: Faster Distillation-Based Prompt Learning for Region-Aware Vision-Language Models Adaptation23 May 2025
- 2025Image Recognition with Online Lightweight Vision Transformer: A Survey6 May 2025
- 2025RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning26 Apr 2025
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision3 Apr 2025
3 more
- 2025Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generation23 Feb 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Method12 Dec 2024
- 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalizationcited by 30
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulationcited by 15
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Modelcited by 8
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model7 Apr 2026
- 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalization3 Feb 2026
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation22 Nov 2025
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 67
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenescited by 3
- 2025Image Recognition with Online Lightweight Vision Transformer: A Surveycited by 2
- 2025FreeAskWorld: An Interactive and Closed-Loop Simulator for Human-Centric Embodied AIcited by 1
- 2026Intelligent Automation for Embodied Benchmark Construction: Pipelines, Embodiments, Simulators, and Trendscited by 1
- 2025Physics-Informed Spiking Neural Networks via Conservative Flux Quantizationcited by 0
- 2026Intelligent Automation for Embodied Benchmark Construction: Pipelines, Embodiments, Simulators, and Trends10 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2025Physics-Informed Spiking Neural Networks via Conservative Flux Quantization26 Nov 2025
- 2025FreeAskWorld: An Interactive and Closed-Loop Simulator for Human-Centric Embodied AI17 Nov 2025
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenes17 Nov 2025
- 2025Image Recognition with Online Lightweight Vision Transformer: A Survey6 May 2025
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Method12 Dec 2024