Alexa Arena: A User-Centric Interactive Platform for Embodied AI
On the map: World models → World models for navigation
Abstract (arXiv)
We introduce Alexa Arena, a user-centric simulation platform for Embodied AI (EAI) research. Alexa Arena provides a variety of multi-room layouts and interactable objects, for the creation of human-robot interaction (HRI) missions. With user-friendly graphics and control mechanisms, Alexa Arena supports the development of gamified robotic tasks readily accessible to general human users, thus opening a new venue for high-efficiency HRI data collection and EAI system evaluation. Along with the platform, we introduce a dialog-enabled instruction-following benchmark and provide baseline results for it. We make Alexa Arena publicly available to facilitate research in building generalizable and assistive embodied agents.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 38 of its 58 references that are in the map. First posted on arXiv 2 Mar 2023.
Builds on
38 of 58 references.
Closest ancestors · 1
Same direction, newest first
Other references · 37
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017Mask R-CNNcited by 7,259
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
25 more
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
- 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 345
- 2020ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulationcited by 249
- 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 202
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 194
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
- 2021FILM: Following Instructions in Language with Modular Methodscited by 119
- 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
- 2019Help, Anna! Visual Navigation with Natural Multimodal Assistance via Retrospective Curiosity-Encouraging Imitation Learningcited by 100
- 2019Executing Instructions in Situated Collaborative Interactionscited by 68
- 2022DialFRED: Dialogue-Enabled Agents for Embodied Instruction Followingcited by 63
- 2019Just Ask:An Interactive Learning Framework for Vision and Language Navigationcited by 53
- 2019EvalAI: Towards Better Evaluation Systems for AI Agentscited by 34
- 2022Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Followingcited by 33
- 2020RMM: A Recursive Mental Model for Dialog Navigationcited by 32
- 2019VRKitchen: an Interactive 3D Virtual Environment for Task-oriented Learningcited by 29
- 2022Avalon: A Benchmark for RL Generalization Using Procedurally Generated Worldscited by 17
- 2017ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy Gamescited by 16
- 2020Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Taskscited by 15
Built on by
Citing papers per year: 2023: 4; 2024: 10; 2025: 3; 2026: 1.
18 papers.
Sort:
By area:
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2024VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thoughtcited by 55
- 2023Interactive Natural Language Processingcited by 31
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraftcited by 20
- 2023Multitask Multimodal Prompted Training for Interactive Embodied Task Completioncited by 9
- 2025Towards Understanding Visual Grounding in Visual Language Modelscited by 9
- 2023Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertaintycited by 8
- 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Modelscited by 8
- 2024SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Researchcited by 8
- 2024Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Taskscited by 8
- 2024Collaborative Instance Object Navigation: Leveraging Uncertainty-Awareness to Minimize Human-Agent Dialoguescited by 7
- 2025Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Trainingcited by 6
6 more
- 2023Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AIcited by 5
- 2024Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Modelscited by 3
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcarecited by 2
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationcited by 1
- 2024Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Communitycited by 0
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligencecited by 0
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence30 Aug 2026
- 2025Towards Understanding Visual Grounding in Visual Language Models12 Sep 2025
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation7 Aug 2025
- 2025Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training10 Feb 2025
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft6 Dec 2024
- 2024Collaborative Instance Object Navigation: Leveraging Uncertainty-Awareness to Minimize Human-Agent Dialogues2 Dec 2024
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov 2024
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare5 Nov 2024
- 2024Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models21 Sep 2024
- 2024Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Tasks4 Jul 2024
- 2024VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought20 Jun 2024
- 2024SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Research16 May 2024
6 more
- 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models29 Apr 2024
- 2024Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community1 Apr 2024
- 2023Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertainty2 Dec 2023
- 2023Multitask Multimodal Prompted Training for Interactive Embodied Task Completion7 Nov 2023
- 2023Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AI9 Aug 2023
- 2023Interactive Natural Language Processing22 May 2023
- 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Modelscited by 8
- 2024Collaborative Instance Object Navigation: Leveraging Uncertainty-Awareness to Minimize Human-Agent Dialoguescited by 7
- 2025Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Trainingcited by 6
- 2025Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training10 Feb 2025
- 2024Collaborative Instance Object Navigation: Leveraging Uncertainty-Awareness to Minimize Human-Agent Dialogues2 Dec 2024
- 2024HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models29 Apr 2024
- 2023Interactive Natural Language Processingcited by 31
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraftcited by 20
- 2023Multitask Multimodal Prompted Training for Interactive Embodied Task Completioncited by 9
- 2023Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertaintycited by 8
- 2024SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Researchcited by 8
- 2024Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Taskscited by 8
- 2023Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AIcited by 5
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcarecited by 2
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationcited by 1
- 2024Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Communitycited by 0
- 2025Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation7 Aug 2025
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft6 Dec 2024
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare5 Nov 2024
- 2024Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Tasks4 Jul 2024
- 2024SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Research16 May 2024
- 2024Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community1 Apr 2024
- 2023Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertainty2 Dec 2023
- 2023Multitask Multimodal Prompted Training for Interactive Embodied Task Completion7 Nov 2023
- 2023Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AI9 Aug 2023
- 2023Interactive Natural Language Processing22 May 2023
Similar, not cited
Close in wording, no citation either way
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI
- 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interaction
- 2026VirtualEnv: A Platform for Embodied AI Research
- 2026ETA: A New Agentic Paradigm for Embodied Tasks
- 2024Simulating User Agents for Embodied Conversational-AI
- 2025TongSIM: A General Platform for Simulating Intelligent Machines
- 2025Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability