mlsanityData to 14 Oct 2026

ConEQsA: Concurrent and Asynchronous Embodied Questions Scheduling and Answering

arXiv 2509.11663 ↗First posted 15 Sep 2025cs.RO cs.AI cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

This paper formulates the Embodied Questions Answering (EQsA) problem, introduces a corresponding benchmark, and proposes an agentic system to tackle the problem. Classical Embodied Question Answering (EQA) is typically formulated as answering one single question by actively exploring a 3D environment. Real deployments, however, often demand handling multiple questions that may arrive asynchronously and carry different urgencies. We formalize this setting as Embodied Questions Answering (EQsA) and present ConEQsA, an agentic framework for concurrent, urgency-aware scheduling and answering. ConEQsA leverages shared group memory to reduce redundant exploration, and a priority-planning method to dynamically schedule questions. To evaluate the EQsA setting fairly, we contribute the Concurrent Asynchronous Embodied Questions (CAEQs) benchmark containing 40 indoor scenes and five questions per scene (200 in total), featuring asynchronous follow-up questions and human-annotated urgency labels. We further propose metrics for EQsA performance: Direct Answer Rate (DAR), and Normalized Urgency-Weighted Latency (NUWL), which serve as a fair evaluation protocol for EQsA. Empirical evaluations demonstrate that ConEQsA consistently outperforms strong sequential baselines, and show that urgency-aware, concurrent scheduling is key to making embodied agents responsive and efficient under realistic, multi-question workloads. Code is available on https://anonymous.4open.science/r/ConEQsA.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 28 references that are in the map. First posted on arXiv 15 Sep 2025.

Builds on

17 of 28 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025AViLA: Asynchronous Vision-Language Agent for Streaming Multimodal Data Interaction23 Jun

Other references · 16

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  3. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  4. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  5. 2020Learning to Explore using Active Neural SLAMcited by 316
  6. 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 256
  7. 2017Neural Map: Structured Memory for Deep Reinforcement Learningcited by 90
  8. 2019Multi-Target Embodied Question Answeringcited by 74
  9. 2024Explore until Confident: Efficient Exploration for Embodied Question Answeringcited by 74
  10. 2025Simultaneous Multi-Robot Motion Planning with Projected Diffusion Modelscited by 38
  11. 2021Knowledge-based Embodied Question Answeringcited by 29
  12. 2025Enter the Mind Palace: Reasoning and Planning for Long-term Active Embodied Question Answeringcited by 14
4 more
  1. 2025Memory-Centric Embodied Question Answeringcited by 12
  2. 2025Can LLM Agents Solve Collaborative Tasks? A Study on Urgency-Aware Planning and Coordinationcited by 3
  3. 2023Extended Set-based Tasks for Multi-task Execution and Prioritizationcited by 2
  4. 2022Informable Multi-Objective and Multi-Directional RRT* System for Robot Path Planningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FAST-EQA: Efficient Embodied Question Answering with Global and Local Region Relevancy
  2. 2025Multi-Step Reasoning for Embodied Question Answering via Tool Augmentation
  3. 2025Beyond the Destination: A Novel Benchmark for Exploration-Aware Embodied Question Answering
  4. 2025CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space
  5. 2024GraphEQA: Using 3D Semantic Scene Graphs for Real-time Embodied Question Answering
  6. 2024EfficientEQA: An Efficient Approach to Open-Vocabulary Embodied Question Answering
  7. 2024Is the House Ready For Sleeptime? Generating and Evaluating Situational Queries for Embodied Question Answering
  8. 2025Prune-Then-Plan: Step-Level Calibration for Stable Frontier Exploration in Embodied Question Answering