mlsanityData to 7 Oct 2026

EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models

arXiv 2605.17070 ↗First posted 16 May 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

While large vision-language models (VLMs) are increasingly adopted as the perceptual backbone for embodied agents, existing benchmarks often rely on question-answering or multiple-choice formats. These protocols allow models to exploit linguistic priors rather than demonstrating genuine visual grounding. To address this, we present EPIC-Bench, Embodied PerceptIon BenChmark, a fine-grained grounding benchmark designed to systematically evaluate the visual perceptual capabilities of VLMs in real-world embodied environments. Comprising 6.6k meticulously annotated tuples (Image, Text, Mask), EPIC-Bench spans 23 fine-grained tasks across three core stages of the embodied interaction pipeline: Target Localization, Navigation, and Manipulation. Extensive evaluations of over 89 leading VLMs reveal that while advanced reasoning models show promise, current VLMs universally struggle with complex visual-text alignment for physical interactions. Specifically, models exhibit critical bottlenecks in multi-target counting, part-whole relationship understanding, and affordance region detection. EPIC-Bench provides a robust foundation and actionable insights for advancing the next generation of vision-driven embodied models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 64 references that are in the map. First posted on arXiv 16 May 2026.

Builds on

36 of 64 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025RoboBrain 2.0 Technical Report2 Jul
  2. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  3. 2025Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces30 May
  4. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents13 Feb
  5. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics25 Nov

Other references · 31

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  3. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  4. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  6. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  7. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  8. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  9. 2016Modeling Context in Referring Expressionscited by 1,054
  10. 2025OpenAI GPT-5 System Cardcited by 910
  11. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  12. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
19 more
  1. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  2. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  3. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  4. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
  5. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
  6. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
  7. 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 116
  8. 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
  9. 2019EasyLabel: A Semi-Automatic Pixel-wise Object Annotation Tool for Creating Robotic RGB-D Datasetscited by 58
  10. 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47
  11. 2023Described Object Detection: Liberating Object Detection with Flexible Expressionscited by 40
  12. 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 38
  13. 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
  14. 2026STEP3-VL-10B Technical Reportcited by 28
  15. 2025RoboAfford++: A Generative AI-Enhanced Dataset for Multimodal Affordance Learning in Robotic Manipulation and Navigationcited by 17
  16. 2024ShapeGrasp: Zero-Shot Task-Oriented Grasping with Large Language Models through Geometric Decompositioncited by 14
  17. 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulationcited by 14
  18. 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligencecited by 10
  19. 2025Embodied intelligent industrial robotics: Framework and techniquescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding
  2. 2026Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models
  3. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models
  4. 2026Contextual Observer Grounding: Evaluating Situated Spatial Reasoning in Vision-Language Models
  5. 2025Does Visual Grounding Enhance the Understanding of Embodied Knowledge in Large Language Models?
  6. 2025Igniting VLMs toward the Embodied Space
  7. 2025Beyond Description: Cognitively Benchmarking Fine-Grained Action for Embodied Agents
  8. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models