EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
While large vision-language models (VLMs) are increasingly adopted as the perceptual backbone for embodied agents, existing benchmarks often rely on question-answering or multiple-choice formats. These protocols allow models to exploit linguistic priors rather than demonstrating genuine visual grounding. To address this, we present EPIC-Bench, Embodied PerceptIon BenChmark, a fine-grained grounding benchmark designed to systematically evaluate the visual perceptual capabilities of VLMs in real-world embodied environments. Comprising 6.6k meticulously annotated tuples (Image, Text, Mask), EPIC-Bench spans 23 fine-grained tasks across three core stages of the embodied interaction pipeline: Target Localization, Navigation, and Manipulation. Extensive evaluations of over 89 leading VLMs reveal that while advanced reasoning models show promise, current VLMs universally struggle with complex visual-text alignment for physical interactions. Specifically, models exhibit critical bottlenecks in multi-target counting, part-whole relationship understanding, and affordance region detection. EPIC-Bench provides a robust foundation and actionable insights for advancing the next generation of vision-driven embodied models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 64 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
36 of 64 references.
Closest ancestors · 5
Same direction, newest first
- 2025RoboBrain 2.0 Technical Report2 Jul
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces30 May
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents13 Feb
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics25 Nov
Other references · 31
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2025OpenAI GPT-5 System Cardcited by 910
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
19 more
- 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 116
- 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
- 2019EasyLabel: A Semi-Automatic Pixel-wise Object Annotation Tool for Creating Robotic RGB-D Datasetscited by 58
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47
- 2023Described Object Detection: Liberating Object Detection with Flexible Expressionscited by 40
- 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 38
- 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
- 2026STEP3-VL-10B Technical Reportcited by 28
- 2025RoboAfford++: A Generative AI-Enhanced Dataset for Multimodal Affordance Learning in Robotic Manipulation and Navigationcited by 17
- 2024ShapeGrasp: Zero-Shot Task-Oriented Grasping with Large Language Models through Geometric Decompositioncited by 14
- 2025GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulationcited by 14
- 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligencecited by 10
- 2025Embodied intelligent industrial robotics: Framework and techniquescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding
- 2026Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models
- 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models
- 2026Contextual Observer Grounding: Evaluating Situated Spatial Reasoning in Vision-Language Models
- 2025Does Visual Grounding Enhance the Understanding of Embodied Knowledge in Large Language Models?
- 2025Igniting VLMs toward the Embodied Space
- 2025Beyond Description: Cognitively Benchmarking Fine-Grained Action for Embodied Agents
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models