RoboView-Bias: Benchmarking Visual Bias in Embodied Agents for Robotic Manipulation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The safety and reliability of embodied agents rely on accurate and unbiased visual perception. However, existing benchmarks mainly emphasize generalization and robustness under perturbations, while systematic quantification of visual bias remains scarce. This gap limits a deeper understanding of how perception influences decision-making stability. To address this issue, we propose RoboView-Bias, the first benchmark specifically designed to systematically quantify visual bias in robotic manipulation, following a principle of factor isolation. Leveraging a structured variant-generation framework and a perceptual-fairness validation protocol, we create 2,127 task instances that enable robust measurement of biases induced by individual visual factors and their interactions. Using this benchmark, we systematically evaluate three representative embodied agents across two prevailing paradigms and report three key findings: (i) all agents exhibit significant visual biases, with camera viewpoint being the most critical factor; (ii) agents achieve their highest success rates on highly saturated colors, indicating inherited visual preferences from underlying VLMs; and (iii) visual biases show strong, asymmetric coupling, with viewpoint strongly amplifying color-related bias. Finally, we demonstrate that a mitigation strategy based on a semantic grounding layer substantially reduces visual bias by approximately 54.5% on MOKA. Our results highlight that systematic analysis of visual bias is a prerequisite for developing safe and reliable general-purpose embodied agents.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 54 of its 63 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
54 of 63 references.
Closest ancestors · 1
Same direction, newest first
Other references · 53
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
38 more
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2017Robust Adversarial Reinforcement Learningcited by 451
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 319
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2023Imitating Human Behaviour with Diffusion Modelscited by 263
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2024Benchmarking Complex Instruction-Following with Multiple Constraints Compositioncited by 152
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 148
- 2016EPOpt: Learning Robust Neural Network Policies Using Model Ensemblescited by 138
- 2024InFoBench: Evaluating Instruction Following Ability in Large Language Modelscited by 135
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 133
- 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
- 2023BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learningcited by 115
- 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 99
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 87
- 2023Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulationcited by 82
- 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learningcited by 80
- 2024SafeBench: A Safety Evaluation Framework for Multimodal Large Language Modelscited by 69
- 2025RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learningcited by 54
- 2024Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shiftcited by 49
- 2024BadRobot: Jailbreaking Embodied LLM Agents in the Physical Worldcited by 43
- 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 38
- 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 24
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
- 2026RoboFollow: Unveiling the Instruction Following Mirage in Embodied Agents
- 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation
- 2026Probing an Embodied LLM: When Higher Observation Fidelity Hurts Problem Solving
- 2026FOCUS: From Privileged States to RGB-D with Controlled Modality Switching and Representation Alignment ↗
- 2025Predictive Red Teaming: Breaking Policies Without Breaking Robots
- 2024Visual Preference Inference: An Image Sequence-Based Preference Reasoning in Tabletop Object Manipulation
- 2026TriWorldBench: A Tri-View Consistency Perspective on Embodied World Models