mlsanityData to 14 Oct 2026

RoboView-Bias: Benchmarking Visual Bias in Embodied Agents for Robotic Manipulation

arXiv 2509.22356 ↗First posted 26 Sep 2025cs.RO cs.CVcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

The safety and reliability of embodied agents rely on accurate and unbiased visual perception. However, existing benchmarks mainly emphasize generalization and robustness under perturbations, while systematic quantification of visual bias remains scarce. This gap limits a deeper understanding of how perception influences decision-making stability. To address this issue, we propose RoboView-Bias, the first benchmark specifically designed to systematically quantify visual bias in robotic manipulation, following a principle of factor isolation. Leveraging a structured variant-generation framework and a perceptual-fairness validation protocol, we create 2,127 task instances that enable robust measurement of biases induced by individual visual factors and their interactions. Using this benchmark, we systematically evaluate three representative embodied agents across two prevailing paradigms and report three key findings: (i) all agents exhibit significant visual biases, with camera viewpoint being the most critical factor; (ii) agents achieve their highest success rates on highly saturated colors, indicating inherited visual preferences from underlying VLMs; and (iii) visual biases show strong, asymmetric coupling, with viewpoint strongly amplifying color-related bias. Finally, we demonstrate that a mitigation strategy based on a semantic grounding layer substantially reduces visual bias by approximately 54.5% on MOKA. Our results highlight that systematic analysis of visual bias is a prerequisite for developing safe and reliable general-purpose embodied agents.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 54 of its 63 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

54 of 63 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making9 Oct

Other references · 53

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Segment Anythingcited by 8,234
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  10. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  11. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  12. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
38 more
  1. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  2. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  3. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  4. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  5. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  6. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  7. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
  8. 2017Robust Adversarial Reinforcement Learningcited by 451
  9. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  10. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  11. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  12. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  13. 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 319
  14. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
  15. 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
  16. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
  17. 2023Imitating Human Behaviour with Diffusion Modelscited by 263
  18. 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
  19. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
  20. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  21. 2024Benchmarking Complex Instruction-Following with Multiple Constraints Compositioncited by 152
  22. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 148
  23. 2016EPOpt: Learning Robust Neural Network Policies Using Model Ensemblescited by 138
  24. 2024InFoBench: Evaluating Instruction Following Ability in Large Language Modelscited by 135
  25. 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 133
  26. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
  27. 2023BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learningcited by 115
  28. 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 99
  29. 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 87
  30. 2023Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulationcited by 82
  31. 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learningcited by 80
  32. 2024SafeBench: A Safety Evaluation Framework for Multimodal Large Language Modelscited by 69
  33. 2025RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learningcited by 54
  34. 2024Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shiftcited by 49
  35. 2024BadRobot: Jailbreaking Embodied LLM Agents in the Physical Worldcited by 43
  36. 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 38
  37. 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 24
  38. 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
  2. 2026RoboFollow: Unveiling the Instruction Following Mirage in Embodied Agents
  3. 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation
  4. 2026Probing an Embodied LLM: When Higher Observation Fidelity Hurts Problem Solving
  5. 2026FOCUS: From Privileged States to RGB-D with Controlled Modality Switching and Representation Alignment ↗
  6. 2025Predictive Red Teaming: Breaking Policies Without Breaking Robots
  7. 2024Visual Preference Inference: An Image Sequence-Based Preference Reasoning in Tabletop Object Manipulation
  8. 2026TriWorldBench: A Tri-View Consistency Perspective on Embodied World Models