mlsanityData to 7 Oct 2026

XEmbodied: A Foundation Model with Enhanced Geometric and Physical Cues for Large-Scale Embodied Environments

arXiv 2604.18484 ↗First posted 20 Apr 2026cs.CV cs.MM cs.ROcited by 1

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

Vision-Language-Action (VLA) models drive next-generation autonomous systems, but training them requires scalable, high-quality annotations from complex environments. Current cloud pipelines rely on generic vision-language models (VLMs) that lack geometric reasoning and domain semantics due to their 2D image-text pretraining. To address this mismatch, we propose XEmbodied, a cloud-side foundation model that endows VLMs with intrinsic 3D geometric awareness and interaction with physical cues (e.g., occupancy grids, 3D boxes). Instead of treating geometry as auxiliary input, XEmbodied integrates geometric representations via a structured 3D Adapter and distills physical signals into context tokens using an Efficient Image-Embodied Adapter. Through progressive domain curriculum and reinforcement learning post-training, XEmbodied preserves general capabilities while demonstrating robust performance across 18 public benchmarks. It significantly improves spatial reasoning, traffic semantics, embodied affordance, and out-of-distribution generalization for large-scale scenario mining and embodied VQA.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 42 of its 71 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

42 of 71 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  9. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  10. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  11. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  12. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
30 more
  1. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
  2. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
  3. 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
  4. 2018Textual Explanations for Self-Driving Vehiclescited by 226
  5. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  6. 2023A Language Agent for Autonomous Drivingcited by 161
  7. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
  8. 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 144
  9. 2024MambaOut: Do We Really Need Mamba for Vision?cited by 142
  10. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
  11. 2023Dolphins: Multimodal Language Model for Drivingcited by 124
  12. 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Drivingcited by 122
  13. 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 120
  14. 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 116
  15. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
  16. 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
  17. 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learningcited by 83
  18. 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
  19. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoningcited by 65
  20. 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 50
  21. 2023VL-Grasp: a 6-Dof Interactive Grasp Policy for Language-Oriented Objects in Cluttered Indoor Scenescited by 40
  22. 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulationcited by 36
  23. 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
  24. 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understandingcited by 35
  25. 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
  26. 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Drivingcited by 21
  27. 2024FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedbackcited by 18
  28. 2024Data-Centric Evolution in Autonomous Driving: A Comprehensive Survey of Big Data System, Data Mining, and Closed-Loop Technologiescited by 17
  29. 2025FASIONAD++ : Integrating High-Level Instruction and Information Bottleneck in FAt-Slow fusION Systems for Enhanced Safety in Autonomous Driving with Adaptive Feedbackcited by 12
  30. 2025LEGO-Motion: Learning-Enhanced Grids with Occupancy Instance Modeling for Class-Agnostic Motion Predictioncited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026VGGT-Omegacited by 20

Similar, not cited

Close in wording, no citation either way

  1. 2025GLaD: Geometric Latent Distillation for Vision-Language-Action Models
  2. 2025EmbRACE-3K: Embodied Reasoning and Action in Complex Environments
  3. 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Models
  4. 2025Igniting VLMs toward the Embodied Space
  5. 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
  6. 2026StrataVLA: Hierarchical and Efficient 3D Geometric Grounding for Vision-Language-Action Models
  7. 20243D-VLA: A 3D Vision-Language-Action Generative World Model
  8. 2025OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervision