XEmbodied: A Foundation Model with Enhanced Geometric and Physical Cues for Large-Scale Embodied Environments
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models drive next-generation autonomous systems, but training them requires scalable, high-quality annotations from complex environments. Current cloud pipelines rely on generic vision-language models (VLMs) that lack geometric reasoning and domain semantics due to their 2D image-text pretraining. To address this mismatch, we propose XEmbodied, a cloud-side foundation model that endows VLMs with intrinsic 3D geometric awareness and interaction with physical cues (e.g., occupancy grids, 3D boxes). Instead of treating geometry as auxiliary input, XEmbodied integrates geometric representations via a structured 3D Adapter and distills physical signals into context tokens using an Efficient Image-Embodied Adapter. Through progressive domain curriculum and reinforcement learning post-training, XEmbodied preserves general capabilities while demonstrating robust performance across 18 public benchmarks. It significantly improves spatial reasoning, traffic semantics, embodied affordance, and out-of-distribution generalization for large-scale scenario mining and embodied VQA.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 42 of its 71 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
42 of 71 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
30 more
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2018Textual Explanations for Self-Driving Vehiclescited by 226
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
- 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 144
- 2024MambaOut: Do We Really Need Mamba for Vision?cited by 142
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
- 2023Dolphins: Multimodal Language Model for Drivingcited by 124
- 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Drivingcited by 122
- 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 120
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 116
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
- 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learningcited by 83
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
- 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoningcited by 65
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 50
- 2023VL-Grasp: a 6-Dof Interactive Grasp Policy for Language-Oriented Objects in Cluttered Indoor Scenescited by 40
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulationcited by 36
- 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
- 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understandingcited by 35
- 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
- 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Drivingcited by 21
- 2024FASIONAD : FAst and Slow FusION Thinking Systems for Human-Like Autonomous Driving with Adaptive Feedbackcited by 18
- 2024Data-Centric Evolution in Autonomous Driving: A Comprehensive Survey of Big Data System, Data Mining, and Closed-Loop Technologiescited by 17
- 2025FASIONAD++ : Integrating High-Level Instruction and Information Bottleneck in FAt-Slow fusION Systems for Enhanced Safety in Autonomous Driving with Adaptive Feedbackcited by 12
- 2025LEGO-Motion: Learning-Enhanced Grids with Occupancy Instance Modeling for Class-Agnostic Motion Predictioncited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026VGGT-Omegacited by 20
- 2026VGGT-Omega14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025GLaD: Geometric Latent Distillation for Vision-Language-Action Models
- 2025EmbRACE-3K: Embodied Reasoning and Action in Complex Environments
- 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Models
- 2025Igniting VLMs toward the Embodied Space
- 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
- 2026StrataVLA: Hierarchical and Efficient 3D Geometric Grounding for Vision-Language-Action Models
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model
- 2025OccVLA: Vision-Language-Action Model with Implicit 3D Occupancy Supervision