mlsanityData to 14 Oct 2026

Embodied Operators and Benchmarking: Toward Reusable and Deployable Embodied Intelligence Systems

arXiv 2607.03283 ↗First posted 3 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Embodied intelligence systems require not only end-to-end policy models, but also reusable functional modules that transform multimodal observations, robot states, human demonstrations, and task contexts into structured representations, decisions, trajectories, control references, and system services. This work defines these modules as embodied operators and studies them as independent yet composable units in embodied intelligence pipelines. We clarify their definition boundary, emphasizing task semantics, standardized input-output contracts, deployability, reusability, and multi-layer optimizability. We further construct a taxonomy covering five categories: detection and segmentation, spatial localization and 3D understanding, hand motion recovery, embodied foundation models and task-decision operators, and planning, control, and system support operators. For each category, we summarize representative functions, technical paradigms, application roles, and practical limitations. Beyond taxonomy, we propose a multi-dimensional benchmark framework that evaluates embodied operators in terms of correctness, end-to-end efficiency, resource usage, temporal stability, portability, interface compatibility, deployment reliability, and downstream task utility. We also discuss workflow-level operator acceleration and open challenges in operator composition, data standardization, world models, VLA safety, edge deployment, and real-world application value. Overall, this work argues that embodied operators should be optimized and evaluated as holistic deployable components, providing a foundation for reusable, scalable, and verifiable embodied intelligence systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 75 references that are in the map. First posted on arXiv 3 Jul 2026.

Builds on

58 of 75 references.

References · 58

  1. 2023Segment Anythingcited by 8,234
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  10. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  12. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
38 more
  1. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
  2. 2025SAM 3: Segment Anything with Conceptscited by 906
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  4. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
  5. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  6. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  7. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
  8. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
  9. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
  10. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  11. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  12. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  13. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
  14. 2026Causal World Modeling for Robot Controlcited by 321
  15. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  16. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  17. 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
  18. 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 208
  19. 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
  20. 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
  21. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  22. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
  23. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
  24. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
  25. 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
  26. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
  27. 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
  28. 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
  29. 2020The Marathon 2: A Navigation Systemcited by 70
  30. 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 51
  31. 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
  32. 2023A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Imagecited by 32
  33. 2025ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splattingcited by 25
  34. 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomycited by 23
  35. 2024All Robots in One: A New Standard and Unified Dataset for Versatile, General-Purpose Embodied Agentscited by 15
  36. 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanismscited by 13
  37. 2025NeRFPrior: Learning Neural Radiance Field as a Prior for Indoor Scene Reconstructioncited by 12
  38. 2026Embodied Foundation Models at the Edge: A Survey of Deployment Constraints and Mitigation Strategiescited by 9

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
  2. 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
  3. 2025P3: Toward Versatile Embodied Agents
  4. 2026Embodied Skill Bench: Benchmarking How Well Agents with Embodied Skills Perform on Physical Tasks
  5. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
  6. 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment
  7. 2026ETA: A New Agentic Paradigm for Embodied Tasks
  8. 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory