Embodied Operators and Benchmarking: Toward Reusable and Deployable Embodied Intelligence Systems
Not on the map. Why?
Abstract (arXiv)
Embodied intelligence systems require not only end-to-end policy models, but also reusable functional modules that transform multimodal observations, robot states, human demonstrations, and task contexts into structured representations, decisions, trajectories, control references, and system services. This work defines these modules as embodied operators and studies them as independent yet composable units in embodied intelligence pipelines. We clarify their definition boundary, emphasizing task semantics, standardized input-output contracts, deployability, reusability, and multi-layer optimizability. We further construct a taxonomy covering five categories: detection and segmentation, spatial localization and 3D understanding, hand motion recovery, embodied foundation models and task-decision operators, and planning, control, and system support operators. For each category, we summarize representative functions, technical paradigms, application roles, and practical limitations. Beyond taxonomy, we propose a multi-dimensional benchmark framework that evaluates embodied operators in terms of correctness, end-to-end efficiency, resource usage, temporal stability, portability, interface compatibility, deployment reliability, and downstream task utility. We also discuss workflow-level operator acceleration and open challenges in operator composition, data standardization, world models, VLA safety, edge deployment, and real-world application value. Overall, this work argues that embodied operators should be optimized and evaluated as holistic deployable components, providing a foundation for reusable, scalable, and verifiable embodied intelligence systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 75 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
58 of 75 references.
References · 58
- 2023Segment Anythingcited by 8,234
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
38 more
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2026Causal World Modeling for Robot Controlcited by 321
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 208
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
- 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
- 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
- 2020The Marathon 2: A Navigation Systemcited by 70
- 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 51
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
- 2023A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Imagecited by 32
- 2025ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splattingcited by 25
- 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomycited by 23
- 2024All Robots in One: A New Standard and Unified Dataset for Versatile, General-Purpose Embodied Agentscited by 15
- 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanismscited by 13
- 2025NeRFPrior: Learning Neural Radiance Field as a Prior for Indoor Scene Reconstructioncited by 12
- 2026Embodied Foundation Models at the Edge: A Survey of Deployment Constraints and Mitigation Strategiescited by 9
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
- 2025P3: Toward Versatile Embodied Agents
- 2026Embodied Skill Bench: Benchmarking How Well Agents with Embodied Skills Perform on Physical Tasks
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment
- 2026ETA: A New Agentic Paradigm for Embodied Tasks
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory