mlsanityData to 7 Oct 2026

SABER: A Scalable Action-Based Embodied Dataset for Real-World VLA Adaptation

arXiv 2605.09613 ↗First posted 10 May 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Robotic deployment in real-world environments depends on rich, domain-specific action data as much as on strong model architecture. General-purpose robot foundation models show modest performance in complex unseen tasks such as manipulation in a retail domain when applied out of the box. The root cause is a data gap: retail environments are structurally absent from general robot pretraining distributions, and the path to filling that gap through teleoperation is prohibitively expensive, logistically constrained, and difficult to scale. We introduce SABER, a high-fidelity retail robotics action dataset built from over 100 hours of natural in-store capture across multiple real grocery environments. Egocentric footage from head-mounted cameras records fine-grained hand activity at the point of interaction, while exocentric 360-degree scene footage from DreamVu's ALIA camera simultaneously observes all actors and activities across the entire space. This combination yields a uniquely complete picture of human retail behavior: dexterous hand activity, whole-body motion, and scene dynamics, all captured without staging, scripting, or teleoperation overhead. The SABER corpus contains 44.8K training samples across three action representation streams: 25K latent action sequences via LAPA-style encoding, 18.6K dexterous hand-pose trajectories retargeted to robot joint space, and 1.2K whole-body synchronized motion sequences retargeted to a humanoid embodiment. When applied to GR00T N1.6 via a shared-backbone multi-task post-training recipe, SABER yields a mean success rate of 29.3% across ten retail manipulation tasks -- more than 2.19x over fine-tuning baselines (13.4%). SABER demonstrates that the path to capable retail robots runs through better data, which can be collected today, at scale, without a robot in the loop. The dataset and code are available at https://dreamvu.ai/saber

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

13 of 29 references.

References · 13

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  7. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  8. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  9. 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 136
  10. 2019DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm Systemcited by 105
  11. 2022Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtubecited by 79
  12. 2024AdaFlow: Imitation Learning with Variance-Adaptive Flow-Based Policiescited by 50
1 more
  1. 2026PRISM: A Multi-View Multi-Capability Retail Video Dataset for Embodied Vision-Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RetailSMV: Exocentric vs. Egocentric Adaptation of Foundation Video World Models in Retail
  2. 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomy
  3. 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
  4. 2025Sari Sandbox: A Virtual Retail Store Environment for Embodied AI Agents
  5. 2025RoboBenchMart: Benchmarking Robots in Retail Environment
  6. 2026Joint-Aligned Latent Action: Towards Scalable VLA Pretraining in the Wild
  7. 2025Masquerade: Learning from In-the-wild Human Videos using Data-Editing
  8. 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation