mlsanityData to 7 Oct 2026

SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretraining

arXiv 2610.07652 ↗First posted 6 Oct 2026cs.RO cs.AIcited by 0

New in Vision-language-action models; no direction yet. Vision-language-action models

Abstract (arXiv)

The ability to interact with articulated objects is essential for embodied intelligent systems, but collecting large-scale real-world demonstrations for these interactions remains challenging due to the precise contact and constraint-following motions involved. Although simulation provides a promising alternative, existing synthetic data efforts cover limited articulated-object categories, while general-purpose synthesis pipelines lack explicit designs for part-level semantics and articulation constraints, hindering agentic task generation and scalable synthesis of high-quality articulated-manipulation demonstrations. To bridge this gap, we introduce SMART, a scalable system leveraging large-scale Synthesized Manipulation demonstrations for ARTiculated-object manipulation. At its core, we develop SMART-Sim, a simulation platform with articulation-aware design that enables effective task generation and efficient demonstration collection. Building on SMART-Sim, we apply agentic task generation and design a scalable distributed synthesis system, using them to synthesize SMART-Data, comprising over 1M demonstrations across 44 atomic task types, 5 robot setups, and 2,507 articulated objects. The vision-language-action (VLA) model pretrained on SMART-Data shows competitive performance on simulation benchmarks and achieves zero-shot sim-to-real transfer and scalable performance in real-world articulated-object manipulation tasks. This highlights the potential of synthetic demonstrations in providing effective and scalable supervision for improving VLA model performance in contact-rich articulated-object manipulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 6 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Models
  2. 2025ArticuBot: Learning Universal Articulated Object Manipulation Policy via Large Scale Simulation
  3. 2025AOMGen: Photoreal, Physics-Consistent Demonstration Generation for Articulated Object Manipulation
  4. 2026MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation
  5. 20263D Generation for Embodied AI and Robotic Simulation: A Survey
  6. 2026Grounding Sim-to-Real Generalization in Robotic Manipulation: An Empirical Study with Vision-Language-Action Models
  7. 2026Exploratory, Communicative, and Deployable: Vision-Driven Embodied Agents for Open-World Mobile Manipulation
  8. 2026Real2Gym: Building Gyms from Videos, Bringing Skills to Robots