SeeTraceAct: Visibility-Aware Latent Planning from Cross-Embodiment Demonstration Videos
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Vision-language-action models (VLAs) are promising general-purpose robot policies, but adapting them to new tasks typically requires costly task-specific teleoperation data. As an alternative, we study one-shot demo-conditioned VLAs, where a robot policy is conditioned on a single demonstration video of an unseen task. We find that existing end-to-end approaches often struggle when successful execution requires precisely localizing small target regions. To address this limitation, we propose SeeTraceAct, a demo-conditioned VLA framework that encourages precise spatial grounding through visibility-aware prediction of future end-effector traces. To enable reproducible evaluation with cross-embodiment demonstrations, we introduce and release RoboCasa-DC, a demo-conditioned extension of RoboCasa with episode-paired humanoid videos. Experiments on RoboCasa-DC and a real-world benchmark, where a Franka Panda arm is conditioned on human demonstrations, show that SeeTraceAct outperforms baselines, achieving the best success rate across all four RoboCasa-DC settings and improving real-world average success by 12.5 percentage points.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 31 of its 32 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
31 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2025See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations8 Dec
- 2024Latent Action Pretraining from Videos15 Oct
Other references · 29
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
17 more
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
- 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 131
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
- 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
- 2023XSkill: Cross Embodiment Skill Discoverycited by 74
- 2024OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitationcited by 62
- 2024Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformerscited by 47
- 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 30
- 2024DITTO: Demonstration Imitation by Trajectory Transformationcited by 28
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planningcited by 20
- 2025DemoDiffusion: One-Shot Human Imitation using pre-trained Diffusion Policycited by 16
- 2025PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulationcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026World Action Models are Zero-shot Policies
- 2026XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?
- 2026Learning to See While Learning to Act: Diffusion Models for Active Perception in Robot Imitation
- 2025AnchorDream: Repurposing Video Diffusion for Embodiment-Aware Robot Data Synthesis
- 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretraining
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
- 2026FOCA: Future-Oriented Conditioning for Data-Efficient Vision-Language-Action Adaptation
- 2026Masked Visual Actions for Unified World Modeling