mlsanityData to 7 Oct 2026

SeeTraceAct: Visibility-Aware Latent Planning from Cross-Embodiment Demonstration Videos

arXiv 2606.02745 ↗First posted 1 Jun 2026cs.RO cs.LGcited by 2

On the map: Vision-language-action models → Human-video and latent-action pretraining

Abstract (arXiv)

Vision-language-action models (VLAs) are promising general-purpose robot policies, but adapting them to new tasks typically requires costly task-specific teleoperation data. As an alternative, we study one-shot demo-conditioned VLAs, where a robot policy is conditioned on a single demonstration video of an unseen task. We find that existing end-to-end approaches often struggle when successful execution requires precisely localizing small target regions. To address this limitation, we propose SeeTraceAct, a demo-conditioned VLA framework that encourages precise spatial grounding through visibility-aware prediction of future end-effector traces. To enable reproducible evaluation with cross-embodiment demonstrations, we introduce and release RoboCasa-DC, a demo-conditioned extension of RoboCasa with episode-paired humanoid videos. Experiments on RoboCasa-DC and a real-world benchmark, where a Franka Panda arm is conditioned on human demonstrations, show that SeeTraceAct outperforms baselines, achieving the best success rate across all four RoboCasa-DC settings and improving real-world average success by 12.5 percentage points.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 31 of its 32 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

31 of 32 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations8 Dec
  2. 2024Latent Action Pretraining from Videos15 Oct

Other references · 29

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  8. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  9. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  10. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
  11. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  12. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
17 more
  1. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  2. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  3. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  4. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  5. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  6. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
  7. 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 131
  8. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
  9. 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
  10. 2023XSkill: Cross Embodiment Skill Discoverycited by 74
  11. 2024OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitationcited by 62
  12. 2024Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformerscited by 47
  13. 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 30
  14. 2024DITTO: Demonstration Imitation by Trajectory Transformationcited by 28
  15. 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planningcited by 20
  16. 2025DemoDiffusion: One-Shot Human Imitation using pre-trained Diffusion Policycited by 16
  17. 2025PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026World Action Models are Zero-shot Policies
  2. 2026XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?
  3. 2026Learning to See While Learning to Act: Diffusion Models for Active Perception in Robot Imitation
  4. 2025AnchorDream: Repurposing Video Diffusion for Embodiment-Aware Robot Data Synthesis
  5. 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretraining
  6. 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
  7. 2026FOCA: Future-Oriented Conditioning for Data-Efficient Vision-Language-Action Adaptation
  8. 2026Masked Visual Actions for Unified World Modeling