mlsanityData to 14 Oct 2026

DreamTrajectory: Trajectory-Guided Action Generation with World Model Alignment for Mobile Manipulation

arXiv 2608.01381 ↗First posted 2 Aug 2026cs.ROcited by 2

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Mobile manipulation requires a robot to coordinate base and arm motion under continuously changing viewpoints and contact conditions, within an action space far larger than that of fixed-base manipulation. Existing Vision-Language-Action (VLA) policies are limited in two respects. (i)They map observations directly to whole-body action chunks, searching this large action space without an explicit task-space motion plan, which makes coordinated base--arm prediction imprecise. (ii)They execute the predicted chunk open-loop, without checking whether the actions can realize the motion the policy intended, so control errors and unmodeled contacts accumulate into a gap between planned and realized motion. We present DreamTrajectory, a trajectory-guided framework for language-conditioned mobile manipulation that introduces one component for each limitation. Addressing(i), DreamTrajectory jointly predicts an intention-level end-effector trajectory and a whole-body action chunk in a single action expert, so that the trajectory explicitly guides base--arm action generation instead of remaining implicit. Addressing(ii), a lightweight trajectory world model predicts the trajectory that a candidate action chunk would induce, and a test-time search--predict--score procedure selects the candidate best aligned with the planned trajectory. On MS-HAB, trajectory guidance raises average success from 32.3% to 47.5% and test-time refinement further to 54.8%, with the largest gains on contact-rich articulated-object tasks. On three real-world mobile manipulation tasks, the corresponding average success rates are 63.3%, 81.7%, and 90.0%.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 23 of its 34 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

23 of 34 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  2. 2026World Action Models are Zero-shot Policies17 Feb
  3. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  4. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr

Other references · 19

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  5. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  6. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  7. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  8. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  9. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  10. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  11. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  12. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
7 more
  1. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
  2. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  3. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
  4. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
  5. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 81
  6. 2025MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulationcited by 34
  7. 2025Diffusion Trajectory-guided Policy for Long-horizon Robot Manipulationcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation
  2. 2026World Models for Robotic Manipulation: A Survey
  3. 2026MM-ABC: Towards Generalist Mobile Manipulation via Seeing, Coordinating and Imagining ↗
  4. 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model
  5. 2026MobileManiBench: Simplifying Model Verification for Mobile Manipulation
  6. 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation
  7. 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation
  8. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation