FORGE-Tree: Diffusion-Forcing Tree Search for Long-Horizon Robot Manipulation
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Long-horizon robot manipulation tasks remain challenging for Vision-Language-Action (VLA) policies due to drift and exposure bias, often denoise the entire trajectory with fixed hyperparameters, causing small geometric errors to compound across stages and offering no mechanism to allocate extra test-time compute where clearances are tight. To address these challenges, we introduce FORGE-Tree, a plug-in control layer that couples a stage-aligned Diffusion Forcing (DF) head with test-time Monte Carlo Tree Diffusion (MCTD). With a frozen VLA encoder, DF aligns timesteps to subtask stages; during inference we partially denoise only a target segment while keeping other tokens frozen, turning trajectory refinement into a sequence of local edits. We then apply Monte Carlo Tree Diffusion to select the next segment to refine. A scene graph supplies priors for expansion and geometry relation-aware scoring for rollouts, yielding tree-structured denoising whose performance scales with search budget while preserving the executed prefix. Evaluation on LIBERO, FORGE-Tree improves success rate by 13.4 to 17.2 pp over the native VLA baselines with both OpenVLA and Octo-Base. Gains remain consistent under comparable compute budgets, especially on long-horizon variants. Videos available at: https://taco-group.github.io/FORGE-Tree/
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 48 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
46 of 48 references.
Closest ancestors · 4
Same direction, newest first
- 2025MolmoAct: Action Reasoning Models that can Reason in Space11 Aug
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning16 Dec
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought24 May
Other references · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
30 more
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2020Integrated Task and Motion Planningcited by 281
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
- 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Modelscited by 87
- 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Modelscited by 82
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
- 2024RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins (early version)cited by 68
- 2024Diffusion-VLA: Generalizable and Interpretable Robot Foundation Model via Self-Generated Reasoningcited by 57
- 2024Scaling Diffusion Policy in Transformer to 1 Billion Parameters for Robotic Manipulationcited by 38
- 2024Generative Factor Chaining: Coordinated Manipulation with Diffusion-based Factor Graphcited by 12
- 2025Improving Pre-Trained Vision-Language-Action Policies with Model-Based Searchcited by 12
- 2025PANDORA: Diffusion Policy Learning for Dexterous Robotic Piano Playingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026A Definition and Roadmap for World Modelscited by 3
- 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectoriescited by 0
- 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectories1 Oct 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Non-Markovian Long-Horizon Robot Manipulation via Keyframe Chaining
- 2026Trace-Focused Diffusion Policy for Multi-Modal Action Disambiguation in Long-Horizon Robotic Manipulation
- 2026StairVLA: Stage-Aware Hierarchical Action Generation for Vision-Language-Action Models
- 2025VLA-Reasoner: Empowering Vision-Language-Action Models with Reasoning via Online Monte Carlo Tree Search
- 2025VLM-TDP: VLM-guided Trajectory-conditioned Diffusion Policy for Robust Long-Horizon Manipulation
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs
- 2024ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulation
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothing