mlsanityData to 14 Oct 2026

Reward-Centered ReST-MCTS: A Robust Decision-Making Framework for Robotic Manipulation in High Uncertainty Environments

arXiv 2503.05226 ↗First posted 7 Mar 2025cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Monte Carlo tree search is attractive for robotic manipulation because it can improve action selection through simulation without requiring a fully differentiable policy. In uncertain domains, however, sparse terminal rewards and noisy transitions can make shallow search brittle: many candidate branches remain indistinguishable until late rollouts, and small simulation budgets amplify this ambiguity. This paper presents Reward-Centered ReST-MCTS, a decision-making framework that decomposes intermediate feedback into rule, heuristic, optional neural, and value-estimation channels, centers the resulting process signal against matched task contexts, and uses it to bias or repair search while preserving terminal-task evaluation. The primary evidence is intentionally tiered. Local tasks and matched ManiSkill diagnostics isolate reward-center mechanisms and ablations; matched option-level ManiSkill sweeps test robustness under primitive failure, observation noise, and initial-pose shifts while not claiming standard benchmark superiority; and an official same-backbone OpenVLA-OFT/LIBERO bridge tests bounded VLA action repair. The OpenVLA-OFT clean reproduction reaches 10/10 LIBERO-Spatial successes both with and without RCRM-Guard. A single-suite same-backbone action-channel stress artifact over ten paired LIBERO-Spatial action-channel stress episodes records 0/10 unguarded successes and 9/10 guarded successes. Additional observation-noise, language-perturbation, and visual-distractor probes are reported as coverage and negative-result context rather than superiority evidence. The resulting claim is bounded: Reward-Centered ReST-MCTS is an inspectable test-time verifier for same-backbone high-uncertainty manipulation, not a replacement VLA policy or a broad standard-benchmark superiority claim.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 7 Mar 2025.

Builds on

16 of 37 references.

References · 16

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Let's Verify Step by Stepcited by 3,789
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  8. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  9. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  10. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  11. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  12. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
4 more
  1. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
  2. 2023Reinforced Self-Training (ReST) for Language Modelingcited by 500
  3. 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
  4. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics
  2. 2026ARM: Advantage Reward Modeling for Long-Horizon Manipulation
  3. 2026RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation
  4. 2025Robotic Long-Horizon Manipulation with Bayesian Non-parametric Skill Priors
  5. 2025ReLAM: Learning Anticipation Model for Rewarding Visual Robotic Manipulation
  6. 2025A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewards
  7. 2025SARM: Stage-Aware Reward Modeling for Long Horizon Robot Manipulation
  8. 2026Beyond Pixels: Learning Invariant Rewards for Real-World Robotics From a Few Demonstrations