mlsanityData to 14 Oct 2026

ReMCTS: Reflection-Enhanced Monte Carlo Tree Search for Code Generation

arXiv 2609.34717 ↗First posted 28 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-weight large language models (LLMs) can generate function-level programs from natural-language prompts, but plausible candidates still fail on hidden semantics and repeat mistakes across repair attempts. We present ReMCTS, an execution-grounded, memory-augmented, LLM-guided MCTS-style search framework. It organizes program candidates as tree states, retains branch-local debugging context, retrieves failure experience across branches, and distinguishes failed checks from unavailable evidence. On HumanEval and MBPP-Sanitized, visible-test ReMCTS improves over direct generation in 8 of 10 model-dataset pairs under held-out evaluation, whereas proxy-only search is less stable. Controlled tree-search, sampling, repair, and memory ablations characterize the source and limits of these gains. A 30-task HumanEval-X C++ pilot further demonstrates compatibility with compiler-backed execution, but does not constitute a broad multilingual evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

21 of 26 references.

References · 21

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2021Program Synthesis with Large Language Modelscited by 3,637
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  5. 2023Teaching Large Language Models to Self-Debugcited by 988
  6. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  7. 2022CodeT: Code Generation with Generated Testscited by 384
  8. 2023CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-Xcited by 300
  9. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 247
  10. 2023LEVER: Learning to Verify Language-to-Code Generation with Executioncited by 239
  11. 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 197
  12. 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
9 more
  1. 2023RLTF: Reinforcement Learning from Unit Test Feedbackcited by 114
  2. 2025S*: Test Time Scaling for Code Generationcited by 98
  3. 2022Coder Reviewer Reranking for Code Generationcited by 84
  4. 2024Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedbackcited by 46
  5. 2024RethinkMCTS: Refining Erroneous Thoughts in Monte Carlo Tree Search for Code Generationcited by 26
  6. 2025RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedbackcited by 25
  7. 2025CodeRL+: Improving Code Generation via Reinforcement with Execution Semantics Alignmentcited by 24
  8. 2026LLMLOOP: Improving LLM-Generated Code and Tests through Automated Iterative Feedback Loopscited by 8
  9. 2026An Iterative Test-and-Repair Framework for Competitive Code Generationcited by 2

Built on by

Not cited yet.