mlsanityData to 7 Oct 2026

o1-Coder: an o1 Replication for Coding

arXiv 2412.00154 ↗First posted 29 Nov 2024cs.SE cs.AIcited by 77

Not on the map. Why?

Cited by 58 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The technical report introduces O1-CODER, an attempt to replicate OpenAI's o1 model with a focus on coding tasks. It integrates reinforcement learning (RL) and Monte Carlo Tree Search (MCTS) to enhance the model's System-2 thinking capabilities. The framework includes training a Test Case Generator (TCG) for standardized code testing, using MCTS to generate code data with reasoning processes, and iteratively fine-tuning the policy model to initially produce pseudocode and then generate the full code. The report also addresses the opportunities and challenges in deploying o1-like models in real-world applications, suggesting transitioning to the System-2 paradigm and highlighting the imperative for world model construction. Updated model progress and experimental results will be reported in subsequent versions. All source code, curated datasets, as well as the derived models are disclosed at https://github.com/ADaM-BJTU/O1-CODER .

Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 29 Nov 2024.

Builds on

21 of 38 references.

References · 21

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2021Program Synthesis with Large Language Modelscited by 3,509
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  4. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  5. 2024Qwen2 Technical Reportcited by 2,076
  6. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  7. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  8. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 292
  9. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 291
  10. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 283
  11. 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
  12. 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 187
9 more
  1. 2023TACO: Topics in Algorithmic COde generation datasetcited by 150
  2. 2024Marco-o1: Towards Open Reasoning Models for Open-Ended Solutionscited by 142
  3. 2024O1 Replication Journey: A Strategic Progress Report -- Part 1cited by 140
  4. 2024Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solverscited by 137
  5. 2024OpenR: An Open Source Framework for Advanced Reasoning with Large Language Modelscited by 92
  6. 2024LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoningcited by 90
  7. 2024ALR2: A Retrieve-then-Reason Framework for Long-context Question Answeringcited by 25
  8. 2021Thinking Fast and Slow in AI: the Role of Metacognitioncited by 11
  9. 2024Equitable Access to Justice: Logical LLMs Show Promisecited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 68; 2026: 6.

77 papers.

Sort:

By area:

  1. 2025s1: Simple test-time scalingcited by 1,311
  2. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  3. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
  4. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  5. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  6. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  7. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 215
  8. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
  9. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 94
  10. 2025GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoningcited by 94
  11. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
  12. 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 86
38 more
  1. 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learningcited by 83
  2. 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 61
  3. 2025RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?cited by 60
  4. 2025Logical Reasoning in Large Language Models: A Surveycited by 52
  5. 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Modelscited by 52
  6. 2025Co-Evolving LLM Coder and Unit Tester via Reinforcement Learningcited by 51
  7. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
  8. 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoningcited by 40
  9. 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
  10. 2025O1 Replication Journey -- Part 3: Inference-time Scaling for Medical Reasoningcited by 34
  11. 2025Search and Refine During Think: Facilitating Knowledge Refinement for Improved Retrieval-Augmented Reasoningcited by 34
  12. 2025Scalable Chain of Thoughts via Elastic Reasoningcited by 32
  13. 2025Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoningcited by 29
  14. 2024DRT: Deep Reasoning Translation via Long Chain-of-Thoughtcited by 28
  15. 2025OptimAI: Optimization from Natural Language Using LLM-Powered AI Agentscited by 22
  16. 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learningcited by 21
  17. 2025ChemDFM-R: A Chemical Reasoning LLM Enhanced with Atomized Chemical Knowledgecited by 20
  18. 2025video-SALMONN-o1: Reasoning-enhanced Audio-visual Large Language Modelcited by 19
  19. 2025DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Modelscited by 19
  20. 2025A Survey of Slow Thinking-based Reasoning LLMs using Reinforced Learning and Inference-time Scaling Lawcited by 18
  21. 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessmentcited by 18
  22. 2025ThinkPatterns-21k: A Systematic Study on the Impact of Thinking Patterns in LLMscited by 16
  23. 2025CoRT: Code-integrated Reasoning within Thinkingcited by 15
  24. 2025Generative AI Act II: Test Time Scaling Drives Cognition Engineeringcited by 14
  25. 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
  26. 2024OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuningcited by 13
  27. 2025Sample Complexity and Representation Ability of Test-time Scaling Paradigmscited by 12
  28. 2025ExTrans: Multilingual Deep Reasoning Translation via Exemplar-Enhanced Reinforcement Learningcited by 11
  29. 2025ManuSearch: Democratizing Deep Search in Large Language Models with a Transparent and Open Multi-Agent Frameworkcited by 11
  30. 2025Good Learners Think Their Thinking: Generative PRM Makes Large Reasoning Model More Efficient Math Learnercited by 11
  31. 2026Fine-R1: Make Multi-modal LLMs Excel in Fine-Grained Visual Recognition by Chain-of-Thought Reasoningcited by 10
  32. 2025Comparative Analysis Based on DeepSeek, ChatGPT, and Google Gemini: Features, Techniques, Performance, Future Prospectscited by 9
  33. 2025Aurelia: Test-time Reasoning Distillation in Audio-Visual LLMscited by 9
  34. 2025Graph-Augmented Reasoning: Evolving Step-by-Step Knowledge Graph Retrieval for LLM Reasoningcited by 8
  35. 2025DeepTrans: Deep Reasoning Translation via Reinforcement Learningcited by 8
  36. 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AIcited by 8
  37. 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Surveycited by 7
  38. 2025Knowledge Augmented Complex Problem Solving with Large Language Models: A Surveycited by 6

50 most cited of 77 All 77 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025ACECODER: Acing Coder RL via Automated Test-Case Synthesis
  2. 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Model
  3. 2024O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
  4. 2024Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning Perspective
  5. 2024System 2 thinking in OpenAI's o1-preview model: Near-perfect performance on a mathematics exam
  6. 2024OpenAI o1 System Card
  7. 2025OpenCodeReasoning: Advancing Data Distillation for Competitive Coding
  8. 2025Dream-Coder 7B: An Open Diffusion Language Model for Code