mlsanityData to 14 Oct 2026

Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions

arXiv 2411.14405 ↗First posted 21 Nov 2024cs.CLcited by 144

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Currently OpenAI o1 sparks a surge of interest in the study of large reasoning models (LRM). Building on this momentum, Marco-o1 not only focuses on disciplines with standard answers, such as mathematics, physics, and coding -- which are well-suited for reinforcement learning (RL) -- but also places greater emphasis on open-ended resolutions. We aim to address the question: ''Can the o1 model effectively generalize to broader domains where clear standards are absent and rewards are challenging to quantify?'' Marco-o1 is powered by Chain-of-Thought (CoT) fine-tuning, Monte Carlo Tree Search (MCTS), reflection mechanisms, and innovative reasoning strategies -- optimized for complex real-world problem-solving tasks.

Key facts. Cited by 144 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 11 of its 14 references that are in the map. First posted on arXiv 21 Nov 2024.

Builds on

11 of 14 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training29 Sep
  2. 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
  3. 2022Large Language Models Can Self-Improve20 Oct

Other references · 8

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2023Let's Verify Step by Stepcited by 3,789
  4. 2024Qwen2 Technical Reportcited by 2,120
  5. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
  6. 2024Evaluation of OpenAI o1: Opportunities and Challenges of AGIcited by 127
  7. 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 108
  8. 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 116; 2026: 20.

144 papers.

Sort:

By area:

  1. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  2. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
  3. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  4. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 265
  5. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
  6. 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 208
  7. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  8. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
  9. 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 136
  10. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmarkcited by 134
  11. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 119
  12. 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agentscited by 98
38 more
  1. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 95
  2. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
  3. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
  4. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 83
  5. 2025ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learningcited by 79
  6. 2024o1-Coder: an o1 Replication for Codingcited by 78
  7. 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoningcited by 72
  8. 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
  9. 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Modelscited by 61
  10. 2025RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?cited by 60
  11. 2025Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQLcited by 59
  12. 2025Logical Reasoning in Large Language Models: A Surveycited by 55
  13. 2025Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Searchcited by 53
  14. 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Modelscited by 53
  15. 2025Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Searchcited by 51
  16. 2024Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning Perspectivecited by 50
  17. 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learningcited by 48
  18. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 44
  19. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 43
  20. 2025Reasoning Language Models: A Blueprintcited by 42
  21. 2025Dynamic Parallel Tree Search for Efficient LLM Reasoningcited by 42
  22. 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoningcited by 40
  23. 2025S2R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learningcited by 39
  24. 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
  25. 2025ReARTeR: Retrieval-Augmented Reasoning with Trustworthy Process Rewardingcited by 32
  26. 2025Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insightscited by 30
  27. 2025Benchmarking Reasoning Robustness in Large Language Modelscited by 30
  28. 2024DRT: Deep Reasoning Translation via Long Chain-of-Thoughtcited by 29
  29. 2025Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysiscited by 26
  30. 2025Med-PRM: Medical Reasoning Models with Stepwise, Guideline-verified Process Rewardscited by 24
  31. 2025Retrieval-Augmented Perception: High-Resolution Image Perception Meets Visual RAGcited by 23
  32. 2025To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Modelscited by 22
  33. 2025Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token Level Granularitycited by 22
  34. 2025MMR-V: What's Left Unsaid? A Benchmark for Multimodal Deep Reasoning in Videoscited by 22
  35. 2025Does Reasoning Introduce Bias? A Study of Social Bias Evaluation and Mitigation in LLM Reasoningcited by 21
  36. 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learningcited by 21
  37. 2025Are Smarter LLMs Safer? Exploring Safety-Reasoning Trade-offs in Prompting and Fine-Tuningcited by 20
  38. 2025Innate Reasoning is Not Enough: In-Context Learning Enhances Reasoning Large Language Models with Less Overthinkingcited by 20

50 most cited of 144 All 144 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Model
  2. 2024OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models
  3. 2024O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
  4. 2024On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
  5. 2025From Reasoning to Super-Intelligence: A Search-Theoretic Perspective
  6. 2025A Tutorial on LLM Reasoning: Relevant Methods behind ChatGPT o1
  7. 2025OpenSIR: Open-Ended Self-Improving Reasoner
  8. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models