mlsanityData to 14 Oct 2026

Vibe Reasoning: Eliciting Frontier AI Mathematical Capabilities -- A Case Study on IMO 2025 Problem 6

arXiv 2512.19287 ↗First posted 22 Dec 2025cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

We introduce Vibe Reasoning, a human-AI collaborative paradigm for solving complex mathematical problems. Our key insight is that frontier AI models already possess the knowledge required to solve challenging problems -- they simply do not know how, what, or when to apply it. Vibe Reasoning transforms AI's latent potential into manifested capability through generic meta-prompts, agentic grounding, and model orchestration. We demonstrate this paradigm through IMO 2025 Problem 6, a combinatorial optimization problem where autonomous AI systems publicly reported failures. Our solution combined GPT-5's exploratory capabilities with Gemini 3 Pro's proof strengths, leveraging agentic workflows with Python code execution and file-based memory, to derive both the correct answer (2112) and a rigorous mathematical proof. Through iterative refinement across multiple attempts, we discovered the necessity of agentic grounding and model orchestration, while human prompts evolved from problem-specific hints to generic, transferable meta-prompts. We analyze why capable AI fails autonomously, how each component addresses specific failure modes, and extract principles for effective vibe reasoning. Our findings suggest that lightweight human guidance can unlock frontier models' mathematical reasoning potential. This is ongoing work; we are developing automated frameworks and conducting broader evaluations to further validate Vibe Reasoning's generality and effectiveness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 8 of its 14 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

8 of 14 references.

References · 8

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  5. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
  6. 2023Large Language Model Routing with Benchmark Datasetscited by 172
  7. 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoningcited by 156
  8. 2025A Human-AI Collaborative Workflow for Mathematical Discovery: A Case Study in Grover-Compatible Riemannian Optimizationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Vibe Coding: Toward an AI-Native Paradigm for Semantic and Intent-Driven Programming ↗
  2. 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI
  3. 2025FormulaOne: Measuring the Depth of Algorithmic Reasoning Beyond Competitive Programming
  4. 2026Agentic Neurosymbolic Collaboration for Mathematical Discovery: A Case Study in Combinatorial Design
  5. 2026Vibe AIGC: A New Paradigm for Content Generation via Agentic Orchestration
  6. 2025AlphaApollo: A System for Deep Agentic Reasoning
  7. 2026MAS-Algorithm: A Workflow for Solving Algorithmic Programming Problems with a Multi-Agent System
  8. 2026Think Fast: Estimating No-CoT Task-Completion Time Horizons of Frontier AI Models