Scaling Test-Time Compute to Achieve IOI Gold Medal with Open-Weight Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Competitive programming has become a rigorous benchmark for evaluating the reasoning and problem-solving capabilities of large language models (LLMs). The International Olympiad in Informatics (IOI) stands out as one of the most prestigious annual competitions in competitive programming and has become a key benchmark for comparing human and AI-level programming ability. While several proprietary models have been claimed to achieve gold medal-level performance at the IOI, often with undisclosed methods, achieving comparable results with open-weight models remains a significant challenge. In this paper, we present GenCluster, a scalable and reproducible test-time compute framework that attains IOI gold-level performance using open-weight models. It combines large-scale generation, behavioral clustering, ranking, and a round-robin submission strategy to efficiently explore diverse solution spaces under limited validation budgets. Our experiments show that the performance of our proposed approach scales consistently with available compute, narrowing the gap between open and closed systems. Notably, we will show that GenCluster can achieve a gold medal at IOI 2025 for the first time with an open-weight model gpt-oss-120b, setting a new benchmark for transparent and reproducible evaluation of reasoning in LLMs
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 36 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
20 of 36 references.
Closest ancestors · 7
Same direction, newest first
- 2025Deep Think with Confidence21 Aug
- 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
- 2025GenSelect: A Generative Approach to Best-of-N23 Jul
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?31 Mar
- 2025Competitive Programming with Large Reasoning Models3 Feb
- 2025PairJudge RM: Perform Best-of-N Sampling with Knockout Tournament22 Jan
- 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models1 Aug
Other references · 13
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2024Generative Verifiers: Reward Modeling as Next-Token Predictioncited by 465
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
- 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
- 2025RM-R1: Reward Modeling as Reasoningcited by 149
- 2024Generative Reward Modelscited by 148
1 more
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Reinforcement Learning via Self-Distillationcited by 285
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inferencecited by 4
- 2026Exploring Pass-Rate Reward in Reinforcement Learning for Code Generationcited by 2
- 2026Perfect score on IPhO 2025 theory by Gemini agentcited by 1
- 2026Majority Voting for Code Generationcited by 1
- 2026RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learningcited by 0
- 2026Post-Training Language Models for Gold-Medal Performance in Coding Competitionscited by 0
- 2026Entropy-Regularized Rank-Masked Policy Optimization for Test-Time Reinforcement Learning in Code Generationcited by 0
- 2026Entropy-Regularized Rank-Masked Policy Optimization for Test-Time Reinforcement Learning in Code Generation8 Sep 2026
- 2026Post-Training Language Models for Gold-Medal Performance in Coding Competitions2 Sep 2026
- 2026Exploring Pass-Rate Reward in Reinforcement Learning for Code Generation1 May 2026
- 2026Majority Voting for Code Generation17 Apr 2026
- 2026RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning1 Apr 2026
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference27 Feb 2026
- 2026Perfect score on IPhO 2025 theory by Gemini agent26 Feb 2026
- 2026Reinforcement Learning via Self-Distillation28 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025OIBench: Benchmarking Strong Reasoning Models with Olympiad in Informatics
- 2025LiveOIBench: Can Large Language Models Outperform Human Contestants in Informatics Olympiads?
- 2026Hill Sampling for Test-Time Scaling: A Simple and Better Alternative to Repeated Sampling, Evolution, and Training
- 2024Can Language Models Solve Olympiad Programming?
- 2025s1: Simple test-time scaling
- 2025LLM-ProS: Analyzing Large Language Models' Performance in Competitive Problem Solving
- 2025LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?
- 2025ProBench: Benchmarking Large Language Models in Competitive Programming