mlsanityData to 7 Oct 2026

Scaling Test-Time Compute to Achieve IOI Gold Medal with Open-Weight Models

arXiv 2510.14232 ↗First posted 16 Oct 2025cs.LG cs.AI cs.CLcited by 8

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Competitive programming has become a rigorous benchmark for evaluating the reasoning and problem-solving capabilities of large language models (LLMs). The International Olympiad in Informatics (IOI) stands out as one of the most prestigious annual competitions in competitive programming and has become a key benchmark for comparing human and AI-level programming ability. While several proprietary models have been claimed to achieve gold medal-level performance at the IOI, often with undisclosed methods, achieving comparable results with open-weight models remains a significant challenge. In this paper, we present GenCluster, a scalable and reproducible test-time compute framework that attains IOI gold-level performance using open-weight models. It combines large-scale generation, behavioral clustering, ranking, and a round-robin submission strategy to efficiently explore diverse solution spaces under limited validation budgets. Our experiments show that the performance of our proposed approach scales consistently with available compute, narrowing the gap between open and closed systems. Notably, we will show that GenCluster can achieve a gold medal at IOI 2025 for the first time with an open-weight model gpt-oss-120b, setting a new benchmark for transparent and reproducible evaluation of reasoning in LLMs

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 36 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

20 of 36 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Deep Think with Confidence21 Aug
  2. 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
  3. 2025GenSelect: A Generative Approach to Best-of-N23 Jul
  4. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?31 Mar
  5. 2025Competitive Programming with Large Reasoning Models3 Feb
  6. 2025PairJudge RM: Perform Best-of-N Sampling with Knockout Tournament22 Jan
  7. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models1 Aug

Other references · 13

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2021Program Synthesis with Large Language Modelscited by 3,509
  5. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  6. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
  7. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  8. 2024Generative Verifiers: Reward Modeling as Next-Token Predictioncited by 465
  9. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  10. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
  11. 2025RM-R1: Reward Modeling as Reasoningcited by 149
  12. 2024Generative Reward Modelscited by 148
1 more
  1. 2023ALGO: Synthesizing Algorithmic Programs with LLM-Generated Oracle Verifierscited by 41

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025OIBench: Benchmarking Strong Reasoning Models with Olympiad in Informatics
  2. 2025LiveOIBench: Can Large Language Models Outperform Human Contestants in Informatics Olympiads?
  3. 2026Hill Sampling for Test-Time Scaling: A Simple and Better Alternative to Repeated Sampling, Evolution, and Training
  4. 2024Can Language Models Solve Olympiad Programming?
  5. 2025s1: Simple test-time scaling
  6. 2025LLM-ProS: Analyzing Large Language Models' Performance in Competitive Problem Solving
  7. 2025LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?
  8. 2025ProBench: Benchmarking Large Language Models in Competitive Programming