mlsanityData to 14 Oct 2026

Infinite-Instruct: Synthesizing Scaling Code instruction Data with Bidirectional Synthesis and Static Verification

arXiv 2505.23177 ↗First posted 29 May 2025cs.CLcited by 1

On the map: Synthetic data and self-improvement for LLMs → Code and instruction data synthesis

Abstract (arXiv)

Traditional code instruction data synthesis methods suffer from limited diversity and poor logic. We introduce Infinite-Instruct, an automated framework for synthesizing high-quality question-answer pairs, designed to enhance the code generation capabilities of large language models (LLMs). The framework focuses on improving the internal logic of synthesized problems and the quality of synthesized code. First, "Reverse Construction" transforms code snippets into diverse programming problems. Then, through "Backfeeding Construction," keywords in programming problems are structured into a knowledge graph to reconstruct them into programming problems with stronger internal logic. Finally, a cross-lingual static code analysis pipeline filters invalid samples to ensure data quality. Experiments show that on mainstream code generation benchmarks, our fine-tuned models achieve an average performance improvement of 21.70% on 7B-parameter models and 36.95% on 32B-parameter models. Using less than one-tenth of the instruction fine-tuning data, we achieved performance comparable to the Qwen-2.5-Coder-Instruct. Infinite-Instruct provides a scalable solution for LLM training in programming. We open-source the datasets used in the experiments, including both unfiltered versions and filtered versions via static analysis. The data are available at https://github.com/xingwenjing417/Infinite-Instruct-dataset

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Code and instruction data synthesis, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 7 of its 25 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

7 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructions20 Dec

Other references · 6

  1. 2021Program Synthesis with Large Language Modelscited by 3,637
  2. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  3. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  4. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
  5. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 256
  6. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Semi-Instruct: Bridging Natural-Instruct and Self-Instruct for Code Large Language Models
  2. 2023Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code
  3. 2025OpenCodeReasoning-II: A Simple Test Time Scaling Approach via Self-Critique
  4. 2025CodeSimpleQA: Scaling Factuality in Code Large Language Models
  5. 2025UCoder: Unsupervised Code Generation by Internal Probing of Large Language Models
  6. 2025PACIFIC: a framework for generating benchmarks to check Precise Automatically Checked Instruction Following In Code
  7. 2025Beyond Code Pairs: Dialogue-Based Data Generation for LLM Code Translation
  8. 2024InverseCoder: Self-improving Instruction-Tuned Code LLMs with Inverse-Instruct