mlsanityData to 14 Oct 2026

CodeEvo: Interaction-Driven Synthesis of Code-centric Data through Hybrid and Iterative Feedback

arXiv 2507.22080 ↗First posted 25 Jul 2025cs.SE cs.AI cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Acquiring high-quality instruction-code pairs is essential for training Large Language Models for code generation. While automated synthesis has emerged as an alternative to expensive manual curation, current approaches often rely on rigid heuristics, yielding data that is ungrounded or lacks logical complexity. We propose CodeEvo, a dual-agent architecture comprising a Coder for iterative solution synthesis and a Reviewer to orchestrate the generation trajectory. To transcend the limitations of existing heuristics, the Reviewer formulates a Schema to systematically architect logic and complexity through an interleaved synthesis of instructions and code. This process is further reinforced by a hybrid verification protocol synergizing deterministic compiler feedback with semantic evaluation. Under this framework, we construct CodeEvo-100K, a large-scale dataset of instruction-code pairs with stepped difficulty levels. Extensive experiments demonstrate that models fine-tuned on CodeEvo data consistently outperform established baselines across code generation benchmarks. In-depth analyses further provide insights into effective code-centric data synthesis. Code and data are available at https://github.com/QiushiSun/CodeEvo.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 41 of its 60 references that are in the map. First posted on arXiv 25 Jul 2025.

Builds on

41 of 60 references.

References · 41

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2021Program Synthesis with Large Language Modelscited by 3,637
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  6. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  9. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  10. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  11. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  12. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
29 more
  1. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
  2. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
  3. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
  4. 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 346
  5. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 256
  6. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 247
  7. 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
  8. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
  9. 2022Large Language Models Meet NL2Code: A Surveycited by 138
  10. 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 89
  11. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 83
  12. 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaborationcited by 70
  13. 2024SelfCodeAlign: Self-Alignment for Code Generationcited by 62
  14. 2022Interactive Code Generation via Test-Driven User-Intent Formalizationcited by 50
  15. 2022Compilable Neural Code Generation with Compiler Feedbackcited by 47
  16. 2024Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedbackcited by 46
  17. 2023WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuningcited by 42
  18. 2024LeDex: Training LLMs to Better Self-Debug and Explain Codecited by 40
  19. 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Modelscited by 39
  20. 2024CodeDPO: Aligning Code Models with Self Generated and Verified Source Codecited by 34
  21. 2025CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debuggingcited by 32
  22. 2017Program Synthesis using Conflict-Driven Learningcited by 26
  23. 2024Arena Learning: Build Data Flywheel for LLMs Post-training via Simulated Chatbot Arenacited by 26
  24. 2024DataEnvGym: Data Generation Agents in Teacher Environments with Student Feedbackcited by 25
  25. 2025Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoningcited by 24
  26. 2025EpiCoder: Encompassing Diversity and Complexity in Code Generationcited by 20
  27. 2017Program Synthesis using Abstraction Refinementcited by 13
  28. 2024Case2Code: Scalable Synthetic Data for Code Generationcited by 13
  29. 2025UnitCoder: Scalable Iterative Code Synthesis with Unit Test Guidancecited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.