mlsanityData to 14 Oct 2026

TENET: One Step Toward Test-Driven Development for Repository-Level Code Generation

arXiv 2509.24148 ↗First posted 29 Sep 2025cs.SE cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Test-Driven Development (TDD) is a widely adopted practice that requires developers to create and execute tests alongside implementation. With recent advances in Large Language Models (LLMs), developers can shift from manually writing the code to defining tests as executable specifications and delegating code synthesis to AI agents. However, enabling repository-level TDD under developer-written tests is challenging, requiring: (1) specification enhancement: identifying a concise yet representative test subset from large suites with rich task semantics; (2) retrieval augmentation: using tests to guide reasoning and context retrieval; and (3) test-driven refinement: interpreting test feedback for iterative improvement. We propose TENET, an agentic framework for repository-level code generation under the TDD paradigm. TENET includes: (1) a test harness mechanism that selects a concise test suite to maximize diversity of the target usage scenarios; (2) a tailored agent toolset for efficient retrieval and debugging; and (3) a reflection-based refinement workflow that iteratively analyzes failures and updates implementations. TENET consistently outperforms the strongest baselines across backbones, achieving 69.08% and 81.77% Pass@1 on RepoCod and RepoEval with Claude Sonnet 4, improving by 9.49 and 2.17 percentage points, respectively. Additionally, we present the first systematic study of how test suite characteristics influence LLM agent performance in TDD settings.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 41 of its 61 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

41 of 61 references.

References · 41

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2021Program Synthesis with Large Language Modelscited by 3,637
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  6. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  7. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  8. 2023Teaching Large Language Models to Self-Debugcited by 988
  9. 2021Measuring Coding Challenge Competence With APPScited by 902
  10. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  11. 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
  12. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
29 more
  1. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
  2. 2024AutoCodeRover: Autonomous Program Improvementcited by 278
  3. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
  4. 2023CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completioncited by 183
  5. 2023CodePlan: Repository-level Coding using LLMs and Planningcited by 140
  6. 2022Repository-Level Prompt Generation for Large Language Models of Codecited by 106
  7. 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 91
  8. 2024RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graphcited by 91
  9. 2025SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agentscited by 85
  10. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safetycited by 75
  11. 2024DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositoriescited by 72
  12. 2024SpecRover: Code Intent Extraction via LLMscited by 72
  13. 2025FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementationcited by 58
  14. 2024Repoformer: Selective Retrieval for Repository-Level Code Completioncited by 55
  15. 2024LLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluationcited by 49
  16. 2024Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedbackcited by 46
  17. 2024RLCoder: Reinforcement Learning for Repository-Level Code Completioncited by 44
  18. 2024Dataflow-Guided Retrieval Augmentation for Repository-Level Code Completioncited by 40
  19. 2024GraphCoder: Enhancing Repository-Level Code Completion via Code Context Graph-based Retrieval and Language Modelcited by 40
  20. 2025Cost-of-Pass: An Economic Framework for Evaluating Language Modelscited by 35
  21. 2024Test-Driven Development for Code Generationcited by 34
  22. 2024REPOFUSE: Repository-Level Code Completion with Fused Dual Contextcited by 32
  23. 2023CoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Modelscited by 28
  24. 2024ExecRepoBench: Multi-level Executable Code Completion Evaluationcited by 20
  25. 2025debug-gym: A Text-Based Environment for Interactive Debuggingcited by 19
  26. 2023Fixing Large Language Models' Specification Misunderstanding for Better Code Generationcited by 17
  27. 2024RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completioncited by 15
  28. 2023LLM4TDD: Best Practices for Test Driven Development Using Large Language Modelscited by 4
  29. 2021Studying Test-Driven Development and its Retainment Over a Six-month Time Spancited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TDD Governance for Multi-Agent Code Generation via Prompt Engineering
  2. 2025TDFlow: Agentic Workflows for Test Driven Development
  3. 2025TestForge: Feedback-Driven, Agentic Test Suite Generation
  4. 2026From Runnable to Shippable: Multi-Agent Test-Driven Development for Generating Full-Stack Web Applications from Requirements
  5. 2026Grounding AI Agents in Contracts: An Empirical Evaluation of Spec-Driven Test Generation
  6. 2026E2E-SWE: Benchmarking LLMs on Building Working Codebases from Scratch
  7. 2026RepoMod-Bench: A Benchmark for Code Repository Modernization via Implementation-Agnostic Testing
  8. 2026Breaking, Stale, or Missing? Benchmarking Coding Agents on Project-Level Test Evolution