mlsanityData to 14 Oct 2026

PRIMG : Efficient LLM-driven Test Generation Using Mutant Prioritization

arXiv 2505.05584 ↗First posted 8 May 2025cs.SE cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Mutation testing is a widely recognized technique for assessing and enhancing the effectiveness of software test suites by introducing deliberate code mutations. However, its application often results in overly large test suites, as developers generate numerous tests to kill specific mutants, increasing computational overhead. This paper introduces PRIMG (Prioritization and Refinement Integrated Mutation-driven Generation), a novel framework for incremental and adaptive test case generation for Solidity smart contracts. PRIMG integrates two core components: a mutation prioritization module, which employs a machine learning model trained on mutant subsumption graphs to predict the usefulness of surviving mutants, and a test case generation module, which utilizes Large Language Models (LLMs) to generate and iteratively refine test cases to achieve syntactic and behavioral correctness. We evaluated PRIMG on real-world Solidity projects from Code4Arena to assess its effectiveness in improving mutation scores and generating high-quality test cases. The experimental results demonstrate that PRIMG significantly reduces test suite size while maintaining high mutation coverage. The prioritization module consistently outperformed random mutant selection, enabling the generation of high-impact tests with reduced computational effort. Furthermore, the refining process enhanced the correctness and utility of LLM-generated tests, addressing their inherent limitations in handling edge cases and complex program logic.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

10 of 34 references.

References · 10

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  3. 2023No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generationcited by 82
  4. 2024What's Wrong with Your Code Generated by Large Language Models? An Extensive Studycited by 53
  5. 2023Effective Test Generation Using Pre-trained Large Language Models and Mutation Testingcited by 51
  6. 2024A Deep Dive into Large Language Models for Automated Bug Localization and Repaircited by 39
  7. 2022Repairing Bugs in Python Assignments Using Large Language Modelscited by 28
  8. 2021Automated Test-Case Generation for Solidity Smart Contracts: the AGSolT Approach and its Evaluationcited by 1
  9. 2021SuMo: A Mutation Testing Strategy for Solidity Smart Contractscited by 1
  10. 2024Leveraging Propagated Infection to Crossfire Mutantscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.