MR-Coupler: Automated Metamorphic Test Generation via Functional Coupling Analysis
Not on the map. Why?
Abstract (arXiv)
Metamorphic testing (MT) is a widely recognized technique for alleviating the oracle problem in software testing. However, its adoption is hindered by the difficulty of constructing effective metamorphic relations (MRs), which often require domain-specific or hard-to-obtain knowledge. In this work, we propose a novel approach that leverages the functional coupling between methods, which is readily available in source code, to automatically construct MRs and generate metamorphic test cases (MTCs). Our technique, MR-Coupler, identifies functionally coupled method pairs, employs large language models to generate candidate MTCs, and validates them through test amplification and mutation analysis. In particular, we leverage three functional coupling features to avoid expensive enumeration of possible method pairs, and a novel validation mechanism to reduce false alarms. Our evaluation of MR-Coupler on 100 human-written MTCs and 50 real-world bugs shows that it generates valid MTCs for over 90% of tasks, improves valid MTC generation by 64.90%, and reduces false alarms by 36.56% compared to baselines. Furthermore, the MTCs generated by MR-Coupler detect 44% of the real bugs. Our results highlight the effectiveness of leveraging functional coupling for automated MR construction and the potential of MR-Coupler to facilitate the adoption of MT in practice. We also released the tool and experimental data to support future research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 79 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
23 of 79 references.
References · 23
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2023An Empirical Evaluation of Using Large Language Models for Automated Unit Test Generationcited by 194
- 2023Chain of Code: Reasoning with a Language Model-Augmented Code Emulatorcited by 123
- 2023ChatUniTest: A Framework for LLM-Based Test Generationcited by 96
- 2024LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigationcited by 93
- 2024Exploring and Unleashing the Power of Large Language Models in Automated Code Translationcited by 57
- 2024CoverUp: Effective High Coverage Test Generation for Pythoncited by 38
- 2023ChatGPT vs SBST: A Comparative Assessment of Unit Test Suite Generationcited by 32
- 2024The Future of AI-Driven Software Engineeringcited by 23
- 2024Concerned with Data Contamination? Assessing Countermeasures in Code Language Modelcited by 14
- 2020An Empirical Study of Usages, Updates and Risks of Third-Party Libraries in Java Projectscited by 12
- 2023Neural-Based Test Oracle Generation: A Large-scale Evaluation and Lessons Learnedcited by 9
11 more
- 2026LLMLOOP: Improving LLM-Generated Code and Tests through Automated Iterative Feedback Loopscited by 8
- 2022Fuzzing Deep Learning Compilers with HirGencited by 7
- 2024Towards Generating Executable Metamorphic Relations Using Large Language Modelscited by 7
- 2023Can ChatGPT advance software testing intelligence? An experience report on metamorphic testingcited by 6
- 2024MR-Adopt: Automatic Deduction of Input Transformation Function for Metamorphic Testingcited by 6
- 2020SemMT: A Semantic-based Testing Approach for Machine Translation Systemscited by 5
- 2023MR-Scout: Automated Synthesis of Metamorphic Relations from Existing Test Casescited by 5
- 2023Word Closure-Based Metamorphic Testing for Machine Translationcited by 4
- 2023GenMorph: Automatically Generating Metamorphic Relations via Genetic Programmingcited by 4
- 2026Understanding LLM-Driven Test Oracle Generationcited by 2
- 2026LLMORPH: Automated Metamorphic Testing of Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.