ATTest: Agent-Driven Tensor Testing for Deep Learning Library Modules
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
The unit testing of Deep Learning (DL) libraries is challenging due to complex numerical semantics and implicit tensor constraints. Traditional Search-Based Software Testing (SBST) often suffers from semantic blindness, failing to satisfy the constraints of high-dimensional tensors, whereas Large Language Models (LLMs) struggle with cross-file context and unstable code modifications. This paper proposes ATTest, an agent-driven tensor testing framework for module-level unit test generation. ATTest orchestrates a seven-stage pipeline, which encompasses constraint extraction and an iterative "generation-validation-repair" loop, to maintain testing stability and mitigate context-window saturation. An evaluation on PyTorch and TensorFlow demonstrates that ATTest significantly outperforms state-of-the-art baselines such as PynguinML, achieving an average branch coverage of 55.60% and 54.77%, respectively. The results illustrate how agent-driven workflows bridge the semantic gap in numerical libraries while ensuring auditable test synthesis. Source code: https://github.com/iSEngLab/ATTest.git
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 19 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
15 of 19 references.
Closest ancestors · 2
Same direction, newest first
- 2025TDFlow: Agentic Workflows for Test Driven Development27 Oct
- 2025QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks20 Jan
Other references · 13
- 2022Large Language Models are Few-shot Testers: Exploring LLM-based General Bug Reproductioncited by 110
- 2023ChatUniTest: A Framework for LLM-Based Test Generationcited by 94
- 2021TOGA: A Neural Method for Test Oracle Generationcited by 57
- 2022Pynguin: Automated Unit Test Generation for Pythoncited by 49
- 2021DocTer: Documentation Guided Fuzzing for Testing Deep Learning API Functionscited by 21
- 2024TestART: Improving LLM-based Unit Testing via Co-evolution of Automated Generation and Repair Iterationcited by 20
- 2024TestBench: Evaluating Class-Level Test Case Generation Capability of Large Language Modelscited by 15
- 2024A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testingcited by 15
- 2024TestSpark: IntelliJ IDEA's Ultimate Test Generation Companioncited by 9
- 2025Large Language Models for Unit Testing: A Systematic Literature Reviewcited by 6
- 2025Enhancing LLM's Ability to Generate More Repository-Aware Unit Tests Through Precise Contextual Information Injectioncited by 4
- 2023Automatic Unit Test Generation for Deep Learning Frameworks based on API Knowledgecited by 2
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Tensor Algebraic Property Skeletons: Amplifying Property-Based Testing for AI Compilers ↗
- 2026TensorBench: Benchmarking Coding Agents on a Compiler-Based Tensor Framework
- 2026Agentic Framework for Deep Learning workload migration via In-Context Learning
- 2026DeepFix: Debugging and Fixing Machine Learning Workflow using Agentic AI
- 2025An Empirical Study of Testing Practices in Open Source AI Agent Frameworks and Agentic Applications
- 2026ATLAS: Agentic Test-time Learning-to-Allocate Scaling
- 2026GTDD: Generative Test-Driven Development for AI Coding Agents with Adversarial Testing
- 2026PBT-Bench: Benchmarking AI Agents on Property-Based Testing