AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) generate code from natural-language prompts, yet real-world prompts rarely provide complete specifications. When prompts leave input formats, error handling, or design decisions unspecified, LLMs fill these gaps with implicit assumptions that shape the generated code's behavior and correctness. Because these assumptions remain hidden, generated code may satisfy tests while violating developer intent. We present AssumptionMiner, a framework that makes implicit assumptions a first-class artifact of LLM-based code generation. In addition to code, AssumptionMiner produces an explicit assumption layer, a structured representation of inferred constraints and design decisions that developers can inspect, confirm, or revise. An AST-based dependency graph enables targeted regeneration of only the code affected by a revised assumption. We also introduce a benchmark of 180 ambiguous programming tasks with 676 annotated assumptions, including a human-verified subset for evaluating code localization. We evaluate assumption extraction, code localization, and assumption-guided regeneration. Across open-source LLMs, a confidence-weighted ensemble achieves an F1 score of 0.816 for assumption extraction, improving on the strongest offline baseline by 3.6x. On the human-verified localization benchmark, AST-guided localization identifies more precise code regions than keyword-based and whole-file baselines. During assumption revision, targeted regeneration modifies less code than non-targeted alternatives while exposing challenges in handling cascading edits. These results demonstrate that making assumptions explicit improves the transparency and controllability of LLM-based code generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 57 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
26 of 57 references.
References · 26
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2024GPT-4o System Cardcited by 4,588
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
- 2023Self-collaboration Code Generation via ChatGPTcited by 258
- 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 197
14 more
- 2018SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repaircited by 145
- 2023Self-planning Code Generation with Large Language Modelscited by 124
- 2022Productivity Assessment of Neural Code Completioncited by 98
- 2023Fuzz4All: Universal Fuzzing with Large Language Modelscited by 88
- 2021Neural Program Repair with Execution-based Backpropagationcited by 50
- 2022Interactive Code Generation via Test-Driven User-Intent Formalizationcited by 50
- 2023Conversational Automated Program Repaircited by 41
- 2024HumanEvalComm: Benchmarking the Communication Competence of Code Generation for LLMs and LLM Agentcited by 24
- 2018AVATAR : Fixing Semantic Bugs with Fix Patterns of Static Analysis Violationscited by 22
- 2021Traceability Transformed: Generating more Accurate Links with Pre-Trained BERT Modelscited by 20
- 2024Specifications: The missing link to making the development of LLM systems an engineering disciplinecited by 17
- 2025When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptionscited by 11
- 2026Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysiscited by 2
- 2026Correctness, confidence, and context: Framing software assurance in the AI agecited by 2
Built on by
Not cited yet.