mlsanityData to 7 Oct 2026

Precision in Practice: Knowledge Guided Code Summarizing Grounded in Industrial Expectations

arXiv 2602.03400 ↗First posted 3 Feb 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Code summaries are essential for helping developers understand code functionality and reducing maintenance and collaboration costs. Although recent advances in large language models (LLMs) have significantly improved automatic code summarization, the practical usefulness of generated summaries in industrial settings remains insufficiently explored. In collaboration with documentation experts from the industrial HarmonyOS project, we conducted a questionnaire study showing that over 57.4% of code summaries produced by state-of-the-art approaches were rejected due to violations of developers' expectations for industrial documentation. Beyond semantic similarity to reference summaries, developers emphasize additional requirements, including the use of appropriate domain terminology, explicit function categorization, and the avoidance of redundant implementation details. To address these expectations, we propose ExpSum, an expectation-aware code summarization approach that integrates function metadata abstraction, informative metadata filtering, context-aware domain knowledge retrieval, and constraint-driven prompting to guide LLMs in generating structured, expectation-aligned summaries. We evaluate ExpSum on the HarmonyOS project and widely used code summarization benchmarks. Experimental results show that ExpSum consistently outperforms all baselines, achieving improvements of up to 26.71% in BLEU-4 and 20.10% in ROUGE-L on HarmonyOS. Furthermore, LLM-based evaluations indicate that ExpSum-generated summaries better align with developer expectations across other projects, demonstrating its effectiveness for industrial code documentation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 69 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

30 of 69 references.

References · 30

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  4. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  5. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
  6. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
  7. 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
  8. 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 357
  9. 2020A Transformer-based Approach for Source Code Summarizationcited by 129
  10. 2022Few-shot training LLMs for project-specific code-summarizationcited by 128
  11. 2023Large Language Models are Few-Shot Summarizers: Multi-Intent Comment Generation via In-Context Learningcited by 71
  12. 2024A Survey on LoRA of Large Language Modelscited by 67
18 more
  1. 2023Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generationcited by 49
  2. 2022No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligencecited by 41
  3. 2022Automatic Code Documentation Generation Using GPT-3cited by 37
  4. 2024Source Code Summarization in the Era of Large Language Modelscited by 30
  5. 2019Automatic Code Summarization: A Systematic Literature Reviewcited by 18
  6. 2023EditSum: A Retrieve-and-Edit Framework for Source Code Summarizationcited by 18
  7. 2023Developer-Intent Driven Code Comment Generationcited by 16
  8. 2025Prompt-Reverse Inconsistency: LLM Self-Inconsistency Beyond Generative Randomness and Prompt Paraphrasingcited by 14
  9. 2025GenSelect: A Generative Approach to Best-of-Ncited by 14
  10. 2022Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitutioncited by 12
  11. 2024Can Large Language Models Serve as Evaluators for Code Summarization?cited by 12
  12. 2021API2Com: On the Improvement of Automatically Generated Code Comments Using API Documentationscited by 10
  13. 2022Unsupervised Lexical Substitution with Decontextualised Embeddingscited by 8
  14. 2025Evaluation of Large Language Models via Coupled Token Generationcited by 7
  15. 2022A Decade of Code Comment Quality Assessment: A Systematic Literature Reviewcited by 5
  16. 2024Large Language Models for Code Summarizationcited by 3
  17. 2018Deep Learning to Detect Redundant Method Commentscited by 1
  18. 2020What do class comments tell us? An investigation of comment evolution and practices in Pharo Smalltalkcited by 1

Built on by

Not cited yet.