mlsanityData to 14 Oct 2026

Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives

arXiv 2503.13793 ↗First posted 18 Mar 2025cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Applications of Large Language Models (LLMs) are rapidly growing in industry and academia for various software engineering (SE) tasks. As these models become more integral to critical processes, ensuring their reliability and trustworthiness becomes essential. Consequently, the concept of trust in these systems is becoming increasingly critical. Well-calibrated trust is important, as excessive trust can lead to security vulnerabilities, and risks, while insufficient trust can hinder innovation. However, the landscape of trust-related concepts in LLMs in SE is relatively unclear, with concepts such as trust, distrust, and trustworthiness lacking clear conceptualizations in the SE community. To bring clarity to the current research status and identify opportunities for future work, we conducted a comprehensive review of 88 papers: a systematic literature review of 18 papers focused on LLMs in SE, complemented by an analysis of 70 papers from broader trust literature. Additionally, we conducted a survey study with 25 domain experts to gain insights into practitioners' understanding of trust and identify gaps between existing literature and developers' perceptions. The result of our analysis serves as a roadmap that covers trust-related concepts in LLMs in SE and highlights areas for future exploration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 90 of its 175 references that are in the map. First posted on arXiv 18 Mar 2025.

Builds on

90 of 175 references.

References · 90

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  6. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  7. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  8. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  9. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  10. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  11. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  12. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
38 more
  1. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  2. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
  3. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
  4. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
  5. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 431
  6. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
  7. 2021Unified Pre-training for Program Understanding and Generationcited by 366
  8. 2022A Systematic Evaluation of Large Language Models of Codecited by 363
  9. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
  10. 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 268
  11. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 253
  12. 2021Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Modelscited by 232
  13. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
  14. 2021Trustworthy AI: From Principles to Practicescited by 207
  15. 2022Do Users Write More Insecure Code with AI Assistants?cited by 192
  16. 2015Visualizing and Understanding Recurrent Networkscited by 160
  17. 2018SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repaircited by 145
  18. 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 123
  19. 2020Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challengescited by 120
  20. 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
  21. 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
  22. 2023Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMscited by 104
  23. 2021Trustworthy AI: A Computational Perspectivecited by 93
  24. 2022Lost at C: A User Study on the Security Implications of Large Language Model Code Assistantscited by 91
  25. 2018Beyond Word Importance: Contextual Decomposition to Extract Interactions from LSTMscited by 67
  26. 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
  27. 2020Big Code != Big Vocabulary: Open-Vocabulary Models for Source Codecited by 54
  28. 2022What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Codecited by 50
  29. 2024Calibration and Correctness of Language Models for Codecited by 49
  30. 2022Designing for Responsible Trust in AI Systems: A Communication Perspectivecited by 48
  31. 2018Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learningcited by 47
  32. 2020Towards Transparent and Explainable Attention Modelscited by 47
  33. 2020On Learning Meaningful Assert Statements for Unit Test Casescited by 42
  34. 2021Perfection Not Required? Human-AI Partnerships in Code Translationcited by 42
  35. 2020A Systematic Literature Review on the Use of Deep Learning in Software Engineering Researchcited by 35
  36. 2021Do Humans Trust Advice More if it Comes from AI? An Analysis of Human-AI Interactionscited by 35
  37. 2023Investigating and Designing for Trust in AI-powered Code Generation Toolscited by 34
  38. 2023Navigating the Complexity of Generative AI Adoption in Software Engineeringcited by 32

50 most cited of 90 All 90 (JSON)

Built on by

Not cited yet.