Trustworthy and Synergistic Artificial Intelligence for Software Engineering: Vision and Roadmaps
Not on the map. Why?
Abstract (arXiv)
For decades, much software engineering research has been dedicated to devising automated solutions aimed at enhancing developer productivity and elevating software quality. The past two decades have witnessed an unparalleled surge in the development of intelligent solutions tailored for software engineering tasks. This momentum established the Artificial Intelligence for Software Engineering (AI4SE) area, which has swiftly become one of the most active and popular areas within the software engineering field. This Future of Software Engineering (FoSE) paper navigates through several focal points. It commences with a succinct introduction and history of AI4SE. Thereafter, it underscores the core challenges inherent to AI4SE, particularly highlighting the need to realize trustworthy and synergistic AI4SE. Progressing, the paper paints a vision for the potential leaps achievable if AI4SE's key challenges are surmounted, suggesting a transition towards Software Engineering 2.0. Two strategic roadmaps are then laid out: one centered on realizing trustworthy AI4SE, and the other on fostering synergistic AI4SE. While this paper may not serve as a conclusive guide, its intent is to catalyze further progress. The ultimate aspiration is to position AI4SE as a linchpin in redefining the horizons of software engineering, propelling us toward Software Engineering 2.0.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 48 of its 155 references that are in the map. First posted on arXiv 8 Sep 2023.
Builds on
48 of 155 references.
References · 48
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023GPT-4 Technical Reportcited by 18,132
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2023How is ChatGPT's behavior changing over time?cited by 265
- 2018code2vec: Learning Distributed Representations of Codecited by 249
- 2023Auditing large language models: a three-layered approachcited by 135
- 2022Few-shot training LLMs for project-specific code-summarizationcited by 128
36 more
- 2023Keep the Conversation Going: Fixing 162 out of 337 bugs for 0.42 each using ChatGPTcited by 125
- 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 112
- 2021Leveraging Automated Unit Tests for Unsupervised Code Translationcited by 82
- 2023Refining ChatGPT-Generated Code: Characterizing and Mitigating Code Quality Issuescited by 78
- 2022Natural Attack for Pre-trained Models of Codecited by 72
- 2022Automated Repair of Programs from Large Language Modelscited by 71
- 2022Repair Is Nearly Generation: Multilingual Program Repair with LLMscited by 68
- 2023On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilotcited by 64
- 2022CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Modelscited by 48
- 2020CC2Vec: Distributed Representations of Code Changescited by 38
- 2020A Survey on Deep Learning for Software Engineeringcited by 37
- 2020A Systematic Literature Review on the Use of Deep Learning in Software Engineering Researchcited by 35
- 2023Stealthy Backdoor Attack for Code Modelscited by 32
- 2023Towards Human-Bot Collaborative Software Architecting with ChatGPTcited by 31
- 2022Compressing Pre-trained Models of Code into 3 MBcited by 21
- 2018Oreo: Detection of Clones in the Twilight Zonecited by 19
- 2023CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Modelscited by 16
- 2023MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Modelscited by 15
- 2019An Empirical Study of Obsolete Answers on Stack Overflowcited by 14
- 2018500+ Times Faster Than Deep Learning (A Case Study Exploring Faster Methods for Text Mining StackOverflow)cited by 13
- 2022Cross-Language Binary-Source Code Matching with Intermediate Representationscited by 13
- 2020Modeling Functional Similarity in Source Code with Graph-Based Siamese Networkscited by 10
- 2023CUPID: Leveraging ChatGPT for More Accurate Duplicate Bug Report Detectioncited by 9
- 2023Practitioners' Expectations on Code Completioncited by 8
- 2023The Devil is in the Tails: How Long-Tailed Code Distributions Impact Large Language Modelscited by 8
- 2023On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Codecited by 7
- 2023Representation Learning for Stack Overflow Posts: How Far are We?cited by 6
- 2023Generative Type Inference for Pythoncited by 6
- 2023Adversarial Attacks on Code Models with Discriminative Graph Patternscited by 6
- 2023Are We Ready to Embrace Generative AI for Software Q&A?cited by 5
- 2022Answer Summarization for Technical Queries: Benchmark and New Approachcited by 4
- 2022Explaining Software Bugs Leveraging Code Structures in Neural Machine Translationcited by 4
- 2019An empirical assessment of best-answer prediction models in technical Q&A sitescited by 3
- 2022Technical Q&A Site Answer Recommendation via Question Boostingcited by 3
- 2023A Systematic Literature Review of Explainable AI for Software Engineeringcited by 3
- 2022Generating and Visualizing Trace Link Explanationscited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 8; 2025: 6; 2026: 3.
19 papers.
Sort:
By area:
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024Calibration and Correctness of Language Models for Codecited by 49
- 2024Human-In-the-Loop Software Development Agentscited by 42
- 2024Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanationscited by 10
- 2023Pitfalls in Language Models for Code Intelligence: A Taxonomy and Surveycited by 9
- 2024Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AIcited by 6
- 2025On LLMs' Internal Representation of Code Correctnesscited by 5
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Modelscited by 4
- 2025Code Readability in the Age of Large Language Models: An Industrial Case Study from Atlassiancited by 4
- 2024GPT-Powered Elicitation Interview Script Generator for Requirements Engineering Trainingcited by 3
- 2024Morescient GAI for Software Engineering (Extended Version)cited by 1
- 2025Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findingscited by 1
7 more
- 2025Open the Oyster: Empirical Evaluation and Improvement of Code Reasoning Confidence in LLMscited by 1
- 2026PenForge: On-the-Fly Expert Agent Construction for Automated Penetration Testingcited by 1
- 2026Artificial Intelligence in Open Source Software Engineering: A Foundation for Sustainabilitycited by 1
- 2024Demystifying Faulty Code with LLM: Step-by-Step Reasoning for Explainable Fault Localizationcited by 0
- 2025Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectivescited by 0
- 2025AI and Agile Software Development: A Research Roadmap from the XP2025 Workshopcited by 0
- 2026From Failure to Alignment: A Requirements Engineering Framework for Machine Learning Systemscited by 0
- 2026From Failure to Alignment: A Requirements Engineering Framework for Machine Learning Systems30 Jun 2026
- 2026Artificial Intelligence in Open Source Software Engineering: A Foundation for Sustainability5 Feb 2026
- 2026PenForge: On-the-Fly Expert Agent Construction for Automated Penetration Testing11 Jan 2026
- 2025On LLMs' Internal Representation of Code Correctness8 Dec 2025
- 2025Open the Oyster: Empirical Evaluation and Improvement of Code Reasoning Confidence in LLMs4 Nov 2025
- 2025AI and Agile Software Development: A Research Roadmap from the XP2025 Workshop28 Aug 2025
- 2025Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findings3 Jun 2025
- 2025Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives18 Mar 2025
- 2025Code Readability in the Age of Large Language Models: An Industrial Case Study from Atlassian20 Jan 2025
- 2024Human-In-the-Loop Software Development Agents19 Nov 2024
- 2024Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI25 Oct 2024
- 2024Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanations12 Jul 2024
7 more
- 2024GPT-Powered Elicitation Interview Script Generator for Requirements Engineering Training17 Jun 2024
- 2024Morescient GAI for Software Engineering (Extended Version)7 Jun 2024
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr 2024
- 2024Demystifying Faulty Code with LLM: Step-by-Step Reasoning for Explainable Fault Localization15 Mar 2024
- 2024Calibration and Correctness of Language Models for Code3 Feb 2024
- 2023Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey27 Oct 2023
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Models22 Oct 2023
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024Human-In-the-Loop Software Development Agentscited by 42
- 2024Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AIcited by 6
- 2026PenForge: On-the-Fly Expert Agent Construction for Automated Penetration Testingcited by 1
- 2026PenForge: On-the-Fly Expert Agent Construction for Automated Penetration Testing11 Jan 2026
- 2024Human-In-the-Loop Software Development Agents19 Nov 2024
- 2024Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI25 Oct 2024
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr 2024
- 2024Calibration and Correctness of Language Models for Codecited by 49
- 2024Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanationscited by 10
- 2023Pitfalls in Language Models for Code Intelligence: A Taxonomy and Surveycited by 9
- 2025On LLMs' Internal Representation of Code Correctnesscited by 5
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Modelscited by 4
- 2025Code Readability in the Age of Large Language Models: An Industrial Case Study from Atlassiancited by 4
- 2024GPT-Powered Elicitation Interview Script Generator for Requirements Engineering Trainingcited by 3
- 2024Morescient GAI for Software Engineering (Extended Version)cited by 1
- 2025Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findingscited by 1
- 2026Artificial Intelligence in Open Source Software Engineering: A Foundation for Sustainabilitycited by 1
- 2025Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectivescited by 0
- 2025AI and Agile Software Development: A Research Roadmap from the XP2025 Workshopcited by 0
12 most cited of 13 All 13 (JSON)
- 2026From Failure to Alignment: A Requirements Engineering Framework for Machine Learning Systems30 Jun 2026
- 2026Artificial Intelligence in Open Source Software Engineering: A Foundation for Sustainability5 Feb 2026
- 2025On LLMs' Internal Representation of Code Correctness8 Dec 2025
- 2025AI and Agile Software Development: A Research Roadmap from the XP2025 Workshop28 Aug 2025
- 2025Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findings3 Jun 2025
- 2025Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives18 Mar 2025
- 2025Code Readability in the Age of Large Language Models: An Industrial Case Study from Atlassian20 Jan 2025
- 2024Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanations12 Jul 2024
- 2024GPT-Powered Elicitation Interview Script Generator for Requirements Engineering Training17 Jun 2024
- 2024Morescient GAI for Software Engineering (Extended Version)7 Jun 2024
- 2024Calibration and Correctness of Language Models for Code3 Feb 2024
- 2023Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey27 Oct 2023
12 newest of 13 All 13 (JSON)