mlsanityData to 7 Oct 2026

Search-Based Software Engineering and AI Foundation Models: Current Landscape and Future Roadmap

arXiv 2505.19625 ↗First posted 26 May 2025cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Search-based software engineering (SBSE), which integrates metaheuristic search techniques with software engineering, has been an active area of research for about 25 years. It has been applied to solve numerous problems across the entire software engineering lifecycle and has demonstrated its versatility in multiple domains. With recent advances in Artificial Intelligence (AI), particularly the emergence of foundation models (FMs) such as large language models (LLMs), the evolution of SBSE alongside these models remains undetermined. In this window of opportunity, we present a research roadmap that articulates the current landscape of SBSE in relation to FMs, identifies open challenges, and outlines potential research directions to advance SBSE through its synergy with FMs. Specifically, we analyze three core aspects: utilizing FMs to enhance SBSE, applying SBSE to advance FMs, and exploring the integration of SBSE and FMs. Furthermore, we present a forward-thinking perspective that envisions the future of SBSE in the era of FMs, highlighting promising research opportunities to address challenges in emerging domains.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 85 of its 221 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

85 of 221 references.

References · 85

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  4. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 876
  5. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 738
  6. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  7. 2024A Survey on Large Language Models for Code Generationcited by 646
  8. 2023A Survey of Hallucination in Large Foundation Modelscited by 365
  9. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  10. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
  11. 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 213
  12. 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
38 more
  1. 2020pymoo: Multi-objective Optimization in Pythoncited by 196
  2. 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
  3. 2023Large Language Models for Software Engineering: Survey and Open Problemscited by 178
  4. 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
  5. 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
  6. 2024IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilitiescited by 100
  7. 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
  8. 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 88
  9. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 88
  10. 2023Large Language Models for Test-Free Fault Localizationcited by 67
  11. 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 60
  12. 2023A Survey on Large Language Models for Software Engineeringcited by 58
  13. 2022Pynguin: Automated Unit Test Generation for Pythoncited by 49
  14. 2022Causality-based Neural Network Repaircited by 44
  15. 2025A Survey of Automatic Prompt Engineering: An Optimization Perspectivecited by 41
  16. 2020Model-based Exploration of the Frontier of Behaviours for Deep Learning System Testingcited by 40
  17. 2022GPS: Genetic Prompt Search for Efficient Few-shot Learningcited by 37
  18. 2022A Survey on Automated Driving System Testing: Landscapes and Trendscited by 36
  19. 2024VLM See, Robot Do: Human Demo Video to Robot Action Plan via Vision Language Modelcited by 36
  20. 2019DeepFault: Fault Localization for Deep Neural Networkscited by 29
  21. 2023Large Language Models in Fault Localisationcited by 28
  22. 2024Search-Based LLMs for Code Optimizationcited by 27
  23. 2019Arachne: Search Based Repair of Deep Neural Networkscited by 25
  24. 2017Continuous Integration, Delivery and Deployment: A Systematic Review on Approaches, Tools, Challenges and Practicescited by 22
  25. 2025KNighter: Transforming Static Analysis with LLM-Synthesized Checkerscited by 22
  26. 2023Leveraging Large Language Models to Improve REST API Testingcited by 20
  27. 2024Efficient and Accurate Prompt Optimization: the Benefit of Memory in Exemplar-Guided Reflectioncited by 18
  28. 2024Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Artcited by 17
  29. 2023InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operatorscited by 16
  30. 2025Beyond Prompt Content: Enhancing LLM Performance via Content-Format Integrated Prompt Optimizationcited by 15
  31. 2023Evaluating Diverse Large Language Models for Automatic and General Bug Reproductioncited by 12
  32. 2024SEE: Strategic Exploration and Exploitation for Cohesive In-Context Prompt Optimizationcited by 12
  33. 2025ProAPO: Progressively Automatic Prompt Optimization for Visual Classificationcited by 12
  34. 2022Testing RESTful APIs: A Surveycited by 11
  35. 2024Reality Bites: Assessing the Realism of Driving Scenarios with Large Language Modelscited by 11
  36. 2024Rethinking Software Engineering in the Foundation Model Era: From Task-Driven AI Copilots to Goal-Driven AI Pair Programmerscited by 11
  37. 2025RainbowPlus: Enhancing Adversarial Prompt Generation via Evolutionary Quality-Diversity Searchcited by 10
  38. 2024TestSpark: IntelliJ IDEA's Ultimate Test Generation Companioncited by 9

50 most cited of 85 All 85 (JSON)

Built on by

Not cited yet.