Evolutionary Computation and Explainable AI: A Roadmap to Understandable Intelligent Systems
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence methods are being increasingly applied across various domains, but their often opaque nature has raised concerns about accountability and trust. In response, the field of explainable AI (XAI) has emerged to address the need for human-understandable AI systems. Evolutionary computation (EC), a family of powerful optimization and learning algorithms, offers significant potential to contribute to XAI, and vice versa. This paper provides an introduction to XAI and reviews current techniques for explaining machine learning models. We then explore how EC can be leveraged in XAI and examine existing XAI approaches that incorporate EC techniques. Furthermore, we discuss the application of XAI principles within EC itself, investigating how these principles can illuminate the behavior and outcomes of EC algorithms, their (automatic) configuration, and the underlying problem landscapes they optimize. Finally, we discuss open challenges in XAI and highlight opportunities for future research at the intersection of XAI and EC. Our goal is to demonstrate EC's suitability for addressing current explainability challenges and to encourage further exploration of these methods, ultimately contributing to the development of more understandable and trustworthy ML models and EC algorithms.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 60 of its 191 references that are in the map. First posted on arXiv 12 Jun 2024.
Builds on
60 of 191 references.
References · 60
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
- 2016The Mythos of Model Interpretabilitycited by 721
- 2017One pixel attack for fooling deep neural networkscited by 582
- 2015Illuminating search spaces by mapping elitescited by 425
- 2018Generating Natural Language Adversarial Examplescited by 424
38 more
- 2018All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneouslycited by 373
- 2021Contemporary Symbolic Regression Methods and their Relative Performancecited by 215
- 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 166
- 2020Multi-Objective Counterfactual Explanationscited by 157
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2020A survey of algorithmic recourse: definitions, formulations, solutions, and prospectscited by 118
- 2018The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communitiescited by 78
- 2020Model Interpretability through the Lens of Computational Complexitycited by 75
- 2022TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversationscited by 66
- 2017Interpretable & Explorable Approximations of Black Box Modelscited by 54
- 2020Neuroevolution of Self-Interpretable Agentscited by 49
- 2017Interpretable Policies for Reinforcement Learning by Genetic Programmingcited by 48
- 2021GeCo: Quality Counterfactual Explanations in Real Timecited by 32
- 2022SAFARI: Versatile and Efficient Evaluations for Robustness of Interpretabilitycited by 28
- 2021Focus! Rating XAI Methods and Finding Biasescited by 20
- 2020Evolutionary learning of interpretable decision treescited by 15
- 2022Foiling Explanations in Deep Neural Networkscited by 14
- 2021Black-box adversarial attacks using Evolution Strategiescited by 11
- 2022Are we measuring trust correctly in explainability, interpretability, and transparency research?cited by 11
- 2020Applying Genetic Programming to Improve Interpretability in Machine Learning Modelscited by 10
- 2024Explainable Benchmarking for Iterative Optimization Heuristicscited by 10
- 2014Structural bias in population-based algorithmscited by 9
- 2019On Explaining Machine Learning Models by Evolving Crucial and Compact Featurescited by 9
- 2019Adversarial Example Generation using Evolutionary Multi-objective Optimizationcited by 9
- 2020Genetic Programming for Evolving a Front of Interpretable Models for Data Visualisationcited by 9
- 2021Model Learning with Personalized Interpretability Estimation (ML-PIE)cited by 9
- 2021OPTION: OPTImization Algorithm Benchmarking ONtologycited by 9
- 2022Neural Network Pruning by Cooperative Coevolutioncited by 9
- 2022A Framework for Inherently Interpretable Optimization Modelscited by 8
- 2023DynamoRep: Trajectory-Based Population Dynamics for Classification of Black-box Optimization Problemscited by 8
- 2022Quality Diversity Evolutionary Learning of Decision Treescited by 7
- 2023MA-BBOB: Many-Affine Combinations of BBOB Functions for Evaluating AutoML Approaches in Noiseless Numerical Black-Box Optimization Contextscited by 7
- 2017Data-Efficient Exploration, Optimization, and Modeling of Diverse Designs through Surrogate-Assisted Illuminationcited by 6
- 2021Explainable Landscape-Aware Optimization Performance Predictioncited by 5
- 2023Using Affine Combinations of BBOB Problems for Performance Assessmentcited by 5
- 2021Multi-objective Feature Selection with Missing Data in Classificationcited by 4
- 2022Towards Explainable Metaheuristic: Mining Surrogate Fitness Models for Importance of Variablescited by 4
- 2023Using Knowledge Graphs for Performance Prediction of Modular Optimization Algorithmscited by 4
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.