Explainable AI for Bioinformatics: Methods, Tools, and Applications
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) systems utilizing deep neural networks (DNNs) and machine learning (ML) algorithms are widely used for solving important problems in bioinformatics, biomedical informatics, and precision medicine. However, complex DNNs or ML models, which are often perceived as opaque and black-box, can make it difficult to understand the reasoning behind their decisions. This lack of transparency can be a challenge for both end-users and decision-makers, as well as AI developers. Additionally, in sensitive areas like healthcare, explainability and accountability are not only desirable but also legally required for AI systems that can have a significant impact on human lives. Fairness is another growing concern, as algorithmic decisions should not show bias or discrimination towards certain groups or individuals based on sensitive attributes. Explainable artificial intelligence (XAI) aims to overcome the opaqueness of black-box models and provide transparency in how AI systems make decisions. Interpretable ML models can explain how they make predictions and the factors that influence their outcomes. However, most state-of-the-art interpretable ML methods are domain-agnostic and evolved from fields like computer vision, automated reasoning, or statistics, making direct application to bioinformatics problems challenging without customization and domain-specific adaptation. In this paper, we discuss the importance of explainability in the context of bioinformatics, provide an overview of model-specific and model-agnostic interpretable ML methods and tools, and outline their potential caveats and drawbacks. Besides, we discuss how to customize existing interpretable ML methods for bioinformatics problems. Nevertheless, we demonstrate how XAI methods can improve transparency through case studies in bioimaging, cancer genomics, and text mining.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 70 of its 133 references that are in the map. First posted on arXiv 25 Dec 2022.
Builds on
70 of 133 references.
References · 70
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
38 more
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2017Counterfactual Fairnesscited by 802
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
- 2020Knowledge Graphscited by 619
- 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
- 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 318
- 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
- 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
- 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 248
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
- 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
- 2015Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelcited by 140
- 2019Explaining Classifiers with Causal Concept Effect (CaCE)cited by 135
- 2019Reinforcement Knowledge Graph Reasoning for Explainable Recommendationcited by 102
- 2019Rethinking Cooperative Rationalization: Introspective Extraction and Complement Controlcited by 96
- 2017Explaining Recurrent Neural Network Predictions in Sentiment Analysiscited by 87
- 2017Learning how to explain neural networks: PatternNet and PatternAttributioncited by 84
- 2020Causal Interpretability for Machine Learning -- Problems, Methods and Evaluationcited by 82
- 2015The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classificationcited by 76
- 2020Interpretability of machine learning based prediction models in healthcarecited by 75
- 2018Weakly Supervised Instance Segmentation using Class Peak Responsecited by 74
- 2019Measuring the Quality of Explanations: The System Causability Scale (SCS). Comparing Human and Machine Explanationscited by 63
- 2018RuleMatrix: Visualizing and Understanding Classifiers with Rulescited by 62
- 2018A Theoretical Explanation for Perplexing Behaviors of Backpropagation-based Visualizationscited by 59
- 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
- 2020Building a PubMed knowledge graphcited by 38
- 2018Understanding Convolutional Neural Networks for Text Classificationcited by 36
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 4; 2025: 3.
11 papers.
- 2023Knowledge Graphs for the Life Sciences: Recent Developments, Challenges and Opportunitiescited by 10
- 2023From Large Language Models to Knowledge Graphs for Biomarker Discovery in Cancercited by 4
- 2024Bioinformatics and Biomedical Informatics with ChatGPT: Year One Reviewcited by 4
- 2023A Biomedical Knowledge Graph for Biomarker Discovery in Cancercited by 3
- 2023Defining the boundaries: challenges and advances in identifying cells in microscopy imagescited by 2
- 2024Advancing Chinese biomedical text mining with community challengescited by 0
- 2024Explaining AI Decisions: Towards Achieving Human-Centered Explainability in Smart Home Environmentscited by 0
- 2024What Matters in Explanations: Towards Explainable Fake Review Detection Focusing on Transformerscited by 0
- 2025Artificial Intelligence for Pediatric Height Prediction Using Large-Scale Longitudinal Body Composition Datacited by 0
- 2025Attribution assignment for deep-generative sequence models enables interpretability analysis using positive-only datacited by 0
- 2025Explaining AI Without Code: A User Study on Explainable AIcited by 0
- 2025Explaining AI Without Code: A User Study on Explainable AI28 Dec 2025
- 2025Attribution assignment for deep-generative sequence models enables interpretability analysis using positive-only data29 Jun 2025
- 2025Artificial Intelligence for Pediatric Height Prediction Using Large-Scale Longitudinal Body Composition Data9 Apr 2025
- 2024What Matters in Explanations: Towards Explainable Fake Review Detection Focusing on Transformers24 Jul 2024
- 2024Explaining AI Decisions: Towards Achieving Human-Centered Explainability in Smart Home Environments23 Apr 2024
- 2024Bioinformatics and Biomedical Informatics with ChatGPT: Year One Review22 Mar 2024
- 2024Advancing Chinese biomedical text mining with community challenges7 Mar 2024
- 2023Defining the boundaries: challenges and advances in identifying cells in microscopy images14 Nov 2023
- 2023From Large Language Models to Knowledge Graphs for Biomarker Discovery in Cancer12 Oct 2023
- 2023Knowledge Graphs for the Life Sciences: Recent Developments, Challenges and Opportunities29 Sep 2023
- 2023A Biomedical Knowledge Graph for Biomarker Discovery in Cancer9 Feb 2023