mlsanityData to 7 Oct 2026

Explainable AI for Bioinformatics: Methods, Tools, and Applications

arXiv 2212.13261 ↗First posted 25 Dec 2022q-bio.QM cs.AI cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence (AI) systems utilizing deep neural networks (DNNs) and machine learning (ML) algorithms are widely used for solving important problems in bioinformatics, biomedical informatics, and precision medicine. However, complex DNNs or ML models, which are often perceived as opaque and black-box, can make it difficult to understand the reasoning behind their decisions. This lack of transparency can be a challenge for both end-users and decision-makers, as well as AI developers. Additionally, in sensitive areas like healthcare, explainability and accountability are not only desirable but also legally required for AI systems that can have a significant impact on human lives. Fairness is another growing concern, as algorithmic decisions should not show bias or discrimination towards certain groups or individuals based on sensitive attributes. Explainable artificial intelligence (XAI) aims to overcome the opaqueness of black-box models and provide transparency in how AI systems make decisions. Interpretable ML models can explain how they make predictions and the factors that influence their outcomes. However, most state-of-the-art interpretable ML methods are domain-agnostic and evolved from fields like computer vision, automated reasoning, or statistics, making direct application to bioinformatics problems challenging without customization and domain-specific adaptation. In this paper, we discuss the importance of explainability in the context of bioinformatics, provide an overview of model-specific and model-agnostic interpretable ML methods and tools, and outline their potential caveats and drawbacks. Besides, we discuss how to customize existing interpretable ML methods for bioinformatics problems. Nevertheless, we demonstrate how XAI methods can improve transparency through case studies in bioimaging, cancer genomics, and text mining.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 70 of its 133 references that are in the map. First posted on arXiv 25 Dec 2022.

Builds on

70 of 133 references.

References · 70

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  6. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  7. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  8. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  9. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  10. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  11. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  12. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
38 more
  1. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  2. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  3. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  4. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  5. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  6. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  7. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  8. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  9. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  10. 2017Counterfactual Fairnesscited by 802
  11. 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
  12. 2020Knowledge Graphscited by 619
  13. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
  14. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
  15. 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
  16. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 318
  17. 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
  18. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
  19. 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 248
  20. 2019Explainable Machine Learning in Deploymentcited by 210
  21. 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
  22. 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
  23. 2015Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelcited by 140
  24. 2019Explaining Classifiers with Causal Concept Effect (CaCE)cited by 135
  25. 2019Reinforcement Knowledge Graph Reasoning for Explainable Recommendationcited by 102
  26. 2019Rethinking Cooperative Rationalization: Introspective Extraction and Complement Controlcited by 96
  27. 2017Explaining Recurrent Neural Network Predictions in Sentiment Analysiscited by 87
  28. 2017Learning how to explain neural networks: PatternNet and PatternAttributioncited by 84
  29. 2020Causal Interpretability for Machine Learning -- Problems, Methods and Evaluationcited by 82
  30. 2015The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classificationcited by 76
  31. 2020Interpretability of machine learning based prediction models in healthcarecited by 75
  32. 2018Weakly Supervised Instance Segmentation using Class Peak Responsecited by 74
  33. 2019Measuring the Quality of Explanations: The System Causability Scale (SCS). Comparing Human and Machine Explanationscited by 63
  34. 2018RuleMatrix: Visualizing and Understanding Classifiers with Rulescited by 62
  35. 2018A Theoretical Explanation for Perplexing Behaviors of Backpropagation-based Visualizationscited by 59
  36. 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
  37. 2020Building a PubMed knowledge graphcited by 38
  38. 2018Understanding Convolutional Neural Networks for Text Classificationcited by 36

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 4; 2024: 4; 2025: 3.

11 papers.