mlsanityData to 14 Oct 2026

SHAP zero Explains Biological Sequence Models with Near-zero Marginal Cost for Future Queries

arXiv 2410.19236 ↗First posted 25 Oct 2024cs.LG cs.CE q-bio.GNcited by 4

Not on the map. Why?

Abstract (arXiv)

The growing adoption of machine learning models for biological sequences has intensified the need for interpretable predictions, with Shapley values emerging as a theoretically grounded standard for model explanation. While effective for local explanations of individual input sequences, scaling Shapley-based interpretability to extract global biological insights requires evaluating thousands of sequences--incurring exponential computational cost per query. We introduce SHAP zero, a novel algorithm that amortizes the cost of Shapley value computation across large-scale biological datasets. After a one-time model sketching step, SHAP zero enables near-zero marginal cost for future queries by uncovering an underexplored connection between Shapley values, high-order feature interactions, and the sparse Fourier transform of the model. Applied to models of guide RNA efficacy, DNA repair outcomes, and protein fitness, SHAP zero explains predictions orders of magnitude faster than existing methods, recovering rich combinatorial interactions previously inaccessible at scale. This work opens the door to principled, efficient, and scalable interpretability for black-box sequence models in biology.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 66 references that are in the map. First posted on arXiv 25 Oct 2024.

Builds on

21 of 66 references.

References · 21

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  3. 2018Learning to Explain: An Information-Theoretic Perspective on Model Interpretationcited by 248
  4. 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 194
  5. 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 154
  6. 2019The Shapley Taylor Interaction Indexcited by 143
  7. 2021FastSHAP: Real-Time Shapley Value Estimationcited by 125
  8. 2019Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximationcited by 115
  9. 2022Algorithms to estimate Shapley value feature attributionscited by 115
  10. 2018L-Shapley and C-Shapley: Efficient Model Interpretation for Structured Datacited by 100
  11. 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
  12. 2022Faith-Shap: The Faithful Shapley Interaction Indexcited by 69
9 more
  1. 2022From Shapley Values to Generalized Additive Models and backcited by 60
  2. 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 51
  3. 2022Learning to Estimate Shapley Values with Vision Transformerscited by 45
  4. 2021Shapley Explanation Networkscited by 41
  5. 2021Explaining a Series of Models by Propagating Shapley Valuescited by 37
  6. 2024Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attributioncited by 21
  7. 2024Learning to Understand: Identifying Interactions via the M"obius Transformcited by 13
  8. 2024On Recovering Higher-order Interactions from Protein Language Modelscited by 10
  9. 2023Efficiently Computing Sparse Fourier Transforms of q-ary Functionscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.