SHAP zero Explains Biological Sequence Models with Near-zero Marginal Cost for Future Queries
Not on the map. Why?
Abstract (arXiv)
The growing adoption of machine learning models for biological sequences has intensified the need for interpretable predictions, with Shapley values emerging as a theoretically grounded standard for model explanation. While effective for local explanations of individual input sequences, scaling Shapley-based interpretability to extract global biological insights requires evaluating thousands of sequences--incurring exponential computational cost per query. We introduce SHAP zero, a novel algorithm that amortizes the cost of Shapley value computation across large-scale biological datasets. After a one-time model sketching step, SHAP zero enables near-zero marginal cost for future queries by uncovering an underexplored connection between Shapley values, high-order feature interactions, and the sparse Fourier transform of the model. Applied to models of guide RNA efficacy, DNA repair outcomes, and protein fitness, SHAP zero explains predictions orders of magnitude faster than existing methods, recovering rich combinatorial interactions previously inaccessible at scale. This work opens the door to principled, efficient, and scalable interpretability for black-box sequence models in biology.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 66 references that are in the map. First posted on arXiv 25 Oct 2024.
Builds on
21 of 66 references.
References · 21
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2018Learning to Explain: An Information-Theoretic Perspective on Model Interpretationcited by 248
- 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 194
- 2020Improving KernelSHAP: Practical Shapley Value Estimation via Linear Regressioncited by 154
- 2019The Shapley Taylor Interaction Indexcited by 143
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 125
- 2019Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximationcited by 115
- 2022Algorithms to estimate Shapley value feature attributionscited by 115
- 2018L-Shapley and C-Shapley: Efficient Model Interpretation for Structured Datacited by 100
- 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
- 2022Faith-Shap: The Faithful Shapley Interaction Indexcited by 69
9 more
- 2022From Shapley Values to Generalized Additive Models and backcited by 60
- 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 51
- 2022Learning to Estimate Shapley Values with Vision Transformerscited by 45
- 2021Shapley Explanation Networkscited by 41
- 2021Explaining a Series of Models by Propagating Shapley Valuescited by 37
- 2024Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attributioncited by 21
- 2024Learning to Understand: Identifying Interactions via the M"obius Transformcited by 13
- 2024On Recovering Higher-order Interactions from Protein Language Modelscited by 10
- 2023Efficiently Computing Sparse Fourier Transforms of q-ary Functionscited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Sparse Autoencoders for Low-N Protein Function Prediction and Designcited by 4
- 2026Protein Circuit Tracing via Cross-layer Transcoderscited by 3
- 2026Circuit Tracing in Autoregressive Protein Language Modelscited by 0
- 2026Learning Task-Specific Antibody Representations via Function-Aware Maskingcited by 0
- 2026Learning Task-Specific Antibody Representations via Function-Aware Masking1 Sep 2026
- 2026Circuit Tracing in Autoregressive Protein Language Models14 Jun 2026
- 2026Protein Circuit Tracing via Cross-layer Transcoders12 Feb 2026
- 2025Sparse Autoencoders for Low-N Protein Function Prediction and Design25 Aug 2025