Static Pruning Across Sparse Retrieval Regimes: What Transfers, What Breaks, and What Still Helps
Not on the map. Why?
Abstract (arXiv)
Static pruning is widely used to accelerate sparse neural retrieval, yet existing studies each validate their conclusions within a single custom pipeline, leaving it unclear which findings transfer to modern engines with different index organizations and dynamic pruning mechanisms. We present the first cross-engine pruning portability study, evaluating static pruning strategies across three engines - a controlled C++ pipeline (exhaustive inverted index), BMP (block-max pruning), and SEISMIC (clustered inverted indexes) - on two benchmarks (MS MARCO, Natural Questions) with two encoders spanning opposite query-density regimes (SPLADE: 44 avg. query terms; V3-GTE: 7 avg. query terms), totaling 1,140 experimental configurations, with an additional deep-judgment validation on TREC DL 2019/2020. We find that index-side pruning (document and posting-list) is portable: it consistently reduces latency (1.2-6.6×) and index size (18-82%) across all engines because sparse retrieval is memory-bound - a conclusion we support with cache-miss, TLB, and IPC profiling. In contrast, query pruning is already internalized by modern engines: it yields 4-11× speedup on the exhaustive pipeline but is subsumed by BMP's β and SEISMIC's querycut. Static pruning complements dynamic pruning: on BMP, combining document and query reduction yields 2.5× speedup with NDCG@10 within 0.003 of the exact baseline. Finally, NDCG@10 saturates while Recall@10 is still in the ~85-95% range across all three engines, providing a portable stopping criterion: practitioners can push pruning to this knee without visible ranking degradation. Together, these findings answer what transfers (index-side pruning), what breaks (query pruning), and what still helps (static atop dynamic pruning).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
13 of 35 references.
References · 13
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 286
- 2019CEDR: Contextualized Embeddings for Document Rankingcited by 77
- 2021A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniquescited by 69
- 2021Learning Passage Impacts for Inverted Indexescited by 68
- 2024Efficient Inverted Indexes for Approximate Retrieval over Learned Sparse Representationscited by 24
- 2023A Static Pruning Study on Sparse Neural Retrieverscited by 11
- 2019Let's measure run time! Extending the IR replicability infrastructure to include performance aspectscited by 10
- 2024Faster Learned Sparse Retrieval with Block-Max Pruningcited by 10
- 2024Towards Competitive Search Relevance For Inference-Free Learned Sparse Retrieverscited by 8
- 2022Faster Learned Sparse Retrieval with Guided Traversalcited by 5
1 more
Built on by
Not cited yet.