BM25S: Orders of magnitude faster lexical search via eager sparse scoring
Not on the map. Why?
Cited by 29 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We introduce BM25S, an efficient Python-based implementation of BM25 that only depends on Numpy and Scipy. BM25S achieves up to a 500x speedup compared to the most popular Python-based framework by eagerly computing BM25 scores during indexing and storing them into sparse matrices. It also achieves considerable speedups compared to highly optimized Java-based implementations, which are used by popular commercial products. Finally, BM25S reproduces the exact implementation of five BM25 variants based on Kamphuis et al. (2020) by extending eager scoring to non-sparse variants using a novel score shifting method. The code can be found at https://github.com/xhluca/bm25s
Key facts. Cited by 87 papers in the map (data through 13 Oct 2026). Builds on 8 of its 27 references that are in the map. First posted on arXiv 4 Jul 2024.
Builds on
8 of 27 references.
References · 8
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,716
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,979
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,600
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,368
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,237
- 2020Fact or Fiction: Verifying Scientific Claimscited by 552
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 429
- 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 195
Built on by
Citing papers per year: 2024: 10; 2025: 45; 2026: 32.
87 papers.
Sort:
By area:
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 226
- 2025On the Theoretical Limitations of Embedding-Based Retrievalcited by 100
- 2025Rank1: Test-Time Compute for Reranking in Information Retrievalcited by 69
- 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Modelscited by 46
- 2024Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Modelscited by 39
- 2024Does Representation Matter? Exploring Intermediate Layers in Large Language Modelscited by 33
- 2024Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retrievercited by 25
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarioscited by 23
- 2025R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learningcited by 20
- 2024FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAGcited by 18
- 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Informationcited by 17
- 2025FocusAgent: Simple Yet Effective Ways of Trimming the Large Context of Web Agentscited by 16
38 more
- 2025The RAG Paradox: A Black-Box Attack Exploiting Unintentional Vulnerabilities in Retrieval-Augmented Generation Systemscited by 14
- 2025Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translationcited by 13
- 2024A General Framework for Producing Interpretable Semantic Text Embeddingscited by 10
- 2025GRADA: Graph-based Reranking against Adversarial Documents Attackcited by 10
- 2025STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarkingcited by 8
- 2025MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented Generationcited by 7
- 2025KoBLEX: Open Legal Question Answering with Multi-hop Reasoningcited by 7
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agentscited by 7
- 2025LAD-RAG: Layout-aware Dynamic RAG for Visually-Rich Document Understandingcited by 7
- 2025GuRE:Generative Query REwriter for Legal Passage Retrievalcited by 6
- 2025ToolDreamer: Instilling LLM Reasoning Into Tool Retrieverscited by 6
- 2026Towards Retrieving Interaction Spaces for Agentic Searchcited by 6
- 2025A Deep Dive into Retrieval-Augmented Generation for Code Completion: Experience on WeChatcited by 5
- 2025FinGEAR: Financial Mapping-Guided Enhanced Answer Retrievalcited by 5
- 2025JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptationcited by 5
- 2025Task-Specific Data Selection for Instruction Tuning via Monosemantic Neuronal Activationscited by 4
- 2025IterKey: Iterative Keyword Generation with LLMs for Enhanced Retrieval Augmented Generationcited by 4
- 2025RAG or Fine-tuning? A Comparative Study on LCMs-based Code Completion in Industrycited by 4
- 2025LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokenscited by 4
- 2024MedMobile: A mobile-sized language model with clinical capabilitiescited by 3
- 2024Multi-Field Adaptive Retrievalcited by 3
- 2025RAG Makes Guardrails Unsafe? Investigating Robustness of Guardrails under RAG-style Contextscited by 3
- 2025A New Query Expansion Approach via Agent-Mediated Dialogic Inquirycited by 2
- 2025Language Model Re-rankers are Fooled by Lexical Similaritiescited by 2
- 2025A Large-Scale Vision-Language Dataset Derived from Open Scientific Literature to Advance Biomedical Generalist AIcited by 2
- 2025Taming System Complexity: Demystifying Software Engineering Agents in Diagnosing Linux Kernel Faultscited by 2
- 2025FlexRAG: A Flexible and Comprehensive Framework for Retrieval-Augmented Generationcited by 2
- 2025Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generationcited by 2
- 2026On the Effectiveness of Proposed Techniques to Reduce Energy Consumption in RAG Systems: A Controlled Experimentcited by 2
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrievalcited by 2
- 2026MEME: Multi-entity & Evolving Memory Evaluationcited by 2
- 2025PathGPT: Reframing Path Recommendation as a Natural Language Generation Task with Retrieval-Augmented Language Modelscited by 1
- 2025TextTIGER: Text-based Intelligent Generation with Entity Prompt Refinement for Text-to-Image Generationcited by 1
- 2025Is Active Persona Inference Necessary for Aligning Small Models to Personal Preferences?cited by 1
- 2025ImpliRet: Benchmarking the Implicit Fact Retrieval Challengecited by 1
- 2025TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translationcited by 1
- 2025Case-Based Decision-Theoretic Decoding with Quality Memoriescited by 1
- 2025Zoom In Disparities in Healthcare LLM Q&Acited by 1
50 most cited of 87 All 87 (JSON)
- 2026Retrieval Sensitivity to Identity Signals in Queries29 Sep 2026
- 2026RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents17 Sep 2026
- 2026How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards16 Sep 2026
- 2026Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking9 Sep 2026
- 2026RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature27 Aug 2026
- 2026Leveraging External Knowledge for Historical Document Restoration via Retrieval-Augmented Large Language Models24 Jul 2026
- 2026AutoIndex: Learning Representation Programs for Retrieval21 Jul 2026
- 2026CMDR: Contextual Multimodal Document Retrieval7 Jul 2026
- 2026DRIFT: Data Selection for LLM Instruction Tuning via On-Policy Attribution16 Jun 2026
- 2026MLLP-VRAIN UPV system for the IWSLT 2026 Simultaneous Speech Translation task15 Jun 2026
- 2026Towards Retrieving Interaction Spaces for Agentic Search5 Jun 2026
- 2026Configurable Reward Model for Balanced Safety Alignment28 May 2026
38 more
- 2026Improving BM25 Code Retrieval Under Fixed Generic Tokenization: Adaptive q-Log Odds as a Drop-In BM25 Fix18 May 2026
- 2026Learning Faster with Better Tokens: Parameter-Efficient Vocabulary Adaptation for Specialized Text Summarization17 May 2026
- 2026MEME: Multi-entity & Evolving Memory Evaluation12 May 2026
- 2026Overview of the MedHopQA track at BioCreative IX: track description, participation and evaluation of systems for multi-hop medical question answering12 May 2026
- 2026Caraman at SemEval-2026 Task 8: Three-Stage Multi-Turn Retrieval with Query Rewriting, Hybrid Search, and Cross-Encoder Reranking12 May 2026
- 2026From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence7 May 2026
- 2026How Does Chunking Affect Retrieval-Augmented Code Completion? A Controlled Empirical Study6 May 2026
- 2026Verbal-R3: Verbal Reranker as the Missing Bridge between Retrieval and Reasoning2 May 2026
- 2026Hierarchical Abstract Tree for Cross-Document Retrieval-Augmented Generation1 May 2026
- 2026Document-as-Image Representations Fall Short for Scientific Retrieval20 Apr 2026
- 2026Understand and Accelerate Memory Processing Pipeline for Large Language Model Inference30 Mar 2026
- 2026What Tracks Hard-Negative Transfer? A Study of Lexical and Semantic Signals22 Mar 2026
- 2026Multi-Step Semantic Reasoning in Generative Retrieval12 Mar 2026
- 2026HotelQuEST: Balancing Quality and Efficiency in Agentic Search27 Feb 2026
- 2026With Argus Eyes: Assessing Retrieval Gaps via Uncertainty Scoring to Detect and Remedy Retrieval Blind Spots10 Feb 2026
- 2026Modular Expert Merging for Biomedical Retrieval4 Feb 2026
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarios13 Jan 2026
- 2026PixRec: Leveraging Visual Context for Next-Item Prediction in Sequential Recommendation10 Jan 2026
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrieval9 Jan 2026
- 2026On the Effectiveness of Proposed Techniques to Reduce Energy Consumption in RAG Systems: A Controlled Experiment5 Jan 2026
- 2025MedBioRAG: Semantic Search and Retrieval-Augmented Generation with Large Language Models for Medical and Biological QA10 Dec 2025
- 2025ToolDreamer: Instilling LLM Reasoning Into Tool Retrievers22 Oct 2025
- 2025Zoom In Disparities in Healthcare LLM Q&A20 Oct 2025
- 2025LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokens13 Oct 2025
- 2025Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generation13 Oct 2025
- 2025LAD-RAG: Layout-aware Dynamic RAG for Visually-Rich Document Understanding8 Oct 2025
- 2025RAG Makes Guardrails Unsafe? Investigating Robustness of Guardrails under RAG-style Contexts6 Oct 2025
- 2025JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptation5 Oct 2025
- 2025FocusAgent: Simple Yet Effective Ways of Trimming the Large Context of Web Agents3 Oct 2025
- 2025Which Programming Language and Model Work Best With LLM-as-a-Judge For Code Retrieval?30 Sep 2025
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agents29 Sep 2025
- 2025Case-Based Decision-Theoretic Decoding with Quality Memories16 Sep 2025
- 2025FinGEAR: Financial Mapping-Guided Enhanced Answer Retrieval15 Sep 2025
- 2025KoBLEX: Open Legal Question Answering with Multi-hop Reasoning1 Sep 2025
- 2025On the Theoretical Limitations of Embedding-Based Retrieval28 Aug 2025
- 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Information18 Aug 2025
- 2025TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translation12 Aug 2025
- 2025A Deep Dive into Retrieval-Augmented Generation for Code Completion: Experience on WeChat24 Jul 2025
50 newest of 87 All 87 (JSON)
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 226
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarioscited by 23
- 2024FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAGcited by 18
- 2025The RAG Paradox: A Black-Box Attack Exploiting Unintentional Vulnerabilities in Retrieval-Augmented Generation Systemscited by 14
- 2025GRADA: Graph-based Reranking against Adversarial Documents Attackcited by 10
- 2025MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented Generationcited by 7
- 2025LAD-RAG: Layout-aware Dynamic RAG for Visually-Rich Document Understandingcited by 7
- 2025A Deep Dive into Retrieval-Augmented Generation for Code Completion: Experience on WeChatcited by 5
- 2025FinGEAR: Financial Mapping-Guided Enhanced Answer Retrievalcited by 5
- 2025IterKey: Iterative Keyword Generation with LLMs for Enhanced Retrieval Augmented Generationcited by 4
- 2025RAG or Fine-tuning? A Comparative Study on LCMs-based Code Completion in Industrycited by 4
- 2024Multi-Field Adaptive Retrievalcited by 3
12 most cited of 26 All 26 (JSON)
- 2026RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents17 Sep 2026
- 2026Leveraging External Knowledge for Historical Document Restoration via Retrieval-Augmented Large Language Models24 Jul 2026
- 2026Improving BM25 Code Retrieval Under Fixed Generic Tokenization: Adaptive q-Log Odds as a Drop-In BM25 Fix18 May 2026
- 2026How Does Chunking Affect Retrieval-Augmented Code Completion? A Controlled Empirical Study6 May 2026
- 2026Hierarchical Abstract Tree for Cross-Document Retrieval-Augmented Generation1 May 2026
- 2026Understand and Accelerate Memory Processing Pipeline for Large Language Model Inference30 Mar 2026
- 2026With Argus Eyes: Assessing Retrieval Gaps via Uncertainty Scoring to Detect and Remedy Retrieval Blind Spots10 Feb 2026
- 2026ViDoRe V3: A Comprehensive Evaluation of Retrieval Augmented Generation in Complex Real-World Scenarios13 Jan 2026
- 2026On the Effectiveness of Proposed Techniques to Reduce Energy Consumption in RAG Systems: A Controlled Experiment5 Jan 2026
- 2025MedBioRAG: Semantic Search and Retrieval-Augmented Generation with Large Language Models for Medical and Biological QA10 Dec 2025
- 2025Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generation13 Oct 2025
- 2025LAD-RAG: Layout-aware Dynamic RAG for Visually-Rich Document Understanding8 Oct 2025
12 newest of 26 All 26 (JSON)
- 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Modelscited by 46
- 2025FocusAgent: Simple Yet Effective Ways of Trimming the Large Context of Web Agentscited by 16
- 2025STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarkingcited by 8
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agentscited by 7
- 2026Towards Retrieving Interaction Spaces for Agentic Searchcited by 6
- 2025JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptationcited by 5
- 2025A New Query Expansion Approach via Agent-Mediated Dialogic Inquirycited by 2
- 2025Taming System Complexity: Demystifying Software Engineering Agents in Diagnosing Linux Kernel Faultscited by 2
- 2026MEME: Multi-entity & Evolving Memory Evaluationcited by 2
- 2026HotelQuEST: Balancing Quality and Efficiency in Agentic Searchcited by 1
- 2026Towards Retrieving Interaction Spaces for Agentic Search5 Jun 2026
- 2026MEME: Multi-entity & Evolving Memory Evaluation12 May 2026
- 2026HotelQuEST: Balancing Quality and Efficiency in Agentic Search27 Feb 2026
- 2025JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptation5 Oct 2025
- 2025FocusAgent: Simple Yet Effective Ways of Trimming the Large Context of Web Agents3 Oct 2025
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agents29 Sep 2025
- 2025STRUCTSENSE: A Task-Agnostic Agentic Framework for Structured Information Extraction with Human-In-The-Loop Evaluation and Benchmarking4 Jul 2025
- 2025Taming System Complexity: Demystifying Software Engineering Agents in Diagnosing Linux Kernel Faults26 May 2025
- 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models3 Mar 2025
- 2025A New Query Expansion Approach via Agent-Mediated Dialogic Inquiry12 Feb 2025
- 2025Rank1: Test-Time Compute for Reranking in Information Retrievalcited by 69
- 2025R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learningcited by 20
- 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Informationcited by 17
- 2025KoBLEX: Open Legal Question Answering with Multi-hop Reasoningcited by 7
- 2025ToolDreamer: Instilling LLM Reasoning Into Tool Retrieverscited by 6
- 2025LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokenscited by 4
- 2024MedMobile: A mobile-sized language model with clinical capabilitiescited by 3
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrievalcited by 2
- 2026Verbal-R3: Verbal Reranker as the Missing Bridge between Retrieval and Reasoningcited by 0
- 2026Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linkingcited by 0
- 2026Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking9 Sep 2026
- 2026Verbal-R3: Verbal Reranker as the Missing Bridge between Retrieval and Reasoning2 May 2026
- 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrieval9 Jan 2026
- 2025ToolDreamer: Instilling LLM Reasoning Into Tool Retrievers22 Oct 2025
- 2025LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokens13 Oct 2025
- 2025KoBLEX: Open Legal Question Answering with Multi-hop Reasoning1 Sep 2025
- 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Information18 Aug 2025
- 2025R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learning26 May 2025
- 2025Rank1: Test-Time Compute for Reranking in Information Retrieval25 Feb 2025
- 2024MedMobile: A mobile-sized language model with clinical capabilities11 Oct 2024
- 2025On the Theoretical Limitations of Embedding-Based Retrievalcited by 100
- 2024Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Modelscited by 39
- 2024Does Representation Matter? Exploring Intermediate Layers in Large Language Modelscited by 33
- 2024Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retrievercited by 25
- 2025Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translationcited by 13
- 2024A General Framework for Producing Interpretable Semantic Text Embeddingscited by 10
- 2025GuRE:Generative Query REwriter for Legal Passage Retrievalcited by 6
- 2025Task-Specific Data Selection for Instruction Tuning via Monosemantic Neuronal Activationscited by 4
- 2025A Large-Scale Vision-Language Dataset Derived from Open Scientific Literature to Advance Biomedical Generalist AIcited by 2
- 2025TextTIGER: Text-based Intelligent Generation with Entity Prompt Refinement for Text-to-Image Generationcited by 1
- 2025ImpliRet: Benchmarking the Implicit Fact Retrieval Challengecited by 1
- 2025TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translationcited by 1
12 most cited of 38 All 38 (JSON)
- 2026Retrieval Sensitivity to Identity Signals in Queries29 Sep 2026
- 2026How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards16 Sep 2026
- 2026RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature27 Aug 2026
- 2026AutoIndex: Learning Representation Programs for Retrieval21 Jul 2026
- 2026CMDR: Contextual Multimodal Document Retrieval7 Jul 2026
- 2026DRIFT: Data Selection for LLM Instruction Tuning via On-Policy Attribution16 Jun 2026
- 2026MLLP-VRAIN UPV system for the IWSLT 2026 Simultaneous Speech Translation task15 Jun 2026
- 2026Learning Faster with Better Tokens: Parameter-Efficient Vocabulary Adaptation for Specialized Text Summarization17 May 2026
- 2026Overview of the MedHopQA track at BioCreative IX: track description, participation and evaluation of systems for multi-hop medical question answering12 May 2026
- 2026Caraman at SemEval-2026 Task 8: Three-Stage Multi-Turn Retrieval with Query Rewriting, Hybrid Search, and Cross-Encoder Reranking12 May 2026
- 2026From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence7 May 2026
- 2026Document-as-Image Representations Fall Short for Scientific Retrieval20 Apr 2026
12 newest of 38 All 38 (JSON)