Yes, BM25 is a Strong Baseline for Legal Case Retrieval
Not on the map. Why?
Abstract (arXiv)
We describe our single submission to task 1 of COLIEE 2021. Our vanilla BM25 got second place, well above the median of submissions. Code is available at https://github.com/neuralmind-ai/coliee.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 6 of its 20 references that are in the map. First posted on arXiv 26 Apr 2021.
Builds on
6 of 20 references.
References · 6
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2021Pyserini: An Easy-to-Use Python Toolkit to Support Replicable IR Research with Sparse and Dense Representationscited by 60
- 2020Rapidly Deploying a Neural Search Engine for the COVID-19 Open Research Dataset: Preliminary Thoughts and Lessons Learnedcited by 10
- 2021IITP@COLIEE 2019: Legal Information Retrieval using BM25 and BERTcited by 5
- 2020Cross-domain Retrieval in the Legal and Patent Domains: a Reproducibility Studycited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 8; 2024: 3; 2025: 10; 2026: 1.
24 papers.
Sort:
By area:
- 2025A Reasoning-Focused Legal Retrieval Benchmarkcited by 37
- 2024The Chronicles of RAG: The Retriever, the Chunk and the Generatorcited by 34
- 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal Systemcited by 18
- 2023U-CREAT: Unsupervised Case Retrieval using Events extrAcTioncited by 16
- 2022nigam@COLIEE-22: Legal Case Retrieval and Entailment using Cascading of Lexical and Semantic-based modelscited by 9
- 2023DAPR: A Benchmark on Document-Aware Passage Retrievalcited by 9
- 2022Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Taskcited by 8
- 2023Generator-Retriever-Generator Approach for Open-Domain Question Answeringcited by 8
- 2023Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Taskcited by 6
- 2025CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generationcited by 6
- 2025LegalSearchLM: Rethinking Legal Case Retrieval as Legal Elements Generationcited by 5
- 2023NOWJ at COLIEE 2023 -- Multi-Task and Ensemble Approaches in Legal Information Processingcited by 4
12 more
- 2025Evaluating Legal Reasoning Traces with Legal Issue Tree Rubricscited by 4
- 2023LePaRD: A Large-Scale Dataset of Judges Citing Precedentscited by 3
- 2024Enhancing Legal Document Retrieval: A Multi-Phase Approach with Large Language Modelscited by 3
- 2025Assessing the Performance Gap Between Lexical and Semantic Models for Information Retrieval With Formulaic Legal Languagecited by 3
- 2025ASP2LJ : An Adversarial Self-Play Laywer Augmented Legal Judgment Frameworkcited by 3
- 2025LLM-based Embedders for Prior Case Retrievalcited by 2
- 2025Comparing Knowledge Injection Methods for LLMs in a Low-Resource Regimecited by 2
- 2023Sequencing Matters: A Generate-Retrieve-Generate Model for Building Conversational Agentscited by 1
- 2025Discourse-Aware Scientific Paper Recommendation via QA-Style Summarization and Multi-Level Contrastive Learningcited by 1
- 2023Citation Recommendation on Scholarly Legal Articlescited by 0
- 2024GPTs and Language Barrier: A Cross-Lingual Legal QA Examinationcited by 0
- 2026When Rules Learn: A Self-Evolving Agent for Legal Case Retrievalcited by 0
- 2026When Rules Learn: A Self-Evolving Agent for Legal Case Retrieval15 Jun 2026
- 2025Evaluating Legal Reasoning Traces with Legal Issue Tree Rubrics30 Nov 2025
- 2025Discourse-Aware Scientific Paper Recommendation via QA-Style Summarization and Multi-Level Contrastive Learning5 Nov 2025
- 2025Comparing Knowledge Injection Methods for LLMs in a Low-Resource Regime8 Aug 2025
- 2025CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generation7 Aug 2025
- 2025LLM-based Embedders for Prior Case Retrieval24 Jul 2025
- 2025Assessing the Performance Gap Between Lexical and Semantic Models for Information Retrieval With Formulaic Legal Language15 Jun 2025
- 2025ASP2LJ : An Adversarial Self-Play Laywer Augmented Legal Judgment Framework11 Jun 2025
- 2025LegalSearchLM: Rethinking Legal Case Retrieval as Legal Elements Generation28 May 2025
- 2025A Reasoning-Focused Legal Retrieval Benchmark6 May 2025
- 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal System18 Mar 2025
- 2024GPTs and Language Barrier: A Cross-Lingual Legal QA Examination26 Mar 2024
12 more
- 2024Enhancing Legal Document Retrieval: A Multi-Phase Approach with Large Language Models26 Mar 2024
- 2024The Chronicles of RAG: The Retriever, the Chunk and the Generator15 Jan 2024
- 2023Sequencing Matters: A Generate-Retrieve-Generate Model for Building Conversational Agents16 Nov 2023
- 2023LePaRD: A Large-Scale Dataset of Judges Citing Precedents15 Nov 2023
- 2023Citation Recommendation on Scholarly Legal Articles10 Nov 2023
- 2023Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Task11 Sep 2023
- 2023Generator-Retriever-Generator Approach for Open-Domain Question Answering21 Jul 2023
- 2023U-CREAT: Unsupervised Case Retrieval using Events extrAcTion11 Jul 2023
- 2023NOWJ at COLIEE 2023 -- Multi-Task and Ensemble Approaches in Legal Information Processing8 Jun 2023
- 2023DAPR: A Benchmark on Document-Aware Passage Retrieval23 May 2023
- 2022Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Task30 May 2022
- 2022nigam@COLIEE-22: Legal Case Retrieval and Entailment using Cascading of Lexical and Semantic-based models16 Apr 2022
- 2025A Reasoning-Focused Legal Retrieval Benchmarkcited by 37
- 2025Evaluating Legal Reasoning Traces with Legal Issue Tree Rubricscited by 4
- 2025Evaluating Legal Reasoning Traces with Legal Issue Tree Rubrics30 Nov 2025
- 2025A Reasoning-Focused Legal Retrieval Benchmark6 May 2025
- 2023U-CREAT: Unsupervised Case Retrieval using Events extrAcTioncited by 16
- 2022nigam@COLIEE-22: Legal Case Retrieval and Entailment using Cascading of Lexical and Semantic-based modelscited by 9
- 2023DAPR: A Benchmark on Document-Aware Passage Retrievalcited by 9
- 2022Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Taskcited by 8
- 2023Generator-Retriever-Generator Approach for Open-Domain Question Answeringcited by 8
- 2023Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Taskcited by 6
- 2025CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generationcited by 6
- 2025LegalSearchLM: Rethinking Legal Case Retrieval as Legal Elements Generationcited by 5
- 2023NOWJ at COLIEE 2023 -- Multi-Task and Ensemble Approaches in Legal Information Processingcited by 4
- 2023LePaRD: A Large-Scale Dataset of Judges Citing Precedentscited by 3
- 2024Enhancing Legal Document Retrieval: A Multi-Phase Approach with Large Language Modelscited by 3
- 2025Assessing the Performance Gap Between Lexical and Semantic Models for Information Retrieval With Formulaic Legal Languagecited by 3
12 most cited of 17 All 17 (JSON)
- 2025Discourse-Aware Scientific Paper Recommendation via QA-Style Summarization and Multi-Level Contrastive Learning5 Nov 2025
- 2025Comparing Knowledge Injection Methods for LLMs in a Low-Resource Regime8 Aug 2025
- 2025CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generation7 Aug 2025
- 2025LLM-based Embedders for Prior Case Retrieval24 Jul 2025
- 2025Assessing the Performance Gap Between Lexical and Semantic Models for Information Retrieval With Formulaic Legal Language15 Jun 2025
- 2025LegalSearchLM: Rethinking Legal Case Retrieval as Legal Elements Generation28 May 2025
- 2024GPTs and Language Barrier: A Cross-Lingual Legal QA Examination26 Mar 2024
- 2024Enhancing Legal Document Retrieval: A Multi-Phase Approach with Large Language Models26 Mar 2024
- 2023LePaRD: A Large-Scale Dataset of Judges Citing Precedents15 Nov 2023
- 2023Citation Recommendation on Scholarly Legal Articles10 Nov 2023
- 2023Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Task11 Sep 2023
- 2023Generator-Retriever-Generator Approach for Open-Domain Question Answering21 Jul 2023
12 newest of 17 All 17 (JSON)