mlsanityData to 7 Oct 2026

Tevatron: An Efficient and Flexible Toolkit for Dense Retrieval

arXiv 2203.05765 ↗First posted 11 Mar 2022cs.IR cs.CLcited by 47

Not on the map. Why?

Abstract (arXiv)

Recent rapid advancements in deep pre-trained language models and the introductions of large datasets have powered research in embedding-based dense retrieval. While several good research papers have emerged, many of them come with their own software stacks. These stacks are typically optimized for some particular research goals instead of efficiency or code structure. In this paper, we present Tevatron, a dense retrieval toolkit optimized for efficiency, flexibility, and code simplicity. Tevatron provides a standardized pipeline for dense retrieval including text processing, model training, corpus/query encoding, and search. This paper presents an overview of Tevatron and demonstrates its effectiveness and efficiency across several IR and QA data sets. We also show how Tevatron's flexible design enables easy generalization across datasets, model architectures, and accelerator platforms(GPU/TPU). We believe Tevatron can serve as an effective software foundation for dense retrieval system research including design, modeling, and optimization.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 20 of its 26 references that are in the map. First posted on arXiv 11 Mar 2022.

Builds on

20 of 26 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  6. 2017Billion-scale similarity search with GPUscited by 2,477
  7. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  8. 2017Mixed Precision Trainingcited by 1,135
  9. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
  10. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  11. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  12. 2021Datasets: A Community Library for Natural Language Processingcited by 526
8 more
  1. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 486
  2. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  3. 2021Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrievalcited by 203
  4. 2021Condenser: a Pre-training Architecture for Dense Retrievalcited by 162
  5. 2021Scaling Deep Contrastive Learning Batch Size under Memory Limited Setupcited by 123
  6. 2020XOR QA: Cross-lingual Open-Retrieval Question Answeringcited by 121
  7. 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 118
  8. 2021A Replication Study of Dense Passage Retrievercited by 37

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 12; 2023: 14; 2024: 7; 2025: 5; 2026: 9.

47 papers.

Sort:

By area:

  1. 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 168
  2. 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMscited by 104
  3. 2024SPLADE-v3: New baselines for SPLADEcited by 69
  4. 2022Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generationcited by 47
  5. 2022Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languagescited by 47
  6. 2024Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Modelscited by 39
  7. 2022CharacterBERT and Self-Teaching for Improving the Robustness of Dense Retrievers on Queries with Typoscited by 22
  8. 2022CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrievalcited by 19
  9. 2022Neural Approaches to Multilingual Information Retrievalcited by 18
  10. 2024CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generationcited by 18
  11. 2024FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAGcited by 18
  12. 2022ConTextual Masked Auto-Encoder for Dense Passage Retrievalcited by 16
35 more
  1. 2022C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrievalcited by 14
  2. 2024Reinforcement Retrieval Leveraging Fine-grained Feedback for Fact Checking News Claims with Black-Box LLMcited by 14
  3. 2025LLM4Ranking: An Easy-to-use Framework of Utilizing Large Language Models for Document Rerankingcited by 12
  4. 2023MAUPQA: Massive Automatically-created Polish Question Answering Datasetcited by 11
  5. 2023Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answeringcited by 11
  6. 2025CSPLADE: Learned Sparse Retrieval with Causal Language Modelscited by 10
  7. 2025The Silent Saboteur: Imperceptible Adversarial Attacks against Black-Box Retrieval-Augmented Generation Systemscited by 10
  8. 2022Query-as-context Pre-training for Dense Passage Retrievalcited by 9
  9. 2023Predictive Chemistry Augmented with Text Retrievalcited by 9
  10. 2023Pre-training with Large Language Model-based Document Expansion for Dense Passage Retrievalcited by 7
  11. 2023Selecting which Dense Retriever to use for Zero-Shot Searchcited by 7
  12. 2022Automated MeSH Term Suggestion for Effective Query Formulation in Systematic Reviews Literature Searchcited by 6
  13. 2023Typo-Robust Representation Learning for Dense Retrievalcited by 6
  14. 2022Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negativescited by 5
  15. 2023Quick Dense Retrievers Consume KALE: Post Training Kullback Leibler Alignment of Embeddings for Asymmetrical dual encoderscited by 5
  16. 2023Noise-Robust Dense Retrieval via Contrastive Alignment Post Trainingcited by 5
  17. 2023Silver Retriever: Advancing Neural Passage Retrieval for Polish Question Answeringcited by 5
  18. 2026LACONIC: Dense-Level Effectiveness for Scalable Sparse Retrieval via a Two-Phase Training Curriculumcited by 5
  19. 2022Learning Diverse Document Representations with Deep Query Interactions for Dense Retrievalcited by 4
  20. 2022Knowledge Base Index Compression via Dimensionality and Precision Reductioncited by 2
  21. 2023Dial-MAE: ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systemscited by 2
  22. 2023Overview of the TREC 2023 Product Product Search Trackcited by 2
  23. 2026AgentWebBench: Benchmarking Multi-Agent Coordination in Agentic Webcited by 2
  24. 2026Efficient Temporal-aware Matryoshka Adaptation for Temporal Information Retrievalcited by 1
  25. 2026RoutIR: Fast Serving of Retrieval Pipelines for Retrieval-Augmented Generationcited by 1
  26. 2026Training Dense Retrievers with Multiple Positive Passagescited by 1
  27. 2023Dense Sparse Retrieval: Using Sparse Language Models for Inference Efficient Dense Retrievalcited by 0
  28. 2023Evidentiality-aware Retrieval for Overcoming Abstractiveness in Open-Domain Question Answeringcited by 0
  29. 2024Transferring BERT Capabilities from High-Resource to Low-Resource Languages Using Vocabulary Matchingcited by 0
  30. 2025MURR: Model Updating with Regularized Replay for Searching a Document Streamcited by 0
  31. 2025Trove: A Flexible Toolkit for Dense Retrievalcited by 0
  32. 2026UnIte: Uncertainty-based Iterative Document Sampling for Domain Adaptation in Information Retrievalcited by 0
  33. 2026DiffRetriever: Parallel Representative Tokens for Retrieval with Diffusion Language Modelscited by 0
  34. 2026FaithMed: Training LLMs For Faithful Evidence-Based Medical Reasoningcited by 0
  35. 2026Disentangled Contrastive Learning for Zero-Shot Multilingual Dense Retrievalcited by 0