End-to-End Open-Domain Question Answering with BERTserini
Not on the map. Why?
Abstract (arXiv)
We demonstrate an end-to-end question answering system that integrates BERT with the open-source Anserini information retrieval toolkit. In contrast to most question answering and reading comprehension models today, which operate over small amounts of input text, our system integrates best practices from IR with a BERT-based reader to identify answers from a large corpus of Wikipedia articles in an end-to-end fashion. We report large improvements over previous results on a standard benchmark test collection, showing that fine-tuning pretrained BERT with SQuAD is sufficient to achieve high accuracy in identifying answer spans.
Key facts. Cited by 152 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 47; 2022: 44; 2023: 33; 2024: 16; 2025: 10; 2026: 2.
152 papers.
Sort:
By area:
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 805
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2023CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Servingcited by 199
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2021Simple Entity-Centric Questions Challenge Dense Retrieverscited by 140
- 2022REVEAL: Retrieval-Augmented Visual-Language Pre-Training with Multi-Source Multimodal Knowledge Memorycited by 122
- 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 96
- 2021TopiOCQA: Open-domain Conversational Question Answering with Topic Switchingcited by 95
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
38 more
- 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answeringcited by 66
- 2022Recitation-Augmented Language Modelscited by 65
- 2023Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformerscited by 59
- 2022THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryptioncited by 55
- 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 53
- 2022QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphscited by 42
- 2023The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Mattercited by 42
- 2021Attacking Open-domain Question Answering by Injecting Misinformationcited by 41
- 2021A Replication Study of Dense Passage Retrievercited by 37
- 2021TWEAC: Transformer with Extendable QA Agent Classifierscited by 37
- 2021R2-D2: A Modular Baseline for Open-Domain Question Answeringcited by 37
- 2023Augmented Large Language Models with Parametric Knowledge Guidingcited by 37
- 2021Scaling Federated Learning for Fine-tuning of Large Language Modelscited by 36
- 2022An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP Taskscited by 36
- 2023Evaluating Open-QA Evaluationcited by 35
- 2021Phrase Retrieval Learns Passage Retrieval, Toocited by 33
- 2021Challenges in Generalization in Open Domain Question Answeringcited by 30
- 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collectionscited by 30
- 2021Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrievalcited by 27
- 2023Large Language Models are Built-in Autoregressive Search Enginescited by 26
- 2021NoiseQA: Challenge Set Evaluation for User-Centric Question Answeringcited by 25
- 2021Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answeringcited by 25
- 2022Using Interactive Feedback to Improve the Accuracy and Explainability of Question Answering Systems Post-Deploymentcited by 25
- 2023IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositionscited by 25
- 2021Geographic Question Answering: Challenges, Uniqueness, Classification, and Future Directionscited by 24
- 2023Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attributioncited by 24
- 2022Grape: Knowledge Graph Enhanced Passage Reader for Open-domain Question Answeringcited by 22
- 2023Exploring New Frontiers in Agricultural NLP: Investigating the Potential of Large Language Models for Food Applicationscited by 21
- 2021Think about it! Improving defeasible reasoning by first modeling the question scenariocited by 20
- 2022Improving Biomedical Information Retrieval with Neural Retrieverscited by 20
- 2022Question Generation for Reading Comprehension Assessment by Modeling How and What to Askcited by 20
- 2022A Survey for Efficient Open Domain Question Answeringcited by 20
- 2023Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Modelscited by 20
- 2021Will this Question be Answered? Question Filtering via Answer Model Distillation for Efficient Question Answeringcited by 19
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
- 2021Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matricescited by 17
- 2021You Only Need One Model for Open-domain Question Answeringcited by 17
- 2022Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQAcited by 17
50 most cited of 152 All 152 (JSON)
- 2026Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 202625 Jun 2026
- 2026Multilingual Reference Need Assessment System for Wikipedia17 Mar 2026
- 2025End-to-End On-Device Quantization-Aware Training for LLMs at Inference Cost21 Aug 2025
- 2025Improving QA Efficiency with DistilBERT: Fine-Tuning and Inference on mobile Intel CPUs28 May 2025
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
- 2025OnRL-RAG: Real-Time Personalized Mental Health Dialogue System2 Apr 2025
- 2025Evaluating Answer Reranking Strategies in Time-sensitive Question Answering6 Mar 2025
- 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questions28 Feb 2025
- 2025When Continue Learning Meets Multimodal Large Language Model: A Survey27 Feb 2025
- 2025Mixture of Structural-and-Textual Retrieval over Text-rich Graph Knowledge Bases27 Feb 2025
- 2025Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning5 Feb 2025
- 2025SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models2 Feb 2025
38 more
- 2024Enhancing ID-based Recommendation with Large Language Models4 Nov 2024
- 2024BanglaQuAD: A Bengali Open-domain Question Answering Dataset14 Oct 2024
- 2024From N-grams to Pre-trained Multilingual Models For Language Identification11 Oct 2024
- 2024Local Explanations and Self-Explanations for Assessing Faithfulness in black-box LLMs18 Sep 2024
- 2024R2GQA: Retriever-Reader-Generator Question Answering System to Support Students Understanding Legal Regulations in Higher Education4 Sep 2024
- 2024All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networks20 Jul 2024
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Survey1 Jul 2024
- 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases19 Apr 2024
- 2024KazQAD: Kazakh Open-Domain Question Answering Dataset6 Apr 2024
- 2024Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users27 Mar 2024
- 2024Guided Distant Supervision for Multilingual Relation Extraction Data: Adapting to a New Language25 Mar 2024
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey21 Mar 2024
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity21 Mar 2024
- 2024TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale15 Mar 2024
- 2024SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering24 Jan 2024
- 2024Fine-tuning Strategies for Domain Specific Question Answering under Low Annotation Budget Constraints17 Jan 2024
- 2023dIR -- Discrete Information Retrieval: Conversational Search over Unstructured (and Structured) Data with Large Language Models20 Dec 2023
- 2023Benchmarking and Analyzing In-context Learning, Fine-tuning and Supervised Learning for Biomedical Knowledge Curation: a focused study on chemical entities of biological interest20 Dec 2023
- 2023Relevance Feedback with Brain Signals9 Dec 2023
- 2023Large Language Models on Graphs: A Comprehensive Survey5 Dec 2023
- 2023Axiomatic Preference Modeling for Longform Question Answering2 Dec 2023
- 2023SUQL: Conversational Search over Structured and Unstructured Data with Large Language Models16 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023Data-Augmented and Retrieval-Augmented Context Enrichment in Chinese Media Bias Detection2 Nov 2023
- 2023Strong and Efficient Baselines for Open Domain Conversational Question Answering23 Oct 2023
- 2023Progressive Evidence Refinement for Open-domain Multimodal Retrieval Question Answering15 Oct 2023
- 2023CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving11 Oct 2023
- 2023Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution9 Oct 2023
- 2023MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question Answering8 Oct 2023
- 2023Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers25 Aug 2023
- 2023Differentiable Retrieval Augmentation via Generative Language Modeling for E-commerce Query Intent Classification18 Aug 2023
- 2023Performance Prediction for Multi-hop Questions12 Aug 2023
- 2023Question Answering with Deep Neural Networks for Semi-Structured Heterogeneous Genealogical Knowledge Graphs30 Jul 2023
- 2023Generator-Retriever-Generator Approach for Open-Domain Question Answering21 Jul 2023
- 2023An In-Depth Evaluation of Federated Learning on Biomedical Natural Language Processing20 Jul 2023
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models24 Jun 2023
- 2023Exploring New Frontiers in Agricultural NLP: Investigating the Potential of Large Language Models for Food Applications20 Jun 2023
- 2023Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models18 Jun 2023
50 newest of 152 All 152 (JSON)
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2022An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP Taskscited by 36
- 2023Data-Augmented and Retrieval-Augmented Context Enrichment in Chinese Media Bias Detectioncited by 2
- 2025OnRL-RAG: Real-Time Personalized Mental Health Dialogue Systemcited by 1
- 2025OnRL-RAG: Real-Time Personalized Mental Health Dialogue System2 Apr 2025
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity21 Mar 2024
- 2023Data-Augmented and Retrieval-Augmented Context Enrichment in Chinese Media Bias Detection2 Nov 2023
- 2022An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP Tasks30 Oct 2022
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2021Simple Entity-Centric Questions Challenge Dense Retrieverscited by 140
- 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 96
- 2021TopiOCQA: Open-domain Conversational Question Answering with Topic Switchingcited by 95
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answeringcited by 66
- 2022Recitation-Augmented Language Modelscited by 65
- 2022THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryptioncited by 55
- 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 53
12 most cited of 142 All 142 (JSON)
- 2026Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 202625 Jun 2026
- 2026Multilingual Reference Need Assessment System for Wikipedia17 Mar 2026
- 2025End-to-End On-Device Quantization-Aware Training for LLMs at Inference Cost21 Aug 2025
- 2025Improving QA Efficiency with DistilBERT: Fine-Tuning and Inference on mobile Intel CPUs28 May 2025
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
- 2025Evaluating Answer Reranking Strategies in Time-sensitive Question Answering6 Mar 2025
- 2025TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questions28 Feb 2025
- 2025Mixture of Structural-and-Textual Retrieval over Text-rich Graph Knowledge Bases27 Feb 2025
- 2025Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning5 Feb 2025
- 2025SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models2 Feb 2025
- 2024Enhancing ID-based Recommendation with Large Language Models4 Nov 2024
- 2024BanglaQuAD: A Bengali Open-domain Question Answering Dataset14 Oct 2024
12 newest of 142 All 142 (JSON)