Bidirectional Attention Flow for Machine Comprehension
Not on the map. Why?
Abstract (arXiv)
Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query. Recently, attention mechanisms have been successfully extended to MC. Typically these methods use attention to focus on a small portion of the context and summarize it with a fixed-size vector, couple attentions temporally, and/or often form a uni-directional attention. In this paper we introduce the Bi-Directional Attention Flow (BIDAF) network, a multi-stage hierarchical process that represents the context at different levels of granularity and uses bi-directional attention flow mechanism to obtain a query-aware context representation without early summarization. Our experimental evaluations show that our model achieves the state-of-the-art results in Stanford Question Answering Dataset (SQuAD) and CNN/DailyMail cloze test.
Key facts. Cited by 278 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 109; 2022: 76; 2023: 47; 2024: 23; 2025: 14; 2026: 8.
278 papers.
Sort:
By area:
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
- 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 211
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2021Explaining Answers with Entailment Treescited by 152
- 2022Rich Knowledge Sources Bring Complex Knowledge Conflicts: Recalibrating Models to Reflect Conflicting Evidencecited by 144
- 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
- 2023Hierarchical Video-Moment Retrieval and Step-Captioningcited by 83
- 2022Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluationcited by 67
- 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
38 more
- 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
- 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
- 2021Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarkingcited by 53
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
- 2021Knowing More About Questions Can Help: Improving Calibration in Question Answeringcited by 47
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2021Can NLI Models Verify QA Systems' Predictions?cited by 46
- 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
- 2025Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMscited by 46
- 2021Coreference Resolution without Span Representationscited by 45
- 2022Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Videocited by 43
- 2022Neural Approaches to Conversational Information Retrievalcited by 42
- 2021Bidirectional Machine Reading Comprehension for Aspect Sentiment Triplet Extractioncited by 40
- 2021Why Machine Reading Comprehension Models Learn Shortcuts?cited by 40
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
- 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
- 2022On Transforming Reinforcement Learning by Transformer: The Development Trajectorycited by 36
- 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
- 2021Conversational Question Answering: A Surveycited by 31
- 2025Self Speculative Decoding for Diffusion Large Language Modelscited by 30
- 2021Self-supervised Dialogue Learning for Spoken Conversational Question Answeringcited by 28
- 2023A Review of Deep Learning for Video Captioningcited by 28
- 2023Pushing the Limits of ChatGPT on NLP Taskscited by 27
- 2022A Dataset for Medical Instructional Video Classification and Question Answeringcited by 26
- 2021NoiseQA: Challenge Set Evaluation for User-Centric Question Answeringcited by 25
- 2021A Short Survey of Pre-trained Language Models for Conversational AI-A NewAge in NLPcited by 25
- 2021Introspective Distillation for Robust Question Answeringcited by 25
- 2024Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluationcited by 25
- 2021Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Taskscited by 24
- 2022Video Activity Localisation with Uncertainties in Temporal Boundarycited by 24
- 2021Parallel Attention Network with Sequence Matching for Video Groundingcited by 22
- 2021Improving Unsupervised Question Answering via Summarization-Informed Question Generationcited by 21
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?cited by 20
- 2021Contrastive Domain Adaptation for Question Answering using Limited Text Corporacited by 20
- 2021Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformationcited by 19
- 2021Idiomatic Expression Identification using Semantic Compatibilitycited by 19
50 most cited of 278 All 278 (JSON)
- 2026From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding1 Sep 2026
- 2026Efficient Diffusion LLMs via Temporal-Spatial Parallel Decoding and Confidence Extrapolation29 May 2026
- 2026Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language28 May 2026
- 2026Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations25 May 2026
- 2026BiRD: A Bidirectional Ranking Defense Mechanism for Retrieval Augmented Generation19 May 2026
- 2026Post-training is (Massive) Supervised Learning20 Apr 2026
- 2026DTCRS: Dynamic Tree Construction for Recursive Summarization8 Apr 2026
- 2026Generalized Stock Price Prediction for Multiple Stocks Combined with News Fusion8 Mar 2026
- 2025Detecting Hallucinations in Graph Retrieval-Augmented Generation via Attention Patterns and Semantic Alignment9 Dec 2025
- 2025Metadata-Driven Retrieval-Augmented Generation for Financial Question Answering28 Oct 2025
- 2025Self Speculative Decoding for Diffusion Large Language Models5 Oct 2025
- 2025Dual-Scale World Models for LLM Agents Towards Hard-Exploration Problems28 Sep 2025
38 more
- 2025Your RAG is Unfair: Exposing Fairness Vulnerabilities in Retrieval-Augmented Generation via Backdoor Attacks26 Sep 2025
- 2025Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMs24 Jul 2025
- 2025MountainLion: A Multi-Modal LLM-Based Agent System for Interpretable and Adaptive Financial Trading13 Jul 2025
- 2025TeamCMU at Touch'e: Adversarial Co-Evolution for Advertisement Integration and Detection in Conversational Search1 Jul 2025
- 2025What Has Been Lost with Synthetic Evaluation?28 May 2025
- 2025Harnessing Structured Knowledge: A Concept Map-Based Approach for High-Quality Multiple Choice Question Generation with Effective Distractors2 May 2025
- 2025Enhanced Cross-modal 3D Retrieval via Tri-modal Reconstruction2 Apr 2025
- 2025Performance Analysis of Traditional VQA Models Under Limited Computational Resources9 Feb 2025
- 2025Hybrid Graphs for Table-and-Text based Question Answering using LLMs29 Jan 2025
- 2025GeAR: Generation Augmented Retrieval6 Jan 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Towards Operationalizing Right to Data Protection13 Nov 2024
- 2024Correct after Answer: Enhancing Multi-Span Question Answering with Post-Processing Method22 Oct 2024
- 2024Optimized Biomedical Question-Answering Services with LLM and Multi-BERT Integration11 Oct 2024
- 2024Exploring Language Model Generalization in Low-Resource Extractive QA27 Sep 2024
- 2024Bypassing DARCY Defense: Indistinguishable Universal Adversarial Triggers5 Sep 2024
- 2024OMoS-QA: A Dataset for Cross-Lingual Extractive Question Answering in a German Migration Context22 Jul 2024
- 2024Clinical Reading Comprehension with Encoder-Decoder Models Enhanced by Direct Preference Optimization19 Jul 2024
- 2024GenSco: Can Question Decomposition based Passage Alignment improve Question Answering?14 Jul 2024
- 2024Confidence Aware Inverse Constrained Reinforcement Learning24 Jun 2024
- 2024Improving Long Text Understanding with Knowledge Distilled from Summarization Model8 May 2024
- 2024Enhanced Textual Feature Extraction for Visual Question Answering: A Simple Convolutional Approach1 May 2024
- 2024KS-LLM: Knowledge Selection of Large Language Models with Evidence Document for Question Answering24 Apr 2024
- 2024MLP: Motion Label Prior for Temporal Sentence Localization in Untrimmed 3D Human Motions21 Apr 2024
- 2024The Death of Feature Engineering? BERT with Linguistic Features on SQuAD 2.04 Apr 2024
- 2024Span-Oriented Information Extraction -- A Unifying Perspective on Information Extraction18 Mar 2024
- 2024A Logical Pattern Memory Pre-trained Model for Entailment Tree Generation11 Mar 2024
- 2024Reinforcement Learning from Bagged Reward6 Feb 2024
- 2024Enhancing textual textbook question answering with large language models and retrieval augmented generation5 Feb 2024
- 2024Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation2 Feb 2024
- 2024Semantics of Multiword Expressions in Transformer-Based Models: A Survey27 Jan 2024
- 2024TCE at Qur'an QA 2023 Shared Task: Low Resource Enhanced Transformer-based Ensemble Approach for Qur'anic QA23 Jan 2024
- 2024Location Aware Modular Biencoder for Tourism Question Answering4 Jan 2024
- 2023ResNLS: An Improved Model for Stock Price Forecasting2 Dec 2023
- 2023The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP1 Dec 2023
- 2023Explainable Product Classification for Customs18 Nov 2023
- 2023Adapting Pre-trained Generative Models for Extractive Question Answering6 Nov 2023
- 2023Divide & Conquer for Entailment-aware Multi-hop Evidence Retrieval5 Nov 2023
50 newest of 278 All 278 (JSON)
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2024Enhancing textual textbook question answering with large language models and retrieval augmented generationcited by 14
- 2025Your RAG is Unfair: Exposing Fairness Vulnerabilities in Retrieval-Augmented Generation via Backdoor Attackscited by 8
- 2025Metadata-Driven Retrieval-Augmented Generation for Financial Question Answeringcited by 4
- 2026DTCRS: Dynamic Tree Construction for Recursive Summarizationcited by 4
- 2024GenSco: Can Question Decomposition based Passage Alignment improve Question Answering?cited by 3
- 2025TeamCMU at Touch'e: Adversarial Co-Evolution for Advertisement Integration and Detection in Conversational Searchcited by 1
- 2025Detecting Hallucinations in Graph Retrieval-Augmented Generation via Attention Patterns and Semantic Alignmentcited by 1
- 2026BiRD: A Bidirectional Ranking Defense Mechanism for Retrieval Augmented Generationcited by 0
- 2026BiRD: A Bidirectional Ranking Defense Mechanism for Retrieval Augmented Generation19 May 2026
- 2026DTCRS: Dynamic Tree Construction for Recursive Summarization8 Apr 2026
- 2025Detecting Hallucinations in Graph Retrieval-Augmented Generation via Attention Patterns and Semantic Alignment9 Dec 2025
- 2025Metadata-Driven Retrieval-Augmented Generation for Financial Question Answering28 Oct 2025
- 2025Your RAG is Unfair: Exposing Fairness Vulnerabilities in Retrieval-Augmented Generation via Backdoor Attacks26 Sep 2025
- 2025TeamCMU at Touch'e: Adversarial Co-Evolution for Advertisement Integration and Detection in Conversational Search1 Jul 2025
- 2024GenSco: Can Question Decomposition based Passage Alignment improve Question Answering?14 Jul 2024
- 2024Enhancing textual textbook question answering with large language models and retrieval augmented generation5 Feb 2024
- 2020REALM: Retrieval-Augmented Language Model Pre-Training10 Feb 2020
- 2022METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanationcited by 17
- 2022A Neural-Symbolic Approach to Natural Language Understandingcited by 8
- 2022Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoningcited by 8
- 2022Relevant CommonSense Subgraphs for "What if..." Procedural Reasoningcited by 2
- 2024Location Aware Modular Biencoder for Tourism Question Answeringcited by 2
- 2022Attention Mechanism based Cognition-level Scene Understandingcited by 0
- 2026Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representationscited by 0
- 2026Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations25 May 2026
- 2024Location Aware Modular Biencoder for Tourism Question Answering4 Jan 2024
- 2022METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation5 May 2022
- 2022Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning2 May 2022
- 2022Attention Mechanism based Cognition-level Scene Understanding17 Apr 2022
- 2022Relevant CommonSense Subgraphs for "What if..." Procedural Reasoning21 Mar 2022
- 2022A Neural-Symbolic Approach to Natural Language Understanding20 Mar 2022
- 2024Reinforcement Learning from Bagged Rewardcited by 0
- 2024Reinforcement Learning from Bagged Reward6 Feb 2024
- 2022Mixture of Experts for Biomedical Question Answeringcited by 6
- 2022Mixture of Experts for Biomedical Question Answering15 Apr 2022
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
- 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 211
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2021Explaining Answers with Entailment Treescited by 152
- 2022Rich Knowledge Sources Bring Complex Knowledge Conflicts: Recalibrating Models to Reflect Conflicting Evidencecited by 144
- 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
- 2023Hierarchical Video-Moment Retrieval and Step-Captioningcited by 83
- 2022Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluationcited by 67
- 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
- 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
- 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
12 most cited of 253 All 253 (JSON)
- 2026Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language28 May 2026
- 2026Post-training is (Massive) Supervised Learning20 Apr 2026
- 2026Generalized Stock Price Prediction for Multiple Stocks Combined with News Fusion8 Mar 2026
- 2025Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMs24 Jul 2025
- 2025What Has Been Lost with Synthetic Evaluation?28 May 2025
- 2025Harnessing Structured Knowledge: A Concept Map-Based Approach for High-Quality Multiple Choice Question Generation with Effective Distractors2 May 2025
- 2025Enhanced Cross-modal 3D Retrieval via Tri-modal Reconstruction2 Apr 2025
- 2025Performance Analysis of Traditional VQA Models Under Limited Computational Resources9 Feb 2025
- 2025Hybrid Graphs for Table-and-Text based Question Answering using LLMs29 Jan 2025
- 2025GeAR: Generation Augmented Retrieval6 Jan 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Towards Operationalizing Right to Data Protection13 Nov 2024
12 newest of 253 All 253 (JSON)