Gated-Attention Readers for Text Comprehension
Not on the map. Why?
Abstract (arXiv)
In this paper we study the problem of answering cloze-style questions over documents. Our model, the Gated-Attention (GA) Reader, integrates a multi-hop architecture with a novel attention mechanism, which is based on multiplicative interactions between the query embedding and the intermediate states of a recurrent neural network document reader. This enables the reader to build query-specific representations of tokens in the document for accurate answer selection. The GA Reader obtains state-of-the-art results on three benchmarks for this task--the CNN & Daily Mail news stories and the Who Did What dataset. The effectiveness of multiplicative interaction is demonstrated by an ablation study, and by comparing to alternative compositional operators for implementing the gated-attention. The code is available at https://github.com/bdhingra/ga-reader.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 7; 2023: 1; 2024: 3; 2025: 4; 2026: 3.
37 papers.
Sort:
By area:
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2021Dynamic Language Models for Continuously Evolving Contentcited by 27
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?cited by 20
- 2022Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoningcited by 8
- 2021A Survey on Natural Language Video Localizationcited by 6
- 2025DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidancecited by 6
- 2021Dual Slot Selector via Local Reliability Verification for Dialogue State Trackingcited by 5
- 2021Multilingual Multi-Aspect Explainability Analyses on Machine Reading Comprehension Modelscited by 5
- 2024VideoDistill: Language-aware Vision Distillation for Video Question Answeringcited by 5
- 2021ExpMRC: Explainability Evaluation for Machine Reading Comprehensioncited by 4
- 2021Fact-driven Logical Reasoning for Machine Reading Comprehensioncited by 4
25 more
- 2021FinGAT: Financial Graph Attention Networks for Recommending Top-K Profitable Stockscited by 4
- 2024It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehensioncited by 4
- 2021SemEval-2021 Task 4: Reading Comprehension of Abstract Meaningcited by 3
- 2021Letter-level Online Writer Identificationcited by 3
- 2025GreenMind: A Next-Generation Vietnamese Large Language Model for Structured and Logical Reasoningcited by 3
- 2022FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertaintycited by 2
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
- 2022To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learningcited by 2
- 2024Span-Oriented Information Extraction -- A Unifying Perspective on Information Extractioncited by 2
- 2021LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Votingcited by 1
- 2021XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaningcited by 1
- 2021Audio-Oriented Multimodal Machine Comprehension: Task, Dataset and Modelcited by 1
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metricscited by 1
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approachescited by 1
- 2023Graph Attention with Hierarchies for Multi-hop Question Answeringcited by 1
- 2021Orthogonal Attention: A Cloze-Style Approach to Negation Scope Resolutioncited by 0
- 2021ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Predictioncited by 0
- 2021Automatic Task Requirements Writing Evaluation via Machine Reading Comprehensioncited by 0
- 2021Sequential Attention Module for Natural Language Processingcited by 0
- 2022elBERto: Self-supervised Commonsense Learning for Question Answeringcited by 0
- 2025LLM-Assisted Question-Answering on Technical Documents Using Structured Data-Aware Retrieval Augmented Generationcited by 0
- 2025A Novel Graph-Sequence Learning Model for Inductive Text Classificationcited by 0
- 2026LLMs Struggle with Abstract Meaning Comprehension More Than Expectedcited by 0
- 2026Warranted Attention: Learning What to Pass from Attention to Predictioncited by 0
- 2026Gated Q-learning: Add Off-Policy Bias to Tastecited by 0
- 2026Gated Q-learning: Add Off-Policy Bias to Taste31 Jul 2026
- 2026Warranted Attention: Learning What to Pass from Attention to Prediction29 Jun 2026
- 2026LLMs Struggle with Abstract Meaning Comprehension More Than Expected13 Apr 2026
- 2025A Novel Graph-Sequence Learning Model for Inductive Text Classification23 Dec 2025
- 2025LLM-Assisted Question-Answering on Technical Documents Using Structured Data-Aware Retrieval Augmented Generation29 Jun 2025
- 2025GreenMind: A Next-Generation Vietnamese Large Language Model for Structured and Logical Reasoning23 Apr 2025
- 2025DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidance5 Mar 2025
- 2024It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension24 Jun 2024
- 2024VideoDistill: Language-aware Vision Distillation for Video Question Answering1 Apr 2024
- 2024Span-Oriented Information Extraction -- A Unifying Perspective on Information Extraction18 Mar 2024
- 2023Graph Attention with Hierarchies for Multi-hop Question Answering27 Jan 2023
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
25 more
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metrics8 Dec 2022
- 2022To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning2 Aug 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2022Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning2 May 2022
- 2022FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertainty4 Apr 2022
- 2022elBERto: Self-supervised Commonsense Learning for Question Answering17 Mar 2022
- 2021Letter-level Online Writer Identification6 Dec 2021
- 2021Sequential Attention Module for Natural Language Processing7 Sep 2021
- 2021Multilingual Multi-Aspect Explainability Analyses on Machine Reading Comprehension Models26 Aug 2021
- 2021Dual Slot Selector via Local Reliability Verification for Dialogue State Tracking27 Jul 2021
- 2021Automatic Task Requirements Writing Evaluation via Machine Reading Comprehension15 Jul 2021
- 2021Audio-Oriented Multimodal Machine Comprehension: Task, Dataset and Model4 Jul 2021
- 2021FinGAT: Financial Graph Attention Networks for Recommending Top-K Profitable Stocks18 Jun 2021
- 2021Dynamic Language Models for Continuously Evolving Content11 Jun 2021
- 2021SemEval-2021 Task 4: Reading Comprehension of Abstract Meaning31 May 2021
- 2021Fact-driven Logical Reasoning for Machine Reading Comprehension21 May 2021
- 2021ExpMRC: Explainability Evaluation for Machine Reading Comprehension10 May 2021
- 2021ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction4 Apr 2021
- 2021A Survey on Natural Language Video Localization1 Apr 2021
- 2021Attention, please! A survey of Neural Attention Models in Deep Learning31 Mar 2021
- 2021XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning30 Mar 2021
- 2021Orthogonal Attention: A Cloze-Style Approach to Negation Scope Resolution7 Mar 2021
- 2021LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Voting24 Feb 2021
- 2021Biomedical Question Answering: A Survey of Approaches and Challenges10 Feb 2021
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?1 Feb 2021
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2021Dynamic Language Models for Continuously Evolving Contentcited by 27
- 2021Do Question Answering Modeling Improvements Hold Across Benchmarks?cited by 20
- 2021A Survey on Natural Language Video Localizationcited by 6
- 2021Dual Slot Selector via Local Reliability Verification for Dialogue State Trackingcited by 5
- 2021Multilingual Multi-Aspect Explainability Analyses on Machine Reading Comprehension Modelscited by 5
- 2024VideoDistill: Language-aware Vision Distillation for Video Question Answeringcited by 5
- 2021ExpMRC: Explainability Evaluation for Machine Reading Comprehensioncited by 4
- 2021Fact-driven Logical Reasoning for Machine Reading Comprehensioncited by 4
- 2021FinGAT: Financial Graph Attention Networks for Recommending Top-K Profitable Stockscited by 4
- 2024It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehensioncited by 4
12 most cited of 32 All 32 (JSON)
- 2026Gated Q-learning: Add Off-Policy Bias to Taste31 Jul 2026
- 2026Warranted Attention: Learning What to Pass from Attention to Prediction29 Jun 2026
- 2026LLMs Struggle with Abstract Meaning Comprehension More Than Expected13 Apr 2026
- 2025A Novel Graph-Sequence Learning Model for Inductive Text Classification23 Dec 2025
- 2024It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension24 Jun 2024
- 2024VideoDistill: Language-aware Vision Distillation for Video Question Answering1 Apr 2024
- 2024Span-Oriented Information Extraction -- A Unifying Perspective on Information Extraction18 Mar 2024
- 2023Graph Attention with Hierarchies for Multi-hop Question Answering27 Jan 2023
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metrics8 Dec 2022
- 2022To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning2 Aug 2022
- 2022FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertainty4 Apr 2022
12 newest of 32 All 32 (JSON)