ComQA:Compositional Question Answering via Hierarchical Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
With the development of deep learning techniques and large scale datasets, the question answering (QA) systems have been quickly improved, providing more accurate and satisfying answers. However, current QA systems either focus on the sentence-level answer, i.e., answer selection, or phrase-level answer, i.e., machine reading comprehension. How to produce compositional answers has not been throughout investigated. In compositional question answering, the systems should assemble several supporting evidence from the document to generate the final answer, which is more difficult than sentence-level or phrase-level QA. In this paper, we present a large-scale compositional question answering dataset containing more than 120k human-labeled questions. The answer in this dataset is composed of discontiguous sentences in the corresponding document. To tackle the ComQA problem, we proposed a hierarchical graph neural networks, which represents the document from the low-level word to the high-level sentence. We also devise a question selection and node selection task for pre-training. Our proposed model achieves a significant improvement over previous machine reading comprehension methods and pre-training methods. Codes and dataset can be found at urlhttps://github.com/benywon/ComQA.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 35 of its 64 references that are in the map. First posted on arXiv 16 Jan 2021.
Builds on
35 of 64 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2016Layer Normalizationcited by 5,669
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
23 more
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2015Teaching Machines to Read and Comprehendcited by 1,049
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 903
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
- 2017Representation Learning on Graphs: Methods and Applicationscited by 457
- 2020Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamicscited by 425
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 225
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2017Constructing Datasets for Multi-hop Reading Comprehension Across Documentscited by 190
- 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
- 2017Quasar: Datasets for Question Answering by Search and Readingcited by 50
- 2020A Survey on Machine Reading Comprehension Systemscited by 41
- 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
- 2017FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehensioncited by 22
- 2020Multi-span Style Extraction for Generative Reading Comprehensioncited by 7
- 2020Composing Answer from Multi-spans for Reading Comprehensioncited by 1
Built on by
Citing papers per year: 2022: 3; 2023: 1.
4 papers.
- 2022ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal Understandingcited by 3
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metricscited by 1
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approachescited by 1
- 2023Intent-calibrated Self-training for Answer Selection in Open-domain Dialoguescited by 1
- 2023Intent-calibrated Self-training for Answer Selection in Open-domain Dialogues13 Jul 2023
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metrics8 Dec 2022
- 2022ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal Understanding5 Aug 2022