Question Answering with Deep Neural Networks for Semi-Structured Heterogeneous Genealogical Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
With the rising popularity of user-generated genealogical family trees, new genealogical information systems have been developed. State-of-the-art natural question answering algorithms use deep neural network (DNN) architecture based on self-attention networks. However, some of these models use sequence-based inputs and are not suitable to work with graph-based structure, while graph-based DNN models rely on high levels of comprehensiveness of knowledge graphs that is nonexistent in the genealogical domain. Moreover, these supervised DNN models require training datasets that are absent in the genealogical domain. This study proposes an end-to-end approach for question answering using genealogical family trees by: 1) representing genealogical data as knowledge graphs, 2) converting them to texts, 3) combining them with unstructured texts, and 4) training a trans-former-based question answering model. To evaluate the need for a dedicated approach, a comparison between the fine-tuned model (Uncle-BERT) trained on the auto-generated genealogical dataset and state-of-the-art question-answering models was per-formed. The findings indicate that there are significant differences between answering genealogical questions and open-domain questions. Moreover, the proposed methodology reduces complexity while increasing accuracy and may have practical implications for genealogical research and real-world projects, making genealogical data accessible to experts as well as the general public.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 51 of its 147 references that are in the map. First posted on arXiv 30 Jul 2023.
Builds on
51 of 147 references.
References · 51
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2018Deep contextualized word representationscited by 2,290
38 more
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2020Reformer: The Efficient Transformercited by 1,668
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2017Graph Embedding Techniques, Applications, and Performance: A Surveycited by 188
- 2017Learning to Ask: Neural Question Generation for Reading Comprehensioncited by 186
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
- 2019Hierarchical Graph Network for Multi-hop Question Answeringcited by 83
- 2020Message Passing for Hyper-Relational Knowledge Graphscited by 79
- 2019TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selectioncited by 74
- 2018Improving Question Answering by Commonsense-Based Pre-Trainingcited by 66
- 2014Question Answering with Subgraph Embeddingscited by 58
- 2018A Graph-to-Sequence Model for AMR-to-Text Generationcited by 56
- 2017Table-to-text Generation by Structure-aware Seq2seq Learningcited by 54
- 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
- 2016Dynamic Coattention Networks For Question Answeringcited by 49
- 2019KBQA: Learning Question Answering over QA Corpora and Knowledge Basescited by 44
- 2019Multi-Hop Paragraph Retrieval for Open-Domain Question Answeringcited by 34
- 2020RECON: Relation Extraction using Knowledge Graph Context in a Graph Neural Networkcited by 28
- 2019Integrating Graph Contextualized Knowledge into Pre-trained Language Modelscited by 26
- 2020Toward Subgraph-Guided Knowledge Graph Question Generation with Graph Neural Networkscited by 25
- 2020Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Modelscited by 23
- 2017Order-Planning Neural Text Generation From Structured Datacited by 20
- 2019Evaluating Rewards for Question Generation Modelscited by 15
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2021KGPool: Dynamic Knowledge Graph Context Selection for Relation Extractioncited by 12
- 2019A Gated Self-attention Memory Network for Answer Selectioncited by 11
- 2019Connecting Language and Knowledge with Heterogeneous Representations for Neural Relation Extractioncited by 9
- 2020NABU - Multilingual Graph-based Neural RDF Verbalizercited by 5
- 2021Toward the Optimized Crowdsourcing Strategy for OCR Post-Correctioncited by 5
- 2016Multi-Perspective Context Matching for Machine Comprehensioncited by 2
- 2020Asking Complex Questions with Multi-hop Answer-focused Reasoningcited by 2
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.