Using Local Knowledge Graph Construction to Scale Seq2Seq Models to Multi-Document Inputs
Not on the map. Why?
Abstract (arXiv)
Query-based open-domain NLP tasks require information synthesis from long and diverse web results. Current approaches extractively select portions of web text as input to Sequence-to-Sequence models using methods such as TF-IDF ranking. We propose constructing a local graph structured knowledge base for each query, which compresses the web search information and reduces redundancy. We show that by linearizing the graph into a structured input sequence, models can encode the graph representations within a standard Sequence-to-Sequence setting. For two generative tasks with very long text input, long-form question answering and multi-document summarization, feeding graph representations as input can achieve better performance than using retrieved text portions.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 14; 2023: 9; 2024: 5; 2025: 2.
38 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 85
- 2022FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representationscited by 41
- 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledgecited by 40
- 2021Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphscited by 36
- 2021Not All Memories are Created Equal: Learning to Forget by Expiringcited by 32
- 2021Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewritingcited by 30
- 2021BASS: Boosting Abstractive Summarization with Unified Semantic Graphcited by 21
- 2023Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operatorcited by 20
26 more
- 2022Knowledge Infused Decodingcited by 12
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semanticscited by 12
- 2021Modeling Worlds in Textcited by 11
- 2022Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphscited by 11
- 2022DetIE: Multilingual Open Information Extraction Inspired by Object Detectioncited by 11
- 2021DocOIE: A Document-level Context-Aware Dataset for OpenIEcited by 10
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2024Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applicationscited by 10
- 2022What Makes Data-to-Text Generation Hard for Pretrained Language Models?cited by 8
- 2022Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographiescited by 7
- 2022CompactIE: Compact Facts in Open Information Extractioncited by 5
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generationcited by 5
- 2023Shaping Political Discourse using multi-source News Summarizationcited by 5
- 2022Descartes: Generating Short Descriptions of Wikipedia Articlescited by 4
- 2023Leveraging Open Information Extraction for More Robust Domain Transfer of Event Trigger Detectioncited by 4
- 2023Syntactically Robust Training on Partially-Observed Data for Open Information Extractioncited by 3
- 2021MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarizationcited by 2
- 2022Knowledge-aware Document Summarization: A Survey of Knowledge, Embedding Methods and Architecturescited by 2
- 2022Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robustcited by 2
- 2024Rematch: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic Similaritycited by 1
- 2022Towards Generalized Open Information Extractioncited by 0
- 2023Shall We Trust All Relational Tuples by Open Information Extraction? A Study on Speculation Detectioncited by 0
- 2024A Second Look on BASS -- Boosting Abstractive Summarization with Unified Semantic Graphs -- A Replication Studycited by 0
- 2024Enterprise Use Cases Combining Knowledge Graphs and Natural Language Processingcited by 0
- 2024Probing Omissions and Distortions in Transformer-based RDF-to-Text Modelscited by 0
- 2025FuDoBa: Fusing Document and Knowledge Graph-based Representations with Bayesian Optimisationcited by 0
- 2025FuDoBa: Fusing Document and Knowledge Graph-based Representations with Bayesian Optimisation9 Jul 2025
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models21 Jan 2025
- 2024Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applications27 Sep 2024
- 2024Probing Omissions and Distortions in Transformer-based RDF-to-Text Models25 Sep 2024
- 2024Rematch: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic Similarity2 Apr 2024
- 2024Enterprise Use Cases Combining Knowledge Graphs and Natural Language Processing1 Apr 2024
- 2024A Second Look on BASS -- Boosting Abstractive Summarization with Unified Semantic Graphs -- A Replication Study5 Mar 2024
- 2023Shaping Political Discourse using multi-source News Summarization18 Dec 2023
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation28 Oct 2023
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment10 Aug 2023
- 2023Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator24 May 2023
- 2023Leveraging Open Information Extraction for More Robust Domain Transfer of Event Trigger Detection23 May 2023
26 more
- 2023Shall We Trust All Relational Tuples by Open Information Extraction? A Study on Speculation Detection7 May 2023
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligence13 Apr 2023
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2023Syntactically Robust Training on Partially-Observed Data for Open Information Extraction17 Jan 2023
- 2022Towards Generalized Open Information Extraction29 Nov 2022
- 2022Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robust6 Nov 2022
- 2022Innovations in Neural Data-to-text Generation: A Survey25 Jul 2022
- 2022DetIE: Multilingual Open Information Extraction Inspired by Object Detection24 Jun 2022
- 2022Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphs15 Jun 2022
- 2022What Makes Data-to-Text Generation Hard for Pretrained Language Models?23 May 2022
- 2022QASem Parsing: Text-to-text Modeling of QA-based Semantics23 May 2022
- 2022Descartes: Generating Short Descriptions of Wikipedia Articles20 May 2022
- 2022CompactIE: Compact Facts in Open Information Extraction5 May 2022
- 2022Knowledge-aware Document Summarization: A Survey of Knowledge, Embedding Methods and Architectures24 Apr 2022
- 2022FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations13 Apr 2022
- 2022Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies12 Apr 2022
- 2022Knowledge Infused Decoding6 Apr 2022
- 2022Survey of Hallucination in Natural Language Generation8 Feb 2022
- 2021MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization22 Sep 2021
- 2021Modeling Worlds in Text17 Jun 2021
- 2021BASS: Boosting Abstractive Summarization with Unified Semantic Graph25 May 2021
- 2021Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting25 May 2021
- 2021Not All Memories are Created Equal: Learning to Forget by Expiring13 May 2021
- 2021DocOIE: A Document-level Context-Aware Dataset for OpenIE10 May 2021
- 2021Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs16 Apr 2021
- 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledge14 Apr 2021
- 2021Modeling Worlds in Textcited by 11
- 2021Modeling Worlds in Text17 Jun 2021
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 85
- 2022FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representationscited by 41
- 2021Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledgecited by 40
- 2021Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphscited by 36
- 2021Not All Memories are Created Equal: Learning to Forget by Expiringcited by 32
- 2021Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewritingcited by 30
- 2021BASS: Boosting Abstractive Summarization with Unified Semantic Graphcited by 21
- 2023Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operatorcited by 20
- 2022Knowledge Infused Decodingcited by 12
12 most cited of 36 All 36 (JSON)
- 2025FuDoBa: Fusing Document and Knowledge Graph-based Representations with Bayesian Optimisation9 Jul 2025
- 2024Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applications27 Sep 2024
- 2024Probing Omissions and Distortions in Transformer-based RDF-to-Text Models25 Sep 2024
- 2024Rematch: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic Similarity2 Apr 2024
- 2024Enterprise Use Cases Combining Knowledge Graphs and Natural Language Processing1 Apr 2024
- 2024A Second Look on BASS -- Boosting Abstractive Summarization with Unified Semantic Graphs -- A Replication Study5 Mar 2024
- 2023Shaping Political Discourse using multi-source News Summarization18 Dec 2023
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation28 Oct 2023
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment10 Aug 2023
- 2023Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator24 May 2023
- 2023Leveraging Open Information Extraction for More Robust Domain Transfer of Event Trigger Detection23 May 2023
- 2023Shall We Trust All Relational Tuples by Open Information Extraction? A Study on Speculation Detection7 May 2023
12 newest of 36 All 36 (JSON)