Document Automation Architectures: Updated Survey in Light of Large Language Models
Not on the map. Why?
Abstract (arXiv)
This paper surveys the current state of the art in document automation (DA). The objective of DA is to reduce the manual effort during the generation of documents by automatically creating and integrating input from different sources and assembling documents conforming to defined templates. There have been reviews of commercial solutions of DA, particularly in the legal domain, but to date there has been no comprehensive review of the academic research on DA architectures and technologies. The current survey of DA reviews the academic literature and provides a clearer definition and characterization of DA and its features, identifies state-of-the-art DA architectures and technologies in academic research, and provides ideas that can lead to new research opportunities within the DA field in light of recent advances in generative AI and large language models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 131 references that are in the map. First posted on arXiv 18 Aug 2023.
Builds on
24 of 131 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
- 2017Challenges in Data-to-Document Generationcited by 226
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 176
12 more
- 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
- 2021Pretrained Language Models for Text Generation: A Surveycited by 95
- 2019Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challengecited by 86
- 2023Structured prompt interrogation and recursive extraction of semantics (SPIRES): A method for populating knowledge bases using zero-shot learningcited by 50
- 2020GPT-too: A language-model-first approach for AMR-to-text generationcited by 38
- 2021Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Modelscited by 29
- 2016Sequence-to-Sequence Generation for Spoken Dialogue via Deep Syntax Trees and Stringscited by 27
- 2016Context-aware Natural Language Generation with Recurrent Neural Networkscited by 8
- 2022OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialoguecited by 4
- 2020Tax Knowledge Graph for a Smarter and More Personalized TurboTaxcited by 3
- 2021Document Automation Architectures and Technologies: A Surveycited by 3
- 2015Generative Concatenative Nets Jointly Learn to Write and Classify Reviewscited by 2
Built on by
Citing papers per year: 2024: 1.
1 paper.