Large Language Models are Pattern Matchers: Editing Semi-Structured and Structured Documents with ChatGPT
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) offer numerous applications, the full extent of which is not yet understood. This paper investigates if LLMs can be applied for editing structured and semi-structured documents with minimal effort. Using a qualitative research approach, we conduct two case studies with ChatGPT and thoroughly analyze the results. Our experiments indicate that LLMs can effectively edit structured and semi-structured documents when provided with basic, straightforward prompts. ChatGPT demonstrates a strong ability to recognize and process the structure of annotated documents. This suggests that explicitly structuring tasks and data in prompts might enhance an LLM's ability to understand and solve tasks. Furthermore, the experiments also reveal impressive pattern matching skills in ChatGPT. This observation deserves further investigation, as it may contribute to understanding the processes leading to hallucinations in LLMs.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 12 Sep 2024.
Builds on
15 of 24 references.
References · 15
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2023Language is All a Graph Needscited by 219
- 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
- 2023Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakescited by 101
- 2019Coreference Resolution as Query-based Span Predictioncited by 91
- 2023Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineeringcited by 86
- 2024FOFO: A Benchmark to Evaluate LLMs' Format-Following Capabilitycited by 79
- 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
- 2023Tabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMscited by 49
3 more
- 2023Beyond the Chat: Executable and Verifiable Text-Editing with LLMscited by 35
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applicationscited by 17
- 2022Development of a multi-timescale method for classifying hybrid energy storage systems in grid applicationscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.