mlsanityData to 14 Oct 2026

Text Data Integration

arXiv 2603.27055 ↗First posted 28 Mar 2026cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Data comes in many forms. From a shallow perspective, they can be viewed as being either in structured (e.g., as a relation, as key-value pairs) or unstructured (e.g., text, image) formats. So far, machines have been fairly good at processing and reasoning over structured data that follows a precise schema. However, the heterogeneity of data poses a significant challenge on how well diverse categories of data can be meaningfully stored and processed. Data Integration, a crucial part of the data engineering pipeline, addresses this by combining disparate data sources and providing unified data access to end-users. Until now, most data integration systems have leaned on only combining structured data sources. Nevertheless, unstructured data (a.k.a. free text) also contains a plethora of knowledge waiting to be utilized. Thus, in this chapter, we firstly make the case for the integration of textual data, to later present its challenges, state of the art and open problems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 195 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

37 of 195 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  6. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  7. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  8. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  9. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  10. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  11. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  12. 2020Knowledge Graphscited by 621
25 more
  1. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
  2. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 398
  3. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
  4. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
  5. 2023How is ChatGPT's behavior changing over time?cited by 270
  6. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 262
  7. 2023A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimationcited by 109
  8. 2022Decentralized Training of Foundation Models in Heterogeneous Environmentscited by 87
  9. 2020Automated Concatenation of Embeddings for Structured Predictioncited by 86
  10. 2017HoloClean: Holistic Data Repairs with Probabilistic Inferencecited by 79
  11. 2019OpenNRE: An Open and Extensible Toolkit for Neural Relation Extractioncited by 62
  12. 2019Enhancing Clinical Concept Extraction with Contextual Embeddingscited by 48
  13. 2023Enhancing Knowledge Graph Construction Using Large Language Modelscited by 44
  14. 2021Learning from Noisy Labels for Entity-Centric Information Extractioncited by 34
  15. 2017SwellShark: A Generative Model for Biomedical Named Entity Recognition without Labeled Datacited by 28
  16. 2021Robust Retrieval Augmented Generation for Zero-shot Slot Fillingcited by 24
  17. 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 23
  18. 2017Hierarchical Embeddings for Hypernymy Detection and Directionalitycited by 19
  19. 2020Contextualized Embeddings in Named-Entity Recognition: An Empirical Study on Generalizationcited by 15
  20. 2022KnowGL: Knowledge Generation and Linking from Textcited by 13
  21. 2022What Makes Data-to-Text Generation Hard for Pretrained Language Models?cited by 8
  22. 2020Graph integration of structured, semistructured and unstructured data for data journalismcited by 5
  23. 2020Statistical Data Integration in Survey Sampling: A Reviewcited by 2
  24. 2020Extracting Semantic Concepts and Relations from Scientific Publications by Using Deep Learningcited by 2
  25. 2021Zero-shot Slot Filling with DPR and RAGcited by 1

Built on by

Not cited yet.