mlsanityData to 14 Oct 2026

Discovering Relationships in Data Lakes Using Large Language Models: An Industrial Case

arXiv 2608.26750 ↗First posted 27 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Data lakes rely on metadata to remain usable, yet this meta data is often limited or weakly informative for column relationship discovery, especially in ERP-derived datasets with coded or abbreviated schema labels. We propose ColRel, a two-stage method that builds column embeddings from metadata and data available at ingestion time. In difficult cases, such as coded schemata, business dictionaries help better interpret column names and support the generation of short natural-language descriptions used in the second stage. Experiments on public benchmarks and an industrial ERP dataset show that ColRel is particularly effective in semantically related, weak-signal settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

12 of 30 references.

References · 12

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  3. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  4. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
  5. 2020Valentine: Evaluating Matching Techniques for Dataset Discoverycited by 35
  6. 2020Dataset Discovery in Data Lakescited by 31
  7. 2024Schema Matching with Large Language Models: an Experimental Studycited by 20
  8. 2024Magneto: Combining Small and Large Language Models for Schema Matchingcited by 17
  9. 2025TARGET: Benchmarking Table Retrieval for Generative Taskscited by 17
  10. 2024ReMatch: Retrieval Enhanced Schema Matching with LLMscited by 16
  11. 2022DeepJoin: Joinable Table Discovery with Pre-trained Language Modelscited by 15
  12. 2025Evaluating Joinable Column Discovery Approaches for Context-Aware Searchcited by 2

Built on by

Not cited yet.