mlsanityData to 14 Oct 2026

Leveraging Large Language Models for Generating Labeled Mineral Site Record Linkage Data

arXiv 2412.03575 ↗First posted 17 Nov 2024cs.IR cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Record linkage integrates diverse data sources by identifying records that refer to the same entity. In the context of mineral site records, accurate record linkage is crucial for identifying and mapping mineral deposits. Properly linking records that refer to the same mineral deposit helps define the spatial coverage of mineral areas, benefiting resource identification and site data archiving. Mineral site record linkage falls under the spatial record linkage category since the records contain information about the physical locations and non-spatial attributes in a tabular format. The task is particularly challenging due to the heterogeneity and vast scale of the data. While prior research employs pre-trained discriminative language models (PLMs) on spatial entity linkage, they often require substantial amounts of curated ground-truth data for fine-tuning. Gathering and creating ground truth data is both time-consuming and costly. Therefore, such approaches are not always feasible in real-world scenarios where gold-standard data are unavailable. Although large generative language models (LLMs) have shown promising results in various natural language processing tasks, including record linkage, their high inference time and resource demand present challenges. We propose a method that leverages an LLM to generate training data and fine-tune a PLM to address the training data gap while preserving the efficiency of PLMs. Our approach achieves over 45% improvement in F1 score for record linkage compared to traditional PLM-based methods using ground truth data while reducing the inference time by nearly 18 times compared to relying on LLMs. Additionally, we offer an automated pipeline that eliminates the need for human intervention, highlighting this approach's potential to overcome record linkage challenges.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 17 Nov 2024.

Builds on

15 of 32 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  7. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  8. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
  9. 2022Language Models are Realistic Tabular Data Generatorscited by 294
  10. 2022Can Foundation Models Wrangle Your Data?cited by 175
  11. 2020Deep Entity Matching with Pre-Trained Language Modelscited by 144
  12. 2017DeepER -- Deep Entity Resolutioncited by 54
3 more
  1. 2022SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representationcited by 23
  2. 2024GPT-4o: Visual perception performance of multimodal large language models in piglet activity understandingcited by 12
  3. 2019Multi-Source Spatial Entity Linkagecited by 2

Built on by

Not cited yet.