Deep Learning and Natural Language Processing in the Field of Construction
Not on the map. Why?
Abstract (arXiv)
This article presents a complete process to extract hypernym relationships in the field of construction using two main steps: terminology extraction and detection of hypernyms from these terms. We first describe the corpus analysis method to extract terminology from a collection of technical specifications in the field of construction. Using statistics and word n-grams analysis, we extract the domain's terminology and then perform pruning steps with linguistic patterns and internet queries to improve the quality of the final terminology. Second, we present a machine-learning approach based on various words embedding models and combinations to deal with the detection of hypernyms from the extracted terminology. Extracted terminology is evaluated using a manual evaluation carried out by 6 experts in the domain, and the hypernym identification method is evaluated with different datasets. The global approach provides relevant and promising results.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 60 references that are in the map. First posted on arXiv 14 Jan 2025.
Builds on
9 of 60 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2019CamemBERT: a Tasty French Language Modelcited by 368
- 2017Advances in Pre-Training Distributed Word Representationscited by 207
- 2016Hypernyms under Siege: Linguistically-motivated Artillery for Hypernymy Detectioncited by 13
Built on by
Not cited yet.