Enhancing Automatic Term Extraction with Large Language Models via Syntactic Retrieval
Not on the map. Why?
Abstract (arXiv)
Automatic Term Extraction (ATE) identifies domain-specific expressions that are crucial for downstream tasks such as machine translation and information retrieval. Although large language models (LLMs) have significantly advanced various NLP tasks, their potential for ATE has scarcely been examined. We propose a retrieval-based prompting strategy that, in the few-shot setting, selects demonstrations according to syntactic rather than semantic similarity. This syntactic retrieval method is domain-agnostic and provides more reliable guidance for capturing term boundaries. We evaluate the approach in both in-domain and cross-domain settings, analyzing how lexical overlap between the query sentence and its retrieved examples affects performance. Experiments on three specialized ATE benchmarks show that syntactic retrieval improves F1-score. These findings highlight the importance of syntactic cues when adapting LLMs to terminology-extraction tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 48 references that are in the map. First posted on arXiv 26 Jun 2025.
Builds on
21 of 48 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
- 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
- 2020Finding Universal Grammatical Relations in Multilingual BERTcited by 110
9 more
- 2024Making Text Embedders Few-Shot Learnerscited by 79
- 2020Fast and Accurate Neural CRF Constituency Parsingcited by 50
- 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractorscited by 45
- 2022Prompting Language Models for Linguistic Structurecited by 39
- 2023Chain of Thought with Explicit Evidence Reasoning for Few-shot Relation Extractioncited by 19
- 2023Investigating semantic subspaces of Transformer sentence embeddings through linear structural probingcited by 12
- 2022FastKASSIM: A Fast Tree Kernel-Based Syntactic Similarity Metriccited by 9
- 2021On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representationscited by 6
- 2023The Recent Advances in Automatic Term Extraction: A surveycited by 4
Built on by
Not cited yet.