Do LLMs Encode Frame Semantics? Evidence from Frame Identification
Not on the map. Why?
Abstract (arXiv)
We investigate whether large language models encode latent knowledge of frame semantics, focusing on frame identification, a core challenge in frame semantic parsing that involves selecting the appropriate semantic frame for a target word in context. Using the FrameNet lexical resource, we evaluate models under prompt-based inference and observe that they can perform frame identification effectively even without explicit supervision. To assess the impact of task-specific training, we fine-tune the model on FrameNet data, which substantially improves in-domain accuracy while generalizing well to out-of-domain benchmarks. Further analysis shows that the models can generate semantically coherent frame definitions, highlighting the model's internalized understanding of frame semantics.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 6 of its 29 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
6 of 29 references.
References · 6
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Few-Shot Semantic Parsing with Language Models Trained On Codecited by 50
- 2017Frame-Semantic Parsing with Softmax-Margin Segmental RNNs and a Syntactic Scaffoldcited by 33
- 2018Learning Joint Semantic Parsers from Disjoint Datacited by 12
- 2024Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRLcited by 10
- 2023Coarse-to-Fine Dual Encoders are Better Frame Identification Learnerscited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.