Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitions
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) can provide accurate word definitions and explanations for any context. However, the scope of the definition changes for different target groups, like children or language learners. This is especially relevant for homonyms, words with multiple meanings, where oversimplification might risk information loss by omitting key senses, potentially misleading users who trust LLM outputs. We investigate how simplification impacts homonym definition quality across three target groups: Normal, Simple, and ELI5. Using two novel evaluation datasets spanning multiple languages, we test DeepSeek v3, Llama 4 Maverick, Qwen3-30B A3B, GPT-4o mini, and Llama 3.1 8B via LLM-as-Judge and human annotations. Our results show that simplification drastically degrades definition completeness by neglecting polysemy, increasing the risk of misunderstanding. Fine-tuning Llama 3.1 8B with Direct Preference Optimization substantially improves homonym response quality across all prompt types. These findings highlight the need to balance simplicity and completeness in educational NLP to ensure reliable, context-aware definitions for all learners.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 45 references that are in the map. First posted on arXiv 16 Jul 2025.
Builds on
19 of 45 references.
References · 19
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2019ELI5: Long Form Question Answeringcited by 575
- 2024Large Language Models for Education: A Survey and Outlookcited by 188
- 2022Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectorscited by 104
- 2023ChatGPT as a Factual Inconsistency Evaluator for Text Summarizationcited by 75
- 2016Definition Modeling: Learning to define word embeddings in natural languagecited by 46
7 more
- 2018Conditional Generators of Words Definitionscited by 35
- 2024Large Language Models for Education: A Surveycited by 34
- 2024SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakescited by 24
- 2022Multitasking Framework for Unsupervised Simple Definition Generationcited by 18
- 2023Do Text Simplification Systems Preserve Meaning? A Human Evaluation via Reading Comprehensioncited by 16
- 2024InfoLossQA: Characterizing and Recovering Information Loss in Text Simplificationcited by 14
- 2024Simpler becomes Harder: Do LLMs Exhibit a Coherent Behavior on Simplified Corpora?cited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025New Evaluation Paradigm for Lexical Simplification
- 2025Towards Trustworthy Lexical Simplification: Exploring Safety and Efficiency with Small LLMs
- 2026Let's Simplify Step by Step: Guiding LLM Towards Multilingual Unsupervised Proficiency-Controlled Sentence Simplification
- 2026On the Limits of LLM Adaptability: Impact of Model-Internalized Priors on Annotation Task Performance
- 2025Rethinking LLM Unlearning Objectives: A Gradient Perspective and Go Beyond
- 2024Teaching LLMs to Abstain across Languages via Multilingual Feedback
- 2024Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models
- 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs