Deep Learning Approaches to Lexical Simplification: A Survey
Not on the map. Why?
Abstract (arXiv)
Lexical Simplification (LS) is the task of replacing complex for simpler words in a sentence whilst preserving the sentence's original meaning. LS is the lexical component of Text Simplification (TS) with the aim of making texts more accessible to various target populations. A past survey (Paetzold and Specia, 2017) has provided a detailed overview of LS. Since this survey, however, the AI/NLP community has been taken by storm by recent advances in deep learning, particularly with the introduction of large language models (LLM) and prompt learning. The high performance of these models sparked renewed interest in LS. To reflect these recent advances, we present a comprehensive survey of papers published between 2017 and 2023 on LS and its sub-tasks with a special focus on deep learning. We also present benchmark datasets for the future development of LS systems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 22 of its 93 references that are in the map. First posted on arXiv 19 May 2023.
Builds on
22 of 93 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2018Deep contextualized word representationscited by 2,290
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2021MarIA: Spanish Language Modelscited by 36
- 2018A Report on the Complex Word Identification Shared Task 2018cited by 30
- 2018A Word-Complexity Lexicon and A Neural Readability Ranking Model for Lexical Simplificationcited by 24
- 2020CompLex: A New Corpus for Lexical Complexity Prediction from Likert Scale Datacited by 24
10 more
- 2015sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddingscited by 20
- 2023Findings of the TSAR-2022 Shared Task on Multilingual Lexical Simplificationcited by 20
- 2021SemEval-2021 Task 1: Lexical Complexity Predictioncited by 19
- 2022Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitutioncited by 12
- 2023UniHD at TSAR-2022 Shared Task: Is Compute All We Need for Lexical Simplification?cited by 12
- 2022One Size Does Not Fit All: The Case for Personalised Word Complexity Modelscited by 10
- 2020Chinese Lexical Simplificationcited by 8
- 2022MANTIS at TSAR-2022 Shared Task: Improved Unsupervised Lexical Simplification with Pretrained Encoderscited by 5
- 2021One Size Does Not Fit All: Finding the Optimal Subword Sizes for FastText Models across Languagescited by 4
- 2023Lexical Complexity Prediction: An Overviewcited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 2.
4 papers.
- 2024Evaluating Document Simplification: On the Importance of Separately Assessing Simplicity and Meaning Preservationcited by 5
- 2024Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learningcited by 1
- 2026RALS: Resources and Baselines for Romanian Automatic Lexical Simplificationcited by 1
- 2026Right at My Level: A Unified Multilingual Framework for Proficiency-Aware Text Simplificationcited by 0
- 2026RALS: Resources and Baselines for Romanian Automatic Lexical Simplification22 Jul 2026
- 2026Right at My Level: A Unified Multilingual Framework for Proficiency-Aware Text Simplification7 Apr 2026
- 2024Evaluating Document Simplification: On the Importance of Separately Assessing Simplicity and Meaning Preservation4 Apr 2024
- 2024Health Text Simplification: An Annotated Corpus for Digestive Cancer Education and Novel Strategies for Reinforcement Learning26 Jan 2024