(Psycho-)Linguistic Features Meet Transformer Models for Improved Explainable and Controllable Text Simplification
Not on the map. Why?
Abstract (arXiv)
State-of-the-art text simplification (TS) systems adopt end-to-end neural network models to directly generate the simplified version of the input text, and usually function as a blackbox. Moreover, TS is usually treated as an all-purpose generic task under the assumption of homogeneity, where the same simplification is suitable for all. In recent years, however, there has been increasing recognition of the need to adapt the simplification techniques to the specific needs of different target groups. In this work, we aim to advance current research on explainable and controllable TS in two ways: First, building on recently proposed work to increase the transparency of TS systems, we use a large set of (psycho-)linguistic features in combination with pre-trained language models to improve explainable complexity prediction. Second, based on the results of this preliminary task, we extend a state-of-the-art Seq2Seq TS model, ACCESS, to enable explicit control of ten attributes. The results of experiments show (1) that our approach improves the performance of state-of-the-art models for predicting explainable complexity and (2) that explicitly conditioning the Seq2Seq model on ten attributes leads to a significant improvement in performance in both within-domain and out-of-domain settings.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 81 references that are in the map. First posted on arXiv 19 Dec 2022.
Builds on
25 of 81 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2017Toward Controlled Generation of Textcited by 271
- 2016Model-Agnostic Interpretability of Machine Learningcited by 219
- 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
- 2020Deep Learning for Text Style Transfer: A Surveycited by 161
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2017Sentence Simplification with Deep Reinforcement Learningcited by 107
- 2019Controllable Sentence Simplificationcited by 78
13 more
- 2016Controlling Output Length in Neural Encoder-Decoderscited by 75
- 2020Exploring Controllable Text Generation Techniquescited by 55
- 2020How Far are We from Effective Context Modeling? An Exploratory Study on Semantic Parsing in Contextcited by 53
- 2020Controllable Text Simplification with Explicit Paraphrasingcited by 53
- 2019EASSE: Easier Automatic Sentence Simplification Evaluationcited by 50
- 2019"Mask and Infill" : Applying Masked Language Model to Sentiment Transfercited by 48
- 2018Dynamic Multi-Level Multi-Task Learning for Sentence Simplificationcited by 25
- 2019Revision in Continuous Space: Unsupervised Text Style Transfer without Adversarial Learningcited by 21
- 2021Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalizationcited by 20
- 2020Explainable Prediction of Text Complexity: The Missing Preliminaries for Text Simplificationcited by 12
- 2022Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Featurescited by 10
- 2022Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patternscited by 8
- 2017A Constrained Sequence-to-Sequence Neural Model for Sentence Simplificationcited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 1.
4 papers.
- 2023Controlling Pre-trained Language Models for Grade-Specific Text Simplificationcited by 14
- 2024Measuring and Modifying the Readability of English Texts with GPT-4cited by 10
- 2023A Video is Worth 10,000 Words: Training and Benchmarking with Diverse Captions for Better Long Video Retrievalcited by 1
- 2026Translate or Simplify First: An Analysis of Cross-lingual Text Simplification in English and Frenchcited by 0
- 2026Translate or Simplify First: An Analysis of Cross-lingual Text Simplification in English and French26 Apr 2026
- 2024Measuring and Modifying the Readability of English Texts with GPT-417 Oct 2024
- 2023A Video is Worth 10,000 Words: Training and Benchmarking with Diverse Captions for Better Long Video Retrieval30 Nov 2023
- 2023Controlling Pre-trained Language Models for Grade-Specific Text Simplification24 May 2023