mlsanityData to 7 Oct 2026

(Psycho-)Linguistic Features Meet Transformer Models for Improved Explainable and Controllable Text Simplification

arXiv 2212.09848 ↗First posted 19 Dec 2022cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

State-of-the-art text simplification (TS) systems adopt end-to-end neural network models to directly generate the simplified version of the input text, and usually function as a blackbox. Moreover, TS is usually treated as an all-purpose generic task under the assumption of homogeneity, where the same simplification is suitable for all. In recent years, however, there has been increasing recognition of the need to adapt the simplification techniques to the specific needs of different target groups. In this work, we aim to advance current research on explainable and controllable TS in two ways: First, building on recently proposed work to increase the transparency of TS systems, we use a large set of (psycho-)linguistic features in combination with pre-trained language models to improve explainable complexity prediction. Second, based on the results of this preliminary task, we extend a state-of-the-art Seq2Seq TS model, ACCESS, to enable explicit control of ten attributes. The results of experiments show (1) that our approach improves the performance of state-of-the-art models for predicting explainable complexity and (2) that explicitly conditioning the Seq2Seq model on ten attributes leads to a significant improvement in performance in both within-domain and out-of-domain settings.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 81 references that are in the map. First posted on arXiv 19 Dec 2022.

Builds on

25 of 81 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  4. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  5. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  6. 2017Toward Controlled Generation of Textcited by 271
  7. 2016Model-Agnostic Interpretability of Machine Learningcited by 219
  8. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
  9. 2020Deep Learning for Text Style Transfer: A Surveycited by 161
  10. 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
  11. 2017Sentence Simplification with Deep Reinforcement Learningcited by 107
  12. 2019Controllable Sentence Simplificationcited by 78
13 more
  1. 2016Controlling Output Length in Neural Encoder-Decoderscited by 75
  2. 2020Exploring Controllable Text Generation Techniquescited by 55
  3. 2020How Far are We from Effective Context Modeling? An Exploratory Study on Semantic Parsing in Contextcited by 53
  4. 2020Controllable Text Simplification with Explicit Paraphrasingcited by 53
  5. 2019EASSE: Easier Automatic Sentence Simplification Evaluationcited by 50
  6. 2019"Mask and Infill" : Applying Masked Language Model to Sentiment Transfercited by 48
  7. 2018Dynamic Multi-Level Multi-Task Learning for Sentence Simplificationcited by 25
  8. 2019Revision in Continuous Space: Unsupervised Text Style Transfer without Adversarial Learningcited by 21
  9. 2021Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalizationcited by 20
  10. 2020Explainable Prediction of Text Complexity: The Missing Preliminaries for Text Simplificationcited by 12
  11. 2022Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Featurescited by 10
  12. 2022Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patternscited by 8
  13. 2017A Constrained Sequence-to-Sequence Neural Model for Sentence Simplificationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 1.

4 papers.