mlsanityData to 7 Oct 2026

What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics

arXiv 2411.17593 ↗First posted 26 Nov 2024cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The integration of new literature into the English curriculum remains a challenge since educators often lack scalable tools to rapidly evaluate readability and adapt texts for diverse classroom needs. This study proposes to address this gap through a multimodal approach that combines transformer-based text classification with linguistic feature analysis to align texts with UK Key Stages. Eight state-of-the-art Transformers were fine-tuned on segmented text data, with BERT achieving the highest unimodal F1 score of 0.75. In parallel, 500 deep neural network topologies were searched for the classification of linguistic characteristics, achieving an F1 score of 0.392. The fusion of these modalities shows a significant improvement, with every multimodal approach outperforming all unimodal models. In particular, the ELECTRA Transformer fused with the neural network achieved an F1 score of 0.996. Unimodal and multimodal approaches are shown to have statistically significant differences in all validation metrics (accuracy, precision, recall, F1 score) except for inference time. The proposed approach is finally encapsulated in a stakeholder-facing web application, providing non-technical stakeholder access to real-time insights on text complexity, reading difficulty, curriculum alignment, and recommendations for learning age range. The application empowers data-driven decision making and reduces manual workload by integrating AI-based recommendations into lesson planning for English literature.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 26 Nov 2024.

Builds on

12 of 29 references.

References · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  8. 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
  9. 2013Crowdsourcing a Word-Emotion Association Lexiconcited by 193
  10. 2019Supervised and Unsupervised Neural Approaches to Text Readabilitycited by 45
  11. 2021Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Featurescited by 36
  12. 2024Generating Educational Materials with Different Levels of Readability using LLMscited by 9

Built on by

Not cited yet.