mlsanityData to 14 Oct 2026

Improving Lexical Difficulty Prediction with Context-Aligned Contrastive Learning and Ridge Ensembling

arXiv 2605.08950 ↗First posted 9 May 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Lexical difficulty prediction is a fundamental problem in language learning and readability assessment, requiring models to estimate word difficulty across different first-language (L1) backgrounds. However, existing approaches rely on regression-only training with scalar supervision, which does not explicitly structure the representation space, limiting their ability to capture cross-lingual alignment and ordinal difficulty. To mitigate these issues, we propose Context-Aligned Contrastive Regression, which integrates Ridge regression ensemble with two complementary objectives, i.e., Cross-View Context and Ordinal Soft Contrastive Learning. Experiments on three L1 datasets show that (i) contrastive objectives improve cross-lingual representation alignment while preserving language-specific nuances, (ii) the learned representations capture the ordinal structure of lexical difficulty, and (iii) the ensemble effectively mitigates systematic biases of individual models, leading to more stable performance across difficulty levels.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 23 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

8 of 23 references.

References · 8

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  5. 2018A Report on the Complex Word Identification Shared Task 2018cited by 30
  6. 2021SemEval-2021 Task 1: Lexical Complexity Predictioncited by 19
  7. 2023ConR: Contrastive Regularizer for Deep Imbalanced Regressioncited by 19
  8. 2022TractoSCR: A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractographycited by 9

Built on by

Not cited yet.