mlsanityData to 7 Oct 2026

SCM-based Fairness and Faithful Explainability for Legal Document Classification

arXiv 2610.00045 ↗First posted 3 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Transformer models such as LegalBERT are increasingly used in legal decision support, raising concerns about both fairness and the transparency of model explanations. These properties are usually evaluated separately, leaving open whether a debiasing intervention that changes fairness also changes how faithfully explanations reflect model reasoning. This study investigates that relationship on the ECtHR alleged-violations corpus from LexGLUE. It compares a LegalBERT baseline with a fairness-regularized variant that penalizes stereotypical warmth and competence representations during fine-tuning. The evaluation covers predictive performance, demographic fairness, and SHAP explanation faithfulness across five random seeds. At the performance-optimal regularization strength, the intervention does not reduce demographic disparity. This null result holds across two fairness definitions and a conventional word-pair control on the gender axis. Classification performance is largely unchanged. However, the intervention consistently degrades explanation sufficiency across all five seeds and three thresholds. A shuffled-pair control reproduces this degradation while leaving performance and fairness unchanged, indicating that the effect arises from contrastive representational regularization rather than specifically from the warmth and competence structure. The results demonstrate a dissociation between fairness and explanation faithfulness: changes in explanation behavior do not necessarily indicate changes in fairness, and fairness must therefore be evaluated directly.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 36 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

14 of 36 references.

References · 14

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  4. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  5. 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
  6. 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
  7. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
  8. 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
  9. 2018An Intersectional Definition of Fairnesscited by 126
  10. 2023Faithfulness Tests for Natural Language Explanationscited by 107
  11. 2022FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processingcited by 48
  12. 2021Understanding and Countering Stereotypes: A Computational Approach to the Stereotype Content Modelcited by 23
2 more
  1. 2022Challenges in Applying Explainability Methods to Improve the Fairness of NLP Modelscited by 20
  2. 2026Assessing the quality and coherence of word embeddings after SCM-based intersectional bias mitigationcited by 2

Built on by

Not cited yet.