mlsanityData to 7 Oct 2026

TypedCSIP: Typed Counterfactual Pretraining for Chinese Legislative Conflict Classification

arXiv 2605.25474 ↗First posted 25 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

TypedCSIP is a typed counterfactual pretraining method for the conflict-classification task of the LCR-CN benchmark (Zhao et al., 2026): given a (superior, subordinate) provision pair, predict whether the pair conflicts and which of four legal-doctrine types (Responsibility, Condition, Sanction, Definition) describes the inconsistency. We exploit LCR-CN's expert-written minimal revisions as training-time counterfactual supervision; at test time the classifier reads only the original pair. Stage 1 pretrains a shared encoder with a typed Counterfactual Selective Intervention Pretraining objective on (superior, subordinate, expert-revised) triplets, treating the expert revision as a counterfactual that the typed factor head must classify as carrying no conflict evidence. Stage 2 transfers the encoder to a five-way classification head. The confirmatory test was registered on the Open Science Framework before observing v6 measurements: 18 seeds, locked rule requiring mean per-seed difference at least 0.8 pp with both seed-bootstrap and Student-t 95% lower bounds above zero. On the 696-record test split, the v2 variant improves macro-F1 over the strongest single-model baseline by +0.916 pp on chinese-roberta-wwm-ext and +1.288 pp on the SAILER cross-backbone replication; both cells pass the rule. A cold-start stratified result on the 244 Unseen-gB records keeps the gain positive on both backbones. A cross-task diagnostic shows the Stage-2 encoder is classification-specialized and does not transfer to LCR-CN's superior-law retrieval task, so we scope the contribution to conflict classification. We release code, 72 pre-registered prediction files, matched-seed and MLM-control auxiliaries, and the OSF pre-registration record.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

14 of 26 references.

References · 14

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  3. 2016Learning without Forgettingcited by 2,465
  4. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  5. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 428
  6. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
  7. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  8. 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
  9. 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 115
  10. 2023SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrievalcited by 61
  11. 2024Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulationcited by 15
  12. 2024Counterfactual contrastive learning: robust representations via causal image synthesiscited by 11
2 more
  1. 2024PairCFR: Enhancing Model Training on Paired Counterfactually Augmented Data through Contrastive Learningcited by 7
  2. 2022CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classificationcited by 2

Built on by

Not cited yet.