mlsanityData to 14 Oct 2026

Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling

arXiv 2608.03842 ↗First posted 4 Aug 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

When a language model fails on surface-perturbed input (typos, OCR noise, homophones), "which layer is responsible" has three natural operationalizations: where representations diverge most (sensitivity), where restoring clean activations recovers the prediction (causality), and where a small adapter can repair the damage (compensatory capacity) - and we show these three layer maps dissociate. Across a five-model panel we identify two propagation regimes - spike-and-suppress (Phi-3.5, Gemma-2-9B) and late-accumulation (Llama-3, Mistral, Qwen2.5-7B) - and on the two models meeting an 80% identity-patch gate, sensitivity and causality are anti-correlated (rho = -0.72 to -0.88). Within-family scaling on Qwen2.5 (1.5B to 14B) shows the late-accumulation signature strengthening monotonically with scale, corroborated on a second family. We propose cascade disruption as the mechanism behind the dissociation: adapters placed at causally implicated early layers break intact downstream computation, making diagnostic-flagged sites the worst adapter placements. A fixed-harness layer sweep across four models (3.8-8B) confirms the core prediction on chain-of-thought GSM8K - the flagged sites are the most damaging adapter windows on every adjudicable model - and is sign-consistent but strongly attenuated on a multiple-choice control, consistent with damage that compounds with generation length. The sweep yields practical guidance: a training-free LRD pre-screen and a default-deepest placement rule, though absolute gains over no-adapter baselines remain small. Finally, apparent gains from a representation-stability loss reverse under an adequate generation budget - truncated chain-of-thought had been scored as empty - a methodological warning for any intervention evaluated on chain-of-thought tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

20 of 35 references.

References · 20

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  4. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  5. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  6. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  7. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  8. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  9. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  10. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  11. 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
  12. 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
8 more
  1. 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 491
  2. 2021Revisiting Model Stitching to Compare Neural Representationscited by 209
  3. 2019Combating Adversarial Misspellings with Robust Word Recognitioncited by 163
  4. 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
  5. 2019Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systemscited by 101
  6. 2021Evaluating the Robustness of Neural Language Models to Input Perturbationscited by 87
  7. 2020OCR Post Correction for Endangered Language Textscited by 31
  8. 2024Useful Blunders: Can Automated Speech Recognition Errors Improve Downstream Dementia Classification?cited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Wrong Before Right: Late Rescue and Interface Failure in Aligned Language Models
  2. 2023The Hydra Effect: Emergent Self-repair in Language Model Computations
  3. 2026Read-Best Is Not Steer-Best: A Probing--Steering Layer Dissociation in Omni-Modal Large Language Models
  4. 2026The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally
  5. 2026When Attribution Patching Lies: Diagnosis and a Second-Order Correction
  6. 2025Probing the Robustness of Large Language Models Safety to Latent Perturbations
  7. 2026Decomposing the Depth Profile of Fine-Tuning
  8. 2026Linear Separability of Activation Representations after Supervised Fine-Tuning on Incorrect Responses: A Study of Synthetic Dishonesty in Large Language Models