SCIT: Testing Causal Cache Carriers in Latent Chain-of-Thought Models
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Latent chain-of-thought models move intermediate reasoning from emitted text into continuous states, improving compactness but hiding the causal object. We introduce SCIT, the Suffix Cache Interchange Test, a causal protocol that constructs exact source-recipient counterfactuals, patches declared cache segments, and identifies which transformer object carries the counterfactual computation. SCIT combines sufficiency tests with K/V component splits, hidden-state controls, semantic source controls, decoded validation, and matched corruption. On CODI-GPT2 and a Sim-CoT-style GPT-2 reproduction, counterfactual arithmetic transfers primarily through value-cache suffix trajectories rather than hidden states, keys, reusable answer slots, or single-token triggers. Complete sufficiency-and-necessity evidence for the late-value-suffix mechanism holds for the main CODI-GPT2 checkpoint; the Sim-CoT-style checkpoint shows the same sufficiency and decoded-control pattern but insufficient matched-corruption evidence for a necessity call. Beyond these local arithmetic cells, SCIT reveals carrier-regime shifts: arithmetic-like GPT-2/1B cells preserve latent-tail value/KV transfer, whereas competent 8B and repaired non-arithmetic cells route through prompt-prefix or full-cache K/V; boundary cells receive no mechanism call. SCIT therefore contributes a cache-level diagnostic, a checkpoint-specific GPT-2 arithmetic mechanism, and a competence-gated carrier map rather than a universal latent-tail claim.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 25 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
13 of 25 references.
Closest ancestors · 7
Same direction, newest first
- 2026Dynamics Within Latent Chain-of-Thought: An Empirical Study of Causal Structure9 Feb
- 2025SIM-CoT: Supervised Implicit Chain-of-Thought24 Sep
- 2025Reasoning Models Don't Always Say What They Think8 May
- 2024Training Large Language Models to Reason in a Continuous Latent Space9 Dec
- 2023Measuring Faithfulness in Chain-of-Thought Reasoning17 Jul
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
Other references · 6
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,145
- 2022In-context Learning and Induction Headscited by 940
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 878
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 600
- 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 229
- 2024How to use and interpret activation patchingcited by 202
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Thinking Traps in Long Chain-of-Thought: A Measurable Study and Trap-Aware Adaptive Restart
- 2026Mechanistic Evidence for Faithfulness Decay in Chain-of-Thought Reasoning
- 2026Beyond the Commitment Boundary: Probing Epiphenomenal Chain-of-Thought in Large Reasoning Models
- 2026When Reasoning Traces Become Performative: Step-Level Evidence that Chain-of-Thought Is an Imperfect Oversight Channel
- 2026The Detection-Extraction Gap: Models Know the Answer Before They Can Say It
- 2026The Coupling Tax: How Shared Token Budgets Undermine Visible Chain-of-Thought Under Fixed Output Limits
- 2026The Last Word Often Wins: A Format Confound in Chain-of-Thought Corruption Studies
- 2026When Chain-of-Thought Fails, the Solution Hides in the Hidden States