Relational Intervention During Functional Collapse in Large Language Models: A Lexical-Statistical Ablation and a Structure x Register Factorial
Not on the map. Why?
Abstract (arXiv)
We test whether a relational-style intervention delivered during functional collapse in a small language model produces post-collapse behavior distinguishable from technical feedback, from a lexically-matched scrambled control, and from each of the two pragmatic dimensions in isolation. Using Qwen3.5-4B with a deliberately broken bash tool, we run 300 episodes across six conditions in a matched-pairs design (50 tasks): no intervention (A), technical/impersonal (B), relational/first-person (C), scrambled relational (D), technical/first-person (E), and relational/impersonal (F). E and F form a 2x2 factorial with B and C that dissociates relational structure (acknowledgment, absolution, agency restoration, unconditional acceptance) from sender register (first-person vs. impersonal). We report two main findings. First, an attention-behavior dissociation: attention follows lexical surprise (D > F > C > E > B, all q_FDR < 10^{-10}), with the scrambled message capturing the most attention; yet behaviorally A ~ B ~ D < E ~ F << C. Second, the factorial localizes the C effect: neither relational structure alone (F) nor first-person register alone (E) replicates C's behavioral signature; main effects of both dimensions are individually significant, and the structure x register interaction is significant on persistence (p = 0.046). A third dissociation emerges in emotion probes: F tracks C on 7 of 8 probes despite producing only baseline behavior, indicating that relational structure alone installs a probe-level state that only translates into behavior when paired with first-person register. The model's processing decomposes into three dissociable stages: attention (ordered by lexical surprise), probe-level state (ordered by structure), and behavior (ordered by the conjunction of both).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 34 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
16 of 34 references.
References · 16
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2019Attention is not Explanationcited by 916
- 2019Attention is not not Explanationcited by 629
- 2024Programming Refusal with Conditional Activation Steeringcited by 191
- 2023Large Language Models Understand and Can be Enhanced by Emotional Stimulicited by 143
- 2026Emotion Concepts and their Function in a Large Language Modelcited by 48
- 2024Taking AI Welfare Seriouslycited by 28
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 24
- 2021Hebbian learning with gradients: Hebbian convolutional neural networks with modern deep learning frameworkscited by 19
- 2025Representation Engineering for Large-Language Models: Survey and Research Challengescited by 18
- 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotioncited by 10
4 more
- 2026Beyond pass@1: A Reliability Science Framework for Long-Horizon LLM Agentscited by 8
- 2025The LLM Has Left The Chat: Evidence of Bail Preferences in Large Language Modelscited by 5
- 2025Empathic Prompting: Non-Verbal Context Integration for Multimodal LLM Conversationscited by 2
- 2026Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparisoncited by 2
Built on by
Not cited yet.