mlsanityData to 14 Oct 2026

When a Conceptor Complement Becomes Gain: Operator Geometry and Behavioral Attribution in Language Models

arXiv 2610.16325 ↗First posted 12 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

When a steering intervention changes a language model's behavior, which part of the intervention deserves the credit? We test this question for a target-centered, scaled conceptor complement by removing its fitted covariance filter while preserving the same target-specific center and gain. At the original aperture α=.05 and gain β=2, all 21 fitted maps across three models and seven targets expand every direction at the generation intervention layers. The matrix correction is 0.093%--7.815% of the matched-control displacement on held-out extraction activations. In 480 paired comparisons within a 1,920-response study, retaining the matrix changes many individual texts but does not establish a consistent additional target-suppression benefit on the four-target panel. A geometric aperture sweep shows that the operating regime changes with the filter setting. Separately, an invertible soft filter preserves what an unrestricted affine readout can recover, whereas dedicated erasure methods reduce prediction by newly fitted probes. Together, the results show why a whole-intervention comparison cannot by itself attribute generated behavior to the fitted matrix: analyze the complete transformation, hold shared components fixed, and test its output consequences directly.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 186 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

20 of 186 references.

References · 20

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Steering Language Models With Activation Engineeringcited by 922
  3. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
  4. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  5. 2023Function Vectors in Large Language Modelscited by 308
  6. 2023LEACE: Perfect linear concept erasure in closed formcited by 267
  7. 2025AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoderscited by 218
  8. 2024Analyzing the Generalization and Reliability of Steering Vectorscited by 143
  9. 2023Improving Activation Steering in Language Models with Mean-Centringcited by 68
  10. 2024Controlling Language and Diffusion Models by Transporting Activationscited by 68
  11. 2024Spectral Editing of Activations for Large Language Model Alignmentcited by 56
  12. 2025Angular Steering: Behavior Control via Rotation in Activation Spacecited by 53
8 more
  1. 2025The Hidden Dimensions of LLM Alignment: A Multi-Dimensional Analysis of Orthogonal Safety Directionscited by 41
  2. 2024Steering Large Language Models using Conceptors: Improving Addition-Based Activation Engineeringcited by 39
  3. 2024Towards Reliable Evaluation of Behavior Steering Interventions in LLMscited by 36
  4. 2025Steering off Course: Reliability Challenges in Steering Language Modelscited by 34
  5. 2025LinEAS: End-to-end Learning of Activation Steering with a Distributional Losscited by 14
  6. 2022Conceptor-Aided Debiasing of Large Language Modelscited by 5
  7. 2014Conceptors: an easy introductioncited by 4
  8. 2026Conceptors for Semantic Steeringcited by 3

Built on by

Not cited yet.