The Invisible Editorial Layer: Formalizing Undisclosed Inference-Time Steering, Probability Placement, and the Attribution Problem in Deployed Language Models
Not on the map. Why?
Abstract (arXiv)
Evaluations of generative language models frequently interpret observable behavioral traits, such as political stance, brand inclination, and normative framing, as manifestations of model weights, post-training alignment, or prompting. This interpretation risks conflating a foundation model with the multi-layered production system through which its outputs are ultimately served. Modern inference stacks support runtime interventions capable of modifying generation while model parameters remain frozen. We examine inference-time framing bias: systematic runtime steering of generated text toward institutional, ideological, or commercial frames without requiring changes to the underlying model parameters. We formalize the Inference Attribution Problem and establish an observational non-identifiability result showing that, under black-box observation alone, behaviorally equivalent deployed systems may arise from structurally distinct combinations of model parameters and inference policies. Consequently, observed behavioral bias does not uniquely identify the architectural layer responsible for it. We further characterize Probability Placement as a deployment pattern in which undisclosed commercial influence is embedded within an ostensibly organic assistant response through systematic probability-mass reallocation, distinguishing it from explicit token-auction mechanisms for generative advertising. Finally, we discuss implications for behavioral auditing, inference provenance, confidential computing, cryptographic attestation, the EU AI Act, the Digital Services Act, and advertising-disclosure principles. We argue that governance of generative systems must increasingly distinguish between auditing a model and auditing the deployed system that ultimately speaks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
12 of 33 references.
References · 12
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2023A Watermark for Large Language Modelscited by 725
- 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 441
- 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 126
- 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 109
- 2024From Transparency to Accountability and Back: A Discussion of Access and Evidence in AI Auditingcited by 15
- 2026Steering Language Models Before They Speak: Logit-Level Interventionscited by 4
- 2025Don't Change My View: Ideological Bias Auditing in Large Language Modelscited by 1
Built on by
Not cited yet.