Replay-Gated Neural Execution: Decoupling Persistent Behavioral Specifications from Neural Realizations in Frozen Language Models
Not on the map. Why?
Abstract (arXiv)
Input-conditioned neural interventions raise a runtime question: what persists when one behavioral specification admits multiple actions whose validity depends on execution state? We introduce replay-gated neural execution, separating five objects: a persistent behavioral predicate, its state-indexed certified realization set, a transient action witness, a budget-limited finder, and execution authorization. Candidates undergo isolated FP32/BF16 replay of the frozen model; commitment additionally requires a valid run audit. Experiments on Qwen3-0.6B and SmolLM2-360M-Instruct establish distinct failure modes for these objects. Independent initializations yield distinct certified actions in all 24 tested fixed-state cells. Unchanged SmolLM2 witnesses remain certified in all 128 native states but only 66 of 384 off-diagonal transfers. All 767 archived Qwen witnesses replay successfully, yet a budget-limited finder misses one known-realizable cell in all three prespecified runs. Of 1,141 replay-submitted candidates, 174 fail item certification. A frozen three-tier cascade uses these boundaries to reject uncertified proposals and escalate audit-valid search misses. On 256 previously sealed Qwen Fresh requests, 221 first certify at the lowest-cost tier and all 256 receive audited authorization, with no observed bypass. Relative to frozen full search, the median singleton search-and-certification cost ratio is 0.1055 and P95 is 1.3485, including failed tiers. Within the studied behavioral family on two small models, these results support state-indexed, set-valued execution semantics: specifications persist, search proposes witnesses, and replay certification plus run audit grants execution authority.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 44 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
38 of 44 references.
References · 38
- 2017Attention Is All You Needcited by 59,932
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2022Mass-Editing Memory in a Transformercited by 976
- 2022Toy Models of Superpositioncited by 928
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2017Safe Reinforcement Learning via Shieldingcited by 427
26 more
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 328
- 2023Function Vectors in Large Language Modelscited by 292
- 2024ReFT: Representation Finetuning for Language Modelscited by 186
- 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 175
- 2024Aligning Large Language Models with Representation Editing: A Control Perspectivecited by 62
- 2024Representation Surgery: Theory and Practice of Affine Steeringcited by 47
- 2024Activation Scaling for Steering and Interpreting Language Modelscited by 33
- 2019Neural Simplex Architecturecited by 27
- 2025To Steer or Not to Steer? Mechanistic Error Reduction with Abstention for Language Modelscited by 26
- 2025HyperSteer: Activation Steering at Scale with Hypernetworkscited by 20
- 2023Selective Generation for Controllable Language Modelscited by 15
- 2025Activation Steering with a Feedback Controllercited by 11
- 2025Preemptive Detection and Steering of LLM Misalignment via Latent Reachabilitycited by 10
- 2026Steering Vector Fields for Context-Aware Inference-Time Control in Large Language Modelscited by 10
- 2025In-Distribution Steering: Balancing Control and Coherence in Language Model Generationcited by 8
- 2026On the Non-Identifiability of Steering Vectors in Large Language Modelscited by 8
- 2026Local Linearity of LLMs Enables Activation Steering via Model-Based Linear Optimal Controlcited by 8
- 2026Steer2Adapt: Dynamically Composing Steering Vectors Elicits Efficient Adaptation of LLMscited by 7
- 2026ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoningcited by 6
- 2026Contextual Linear Activation Steering of Language Modelscited by 4
- 2026Deployable Per-Instance Multi-Layer Activation Steering for Large Language Modelscited by 2
- 2026What Does Activation Steering Control? Attribution Across Answer Encodings and Output-Sensitive Subspacescited by 1
- 2026SteerCheck: Attribution Specificity and Alignment Leakage in Activation-Steering Auditscited by 1
- 2026One Model, Many Minds: Unlocking Multi-Agent Synergy in a Single Agent via Mixture of Rolescited by 1
- 2026ObserverBench: Testing Mechanistic Estimates for Intervention and Controlcited by 1
Built on by
Not cited yet.