mlsanityData to 7 Oct 2026

Replay-Gated Neural Execution: Decoupling Persistent Behavioral Specifications from Neural Realizations in Frozen Language Models

arXiv 2609.22243 ↗First posted 5 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Input-conditioned neural interventions raise a runtime question: what persists when one behavioral specification admits multiple actions whose validity depends on execution state? We introduce replay-gated neural execution, separating five objects: a persistent behavioral predicate, its state-indexed certified realization set, a transient action witness, a budget-limited finder, and execution authorization. Candidates undergo isolated FP32/BF16 replay of the frozen model; commitment additionally requires a valid run audit. Experiments on Qwen3-0.6B and SmolLM2-360M-Instruct establish distinct failure modes for these objects. Independent initializations yield distinct certified actions in all 24 tested fixed-state cells. Unchanged SmolLM2 witnesses remain certified in all 128 native states but only 66 of 384 off-diagonal transfers. All 767 archived Qwen witnesses replay successfully, yet a budget-limited finder misses one known-realizable cell in all three prespecified runs. Of 1,141 replay-submitted candidates, 174 fail item certification. A frozen three-tier cascade uses these boundaries to reject uncertified proposals and escalate audit-valid search misses. On 256 previously sealed Qwen Fresh requests, 221 first certify at the lowest-cost tier and all 256 receive audited authorization, with no observed bypass. Relative to frozen full search, the median singleton search-and-certification cost ratio is 0.1055 and P95 is 1.3485, including failed tiers. Within the studied behavioral family on two small models, these results support state-indexed, set-valued execution semantics: specifications persist, search proposes witnesses, and replay certification plus run audit grants execution authority.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 44 references that are in the map. First posted on arXiv 5 Sep 2026.

Builds on

38 of 44 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  4. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  5. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  6. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  7. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  8. 2022Mass-Editing Memory in a Transformercited by 976
  9. 2022Toy Models of Superpositioncited by 928
  10. 2023Steering Language Models With Activation Engineeringcited by 824
  11. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  12. 2017Safe Reinforcement Learning via Shieldingcited by 427
26 more
  1. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
  2. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 328
  3. 2023Function Vectors in Large Language Modelscited by 292
  4. 2024ReFT: Representation Finetuning for Language Modelscited by 186
  5. 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 175
  6. 2024Aligning Large Language Models with Representation Editing: A Control Perspectivecited by 62
  7. 2024Representation Surgery: Theory and Practice of Affine Steeringcited by 47
  8. 2024Activation Scaling for Steering and Interpreting Language Modelscited by 33
  9. 2019Neural Simplex Architecturecited by 27
  10. 2025To Steer or Not to Steer? Mechanistic Error Reduction with Abstention for Language Modelscited by 26
  11. 2025HyperSteer: Activation Steering at Scale with Hypernetworkscited by 20
  12. 2023Selective Generation for Controllable Language Modelscited by 15
  13. 2025Activation Steering with a Feedback Controllercited by 11
  14. 2025Preemptive Detection and Steering of LLM Misalignment via Latent Reachabilitycited by 10
  15. 2026Steering Vector Fields for Context-Aware Inference-Time Control in Large Language Modelscited by 10
  16. 2025In-Distribution Steering: Balancing Control and Coherence in Language Model Generationcited by 8
  17. 2026On the Non-Identifiability of Steering Vectors in Large Language Modelscited by 8
  18. 2026Local Linearity of LLMs Enables Activation Steering via Model-Based Linear Optimal Controlcited by 8
  19. 2026Steer2Adapt: Dynamically Composing Steering Vectors Elicits Efficient Adaptation of LLMscited by 7
  20. 2026ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoningcited by 6
  21. 2026Contextual Linear Activation Steering of Language Modelscited by 4
  22. 2026Deployable Per-Instance Multi-Layer Activation Steering for Large Language Modelscited by 2
  23. 2026What Does Activation Steering Control? Attribution Across Answer Encodings and Output-Sensitive Subspacescited by 1
  24. 2026SteerCheck: Attribution Specificity and Alignment Leakage in Activation-Steering Auditscited by 1
  25. 2026One Model, Many Minds: Unlocking Multi-Agent Synergy in a Single Agent via Mixture of Rolescited by 1
  26. 2026ObserverBench: Testing Mechanistic Estimates for Intervention and Controlcited by 1

Built on by

Not cited yet.