mlsanityData to 14 Oct 2026

You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model

arXiv 2608.14465 ↗First posted 14 Aug 2026cs.CL cs.LGcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

A frozen language model on reasoning tasks has two coupled weaknesses: it under-uses evidence its own residual stream already encodes, and it fails to detect when the input is insufficient to answer, so it confabulates. This paper consolidates two research lines that address these on the same residual stream: a conditional steering probe writes the stream at mid-stack layers and recovers reasoning accuracy from a frozen backbone, and a zero-shot sufficiency direction reads the stream and abstains when information is insufficient. Deployed in one forward pass they interfere: the steering write shifts the state the direction reads, costing up to 8 AUROC points of cross-domain transfer on small models; a separate clean pass doubles inference cost. We keep the direction fixed and train a small network to reconstruct the pre-steering residual from the steered one -- mean-squared error on (steered, clean) pairs, no sufficiency labels -- and read the direction on the reconstruction. The resulting system, YOPO (You Only Pass Once), answers, steers, and abstains in one forward pass of a frozen Qwen2.5 backbone (1.5B/3B/7B). End to end, three-way accuracy more than doubles the frozen baseline (0.375->0.798 on 1.5B alphaNLI) and one pass beats the two-pass reference at every scale (0.798/0.830/0.893 vs 0.753/0.790/0.863) and on ten backbones across six model families. We chart the capacity-transfer frontier quantifying the principle that abstention should not be trained in; a source-side audit catches our own alphaNLI construction leaking a surface artifact, so architectural claims are anchored on native-label replications (SQuAD2, RepLiQA, MuSiQue); and on the standard four-domain suite we contribute, to our knowledge, the first answer-or-abstain benchmark, where our gate tops every in-domain dataset and the label-free direction is the only gate family to survive domain transfer.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 18 of its 23 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

18 of 23 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Language Models (Mostly) Know What They Know11 Jul

Other references · 17

  1. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  2. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  3. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  4. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  5. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  6. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  7. 2022Editing Models with Task Arithmeticcited by 1,120
  8. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  9. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
  10. 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 533
  11. 2023Function Vectors in Large Language Modelscited by 308
  12. 2019Abductive Commonsense Reasoningcited by 301
5 more
  1. 2024Programming Refusal with Conditional Activation Steeringcited by 206
  2. 2024ReFT: Representation Finetuning for Language Modelscited by 197
  3. 2023The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Modelscited by 55
  4. 2024RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Contentcited by 26
  5. 2025Detecting (Un)answerability in Large Language Models with Linear Directionscited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Latent Recurrent Thoughts: Recurrent Refinement of Proposed Latents for Reasoning with Frozen LLMs
  2. 2026Enhancing reasoning accuracy in large language models during inference time
  3. 2026INTACT: Inducing Latent Reasoning on a Frozen Backbone
  4. 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
  5. 2026A Frozen 12B Beats Frontier Models on Verified Work: 100% Accuracy, 0 Tokens, Bit-Exact, Forever
  6. 2025KV Cache Steering for Controlling Frozen LLMs
  7. 2026Can Language Models Learn to Reject Their Own Bad Reasoning Steps?
  8. 2026Routing by Reasoning Need: Trajectory-Aware Decoding Control for Diffusion Vision-Language Models