Finding RELIEF: Shaping Reasoning Behavior without Reasoning Supervision via Belief Engineering
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large reasoning models (LRMs) have achieved remarkable success in complex problem-solving, yet they often suffer from computational redundancy or reasoning unfaithfulness. Current methods for shaping LRM behavior typically rely on reinforcement learning or fine-tuning with gold-standard reasoning traces, a paradigm that is both computationally expensive and difficult to scale. In this paper, we reveal that LRMs possess latent textitreasoning beliefs that internally track their own reasoning traits, which can be captured through simple logit probing. Building upon this insight, we propose Reasoning Belief Engineering (RELIEF), a simple yet effective framework that shapes LRM behavior by aligning the model's self-concept with a target belief blueprint. Crucially, RELIEF completely bypasses the need for reasoning-trace supervision. It internalizes desired traits by fine-tuning on synthesized, self-reflective question-answering pairs that affirm the target belief. Extensive experiments on efficiency and faithfulness tasks demonstrate that RELIEF matches or outperforms behavior-supervised and preference-based baselines while requiring lower training costs. Further analysis validates that shifting a model's reasoning belief effectively shapes its actual behavior.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 24 of its 39 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
24 of 39 references.
Closest ancestors · 7
Same direction, newest first
- 2025Test-time Prompt Intervention4 Aug
- 2025Learn to Reason Efficiently with Adaptive Length-based Reward Shaping21 May
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
- 2025Self-Training Elicits Concise Reasoning in Large Language Models27 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
Other references · 17
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2025LIMO: Less is More for Reasoningcited by 488
- 2025Reasoning Models Don't Always Say What They Thinkcited by 388
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 338
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2025Training Language Models to Reason Efficientlycited by 242
- 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 100
- 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in datacited by 89
- 2025Persona Features Control Emergent Misalignmentcited by 76
- 2025School of Reward Hacks: Hacking harmless tasks generalizes to misaligned behavior in LLMscited by 58
5 more
- 2025Thought Crime: Backdoors and Emergent Misalignment in Reasoning Modelscited by 57
- 2025Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMscited by 47
- 2025Teaching Models to Verbalize Reward Hacking in Chain-of-Thought Reasoningcited by 19
- 2025Believe It or Not: How Deeply do LLMs Believe Implanted Facts?cited by 19
- 2023Tell, don't show: Declarative facts influence how LLMs generalizecited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures
- 2025Thinking Out Loud: Do Reasoning Models Know When They're Right?
- 2026RFEval: Benchmarking Reasoning Faithfulness under Counterfactual Reasoning Intervention in Large Reasoning Models
- 2025Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories
- 2026CAT: Confidence-Adaptive Thinking for Efficient Reasoning of Large Reasoning Models
- 2025Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement
- 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning
- 2025Think How to Think: Mitigating Overthinking with Autonomous Difficulty Cognition in Large Reasoning Models