Heaviside Continuity of Rolling Coefficients for Eliminating Epistemic Entropy in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) generate fluent outputs that can be wrong. Unlike humans, who often exhibit cues when providing false information, LLMs produce errors that are difficult to detect because autoregressive decoding provides no mechanism for verifying intermediate reasoning before state progression. We introduce Heaviside Continuity of Rolling Coefficients (HCRC), a verification-first execution framework that reformulates inference as predicate-gated state transitions governed by a Heaviside Gate. HCRC combines model confidence with independent verification signals from a parallel worker architecture, allowing execution to advance only when predefined correctness predicates are satisfied. This prevents invalid intermediate states from propagating, reducing epistemic entropy without modifying the underlying model. We evaluate HCRC on software-engineering and reasoning tasks across thirteen proposers from four providers. On capable proposers, the gate reduces the false-completion rate (FCR) from 4--7% to 0% while remaining latency-competitive and, in some settings, faster than the unwrapped model. On weaker proposers, it converts false completions into honest halts instead of corrupting downstream state. Beyond benchmarking, HCRC has operated for months as the production control plane of an agentic coding environment, authorizing file mutations, verification-driven progress reporting, and memory compaction. These results establish HCRC as a general framework for verification-driven LLM execution, showing that reliable reasoning can be achieved through principled execution control rather than model scale alone.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
43 of 51 references.
References · 43
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
31 more
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2016Concrete Problems in AI Safetycited by 1,582
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2018AI safety via debatecited by 384
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
- 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 200
- 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 191
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
- 2023Calibrated Language Models Must Hallucinatecited by 114
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Blast Radiuscited by 0
- 2026Blast Radius7 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Dissecting Failure Dynamics in Large Language Model Reasoning
- 2026Enhancing reasoning accuracy in large language models during inference time
- 2025Think Just Enough: Sequence-Level Entropy as a Confidence Signal for LLM Reasoning
- 2026TRUE: A Trustworthy Unified Explanation Framework for Large Language Model Reasoning
- 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
- 2025Patterns Over Principles: The Fragility of Inductive Reasoning in LLMs under Noisy Observations
- 2025The Sequential Edge: Inverse-Entropy Voting Beats Parallel Self-Consistency at Matched Compute
- 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification