mlsanityData to 7 Oct 2026

Heaviside Continuity of Rolling Coefficients for Eliminating Epistemic Entropy in Large Language Models

arXiv 2607.04562 ↗First posted 6 Jul 2026cs.AI cs.NEcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) generate fluent outputs that can be wrong. Unlike humans, who often exhibit cues when providing false information, LLMs produce errors that are difficult to detect because autoregressive decoding provides no mechanism for verifying intermediate reasoning before state progression. We introduce Heaviside Continuity of Rolling Coefficients (HCRC), a verification-first execution framework that reformulates inference as predicate-gated state transitions governed by a Heaviside Gate. HCRC combines model confidence with independent verification signals from a parallel worker architecture, allowing execution to advance only when predefined correctness predicates are satisfied. This prevents invalid intermediate states from propagating, reducing epistemic entropy without modifying the underlying model. We evaluate HCRC on software-engineering and reasoning tasks across thirteen proposers from four providers. On capable proposers, the gate reduces the false-completion rate (FCR) from 4--7% to 0% while remaining latency-competitive and, in some settings, faster than the unwrapped model. On weaker proposers, it converts false completions into honest halts instead of corrupting downstream state. Beyond benchmarking, HCRC has operated for months as the production control plane of an agentic coding environment, authorizing file mutations, verification-driven progress reporting, and memory compaction. These results establish HCRC as a general framework for verification-driven LLM execution, showing that reliable reasoning can be achieved through principled execution control rather than model scale alone.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

43 of 51 references.

References · 43

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  8. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  9. 2017On Calibration of Modern Neural Networkscited by 4,860
  10. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  11. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  12. 2023Let's Verify Step by Stepcited by 3,598
31 more
  1. 2021Program Synthesis with Large Language Modelscited by 3,509
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  7. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  8. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  9. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  10. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  12. 2016Concrete Problems in AI Safetycited by 1,582
  13. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  14. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  15. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  16. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  17. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  18. 2023Teaching Large Language Models to Self-Debugcited by 963
  19. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  20. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  21. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  22. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  23. 2018AI safety via debatecited by 384
  24. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
  25. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
  26. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
  27. 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
  28. 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 200
  29. 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 191
  30. 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
  31. 2023Calibrated Language Models Must Hallucinatecited by 114

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Blast Radiuscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Dissecting Failure Dynamics in Large Language Model Reasoning
  2. 2026Enhancing reasoning accuracy in large language models during inference time
  3. 2025Think Just Enough: Sequence-Level Entropy as a Confidence Signal for LLM Reasoning
  4. 2026TRUE: A Trustworthy Unified Explanation Framework for Large Language Model Reasoning
  5. 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
  6. 2025Patterns Over Principles: The Fragility of Inductive Reasoning in LLMs under Noisy Observations
  7. 2025The Sequential Edge: Inverse-Entropy Voting Beats Parallel Self-Consistency at Matched Compute
  8. 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification