mlsanityData to 7 Oct 2026

Entropic-Time Inference: Self-Organizing Large Language Model Decoding Beyond Attention

arXiv 2603.03310 ↗First posted 8 Feb 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern large language model (LLM) inference engines optimize throughput and latency under fixed decoding rules, treating generation as a linear progression in token time. We propose a fundamentally different paradigm: entropic-time inference, where decoding is governed by the flow of uncertainty rather than token index. We introduce a self-organizing inference architecture that jointly couples scheduling, attention sparsification, and sampling temperature under a unified entropy control objective. Our method extends vLLM with entropy-aware scheduling, entropic pruning of paged attention blocks, and adaptive temperature control that stabilizes generation near a target entropy regime. This transforms inference into a resource-intelligent thermodynamic process that allocates computation where uncertainty reduction is maximized. We present a concrete systems design, pseudocode, and integration plan, demonstrating how entropy can serve as a first-class control signal for scalable LLM inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

10 of 25 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  3. 2017On Calibration of Modern Neural Networkscited by 4,860
  4. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  6. 2020Longformer: The Long-Document Transformercited by 3,362
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  8. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  9. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  10. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 479

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Entropy-informed Decoding: Adaptive Information-Driven Branching
  2. 2026Think Twice Before You Write -- an Entropy-based Decoding Strategy to Enhance LLM Reasoning
  3. 2024Accelerating Large Language Model Inference with Self-Supervised Early Exits
  4. 2026Compute Where it Counts: Self Optimizing Language Models
  5. 2025Entropy Adaptive Decoding: Dynamic Model Switching for Efficient Inference
  6. 2026Top-b: Entropic Regulation of Relative Probability Bands in Autoregressive Language Processes
  7. 2025EntroLLM: Entropy Encoded Weight Compression for Efficient Large Language Model Inference on Edge Devices
  8. 2024Entropy Guided Extrapolative Decoding to Improve Factuality in Large Language Models