Entropic-Time Inference: Self-Organizing Large Language Model Decoding Beyond Attention
Not on the map. Why?
Abstract (arXiv)
Modern large language model (LLM) inference engines optimize throughput and latency under fixed decoding rules, treating generation as a linear progression in token time. We propose a fundamentally different paradigm: entropic-time inference, where decoding is governed by the flow of uncertainty rather than token index. We introduce a self-organizing inference architecture that jointly couples scheduling, attention sparsification, and sampling temperature under a unified entropy control objective. Our method extends vLLM with entropy-aware scheduling, entropic pruning of paged attention blocks, and adaptive temperature control that stabilizes generation near a target entropy regime. This transforms inference into a resource-intelligent thermodynamic process that allocates computation where uncertainty reduction is maximized. We present a concrete systems design, pseudocode, and integration plan, demonstrating how entropy can serve as a first-class control signal for scalable LLM inference.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
10 of 25 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2019Generating Long Sequences with Sparse Transformerscited by 1,523
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 479
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Entropy-informed Decoding: Adaptive Information-Driven Branching
- 2026Think Twice Before You Write -- an Entropy-based Decoding Strategy to Enhance LLM Reasoning
- 2024Accelerating Large Language Model Inference with Self-Supervised Early Exits
- 2026Compute Where it Counts: Self Optimizing Language Models
- 2025Entropy Adaptive Decoding: Dynamic Model Switching for Efficient Inference
- 2026Top-b: Entropic Regulation of Relative Probability Bands in Autoregressive Language Processes
- 2025EntroLLM: Entropy Encoded Weight Compression for Efficient Large Language Model Inference on Edge Devices
- 2024Entropy Guided Extrapolative Decoding to Improve Factuality in Large Language Models