An Information-Geometric Framework for Stability Analysis of Large Language Models under Entropic Stress
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) are increasingly deployed in high-stakes and operational settings, evaluation strategies based solely on aggregate accuracy are often insucient to characterize system reliability. This study proposes a thermodynamic inspired modeling framework for analyzing the stability of LLM outputs under conditions of uncertainty and perturbation. The framework introduces a composite stability score that integrates task utility, entropy as a measure of external uncertainty, and two internal structural proxies: internal integration and aligned reective capacity. Rather than interpreting these quantities as physical variables, the formulation is intended as an interpretable abstraction that captures how internal structure may modulate the impact of disorder on model behavior. Using the IST-20 benchmarking protocol and associated metadata, we analyze 80 modelscenario observations across four contemporary LLMs. The proposed formulation consistently yields higher stability scores than a reduced utilityentropy baseline, with a mean improvement of 0.0299 (95% CI: 0.02470.0351). The observed gain is more pronounced under higher entropy conditions, suggesting that the framework captures a form of nonlinear attenuation of uncertainty. We do not claim a fundamental physical law or a complete theory of machine ethics. Instead, the contribution of this work is a compact and interpretable modeling perspective that connects uncertainty, performance, and internal structure within a unied evaluation lens. The framework is intended to complement existing benchmarking approaches and to support ongoing discussions in AI safety, reliability, and governance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 24 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
11 of 24 references.
References · 11
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
- 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 256
- 2024Factuality of Large Language Models: A Surveycited by 66
- 2025MetaFaith: Faithful Natural Language Uncertainty Expression in LLMscited by 16
- 2024FactAlign: Long-form Factuality Alignment of Large Language Modelscited by 12
Built on by
Not cited yet.