mlsanityData to 14 Oct 2026

Entropy in Conversational AI: Structured Unpredictability as Inferrable Interiority

arXiv 2609.19044 ↗First posted 20 Jul 2026cs.CL cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Sampling can increase response diversity without producing history-dependent behavior. We formalize a different design target, structured unpredictability, as conditional dependence between an output and a persistent hidden state beyond what an observer can infer from the transcript. A selection layer updates a low-dimensional style-and-attention state from a capacity-limited stream, generates several responses with a fixed base model, and selects for novelty and state affinity. Evaluation uses scripted sequences of independent prompt turns: the base model receives the current turn and rendered state, but not the preceding dialogue; cross-turn dependence resides in the wrapper state and response selector. A synthetic implementation validates the pipeline and matches four prospectively hash-frozen divergence features at point level. In the final real-model grid (mlx-community/Qwen2.5-1.5B-Instruct-4bit; 56 sequences per arm), the mechanism increased lexical novelty over the low-variance and consistency-only controls by 0.073 and 0.023, respectively. Its stylometric-consistency contrast with novelty-matched sampling was equivalent to zero under the registered smallest-effect rule, so the joint novelty-consistency criterion failed. The original two-part accumulation criterion also failed; a revised final-grid contrast, frozen after the powered grid, found higher consistency than the memory-reset ablation (0.028, 95% CI [0.018,0.039]), but does not establish path dependence. Twin separation was not established (0.003, 95% CI [-0.011,0.019]); the mean curve's saturating curvature matched the frozen prediction, which without separation does not support path dependence. Probe-level capability equivalence held within +/-0.10 on a near-ceiling battery, while output quality was not evaluated. All outcomes are machine-scored; no claims about perceived mind or consciousness are tested.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

24 of 33 references.

References · 24

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  3. 2020Learning to summarize from human feedbackcited by 2,588
  4. 2018Hierarchical Neural Story Generationcited by 1,193
  5. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
  6. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  7. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
  8. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
  9. 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
  10. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
  11. 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
  12. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
12 more
  1. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
  2. 2023Role-Play with Large Language Modelscited by 294
  3. 2019What makes a good conversation? How controllable attributes affect human judgmentscited by 140
  4. 2018Language GANs Falling Shortcited by 97
  5. 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 86
  6. 2024Measuring and Controlling Instruction (In)Stability in Language Model Dialogscited by 53
  7. 2025PersonaAgent: Bridging Memory and Action for Personalized LLM Agentscited by 14
  8. 2026SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generationcited by 11
  9. 2025Echoing: Identity Failures when LLM Agents Talk to Each Othercited by 9
  10. 2026ContextEcho: A Benchmark for Persona Drift in Long Agentic-Coding Sessionscited by 5
  11. 2026Scaling Self-Evolving Agents via Parametric Memorycited by 5
  12. 2026Perceived AGI: Believability as Dimensional Completeness, Not Capabilitycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.