mlsanityData to 14 Oct 2026

In Dialogue with Intelligence: Rethinking Large Language Models as Collective Knowledge

arXiv 2505.22767 ↗First posted 28 May 2025cs.HC cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Dialogue with a large language model can lead a person to insight: a sudden change in how they understand a problem. This perspective asks how model activity relates to insight as a dialogue unfolds. I propose that part of the intelligence expressed in dialogue arises from two interacting recurrences: each generated token becomes context for the next, and each response returns through the person, whose interpretation and new observations reshape what the model receives. Within this loop, the model's contribution shifts between modes, from echoing familiar formulations to offering a framing that opens a new direction for the person to develop. These modes may correspond to distinguishable patterns of model activity. A memory "spine" that selects which context is carried forward could elicit productive patterns again while the ideas themselves change. Public records of human-model dialogue, activity recorded from open-weight models and tools from computational neuroscience make these proposals testable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 26 of its 55 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

26 of 55 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct

Other references · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  8. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  9. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  10. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  11. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  12. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
13 more
  1. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
  2. 2023Cognitive Architectures for Language Agentscited by 429
  3. 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
  4. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
  5. 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
  6. 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 106
  7. 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
  8. 2024Building Machines that Learn and Think with Peoplecited by 73
  9. 2024From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuningcited by 54
  10. 2024Transforming Agency. On the mode of existence of Large Language Modelscited by 7
  11. 2024Noise-Aware Training of Neuromorphic Dynamic Device Networkscited by 5
  12. 2024Steering Large Language Models to Evaluate and Amplify Creativitycited by 4
  13. 2024Generative midtended cognition and Artificial Intelligence. Thinging with thinging thingscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates
  2. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thought
  3. 2024Language Models in Dialogue: Conversational Maxims for Human-AI Interactions
  4. 2024Generative Emergent Communication: Large Language Model is a Collective World Model
  5. 2025LLMs and their Limited Theory of Mind: Evaluating Mental State Annotations in Situated Dialogue
  6. 2026Understanding Large Language Models
  7. 2025On the Thinking-Language Modeling Gap in Large Language Models
  8. 2025WHEN TO ACT, WHEN TO WAIT: Modeling the Intent-Action Alignment Problem in Dialogue