mlsanityData to 14 Oct 2026

Rethinking ChatGPT's Success: Usability and Cognitive Behaviors Enabled by Auto-regressive LLMs' Prompting

arXiv 2405.10474 ↗First posted 17 May 2024cs.CLcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Over the last decade, a wide range of training and deployment strategies for Large Language Models (LLMs) have emerged. Among these, the prompting paradigms of Auto-regressive LLMs (AR-LLMs) have catalyzed a significant surge in Artificial Intelligence (AI). This paper aims to emphasize the significance of utilizing free-form modalities (forms of input and output) and verbal free-form contexts as user-directed channels (methods for transforming modalities) for downstream deployment. Specifically, we analyze the structure of modalities within both two types of LLMs and six task-specific channels during deployment. From the perspective of users, our analysis introduces and applies the analytical metrics of task customizability, transparency, and complexity to gauge their usability, highlighting the superior nature of AR-LLMs' prompting paradigms. Moreover, we examine the stimulation of diverse cognitive behaviors in LLMs through the adoption of free-form text and verbal contexts, mirroring human linguistic expressions of such behaviors. We then detail four common cognitive behaviors to underscore how AR-LLMs' prompting successfully imitate human-like behaviors using this free-form modality and channel. Lastly, the potential for improving LLM deployment, both as autonomous agents and within multi-agent systems, is identified via cognitive behavior concepts and principles.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 2 of its 47 references that are in the map. First posted on arXiv 17 May 2024.

Builds on

2 of 47 references.

References · 2

  1. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  2. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  2. 2023Who's Thinking? A Push for Human-Centered Evaluation of LLMs using the XAI Playbook
  3. 2024Comparing Rationality Between Large Language Models and Humans: Insights and Open Questions
  4. 2025Agent-Centric Projection of Prompting Techniques and Implications for Synthetic Training Data for Large Language Models
  5. 2024CogBench: a large language model walks into a psychology lab
  6. 2026Benchmarking LLM Tool-Use in the Wild
  7. 2026Understanding Large Language Models
  8. 2025Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications