mlsanityData to 7 Oct 2026

Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responses

arXiv 2312.00763 ↗First posted 1 Dec 2023cs.HC cs.AI cs.CLcited by 18

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language model (LLM) powered chatbots are primarily text-based today, and impose a large interactional cognitive load, especially for exploratory or sensemaking tasks such as planning a trip or learning about a new city. Because the interaction is textual, users have little scaffolding in the way of structure, informational "scent", or ability to specify high-level preferences or goals. We introduce ExploreLLM that allows users to structure thoughts, help explore different options, navigate through the choices and recommendations, and to more easily steer models to generate more personalized responses. We conduct a user study and show that users find it helpful to use ExploreLLM for exploratory or planning tasks, because it provides a useful schema-like structure to the task, and guides users in planning. The study also suggests that users can more easily personalize responses with high-level preferences with ExploreLLM. Together, ExploreLLM points to a future where users interact with LLMs beyond the form of chatbots, and instead designed to support complex user tasks with a tighter integration between natural language and graphical user interfaces.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 19 of its 57 references that are in the map. First posted on arXiv 1 Dec 2023.

Builds on

19 of 57 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Measuring and Narrowing the Compositionality Gap in Language Models7 Oct

Other references · 18

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  6. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  7. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  8. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  9. 2023Large Language Models as Optimizerscited by 830
  10. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
  11. 2023Large Language Models as Tool Makerscited by 293
  12. 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 157
6 more
  1. 2023Branch-Solve-Merge Improves Large Language Model Evaluation and Generationcited by 104
  2. 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 65
  3. 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
  4. 2023Improving Diversity of Demographic Representation in Large Language Models via Collective-Critiques and Self-Votingcited by 46
  5. 2023Understanding Users' Dissatisfaction with ChatGPT Responses: Types, Resolving Tactics, and the Effect of Knowledge Levelcited by 26
  6. 2023Let's Do a Thought Experiment: Using Counterfactuals to Improve Moral Reasoningcited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 11; 2025: 6; 2026: 1.

18 papers.

Sort:

By area:

  1. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  2. 2024Aligning to Thousands of Preferences via System Message Generalizationcited by 84
  3. 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AIcited by 39
  4. 2024TravelAgent: An AI Assistant for Personalized Travel Planningcited by 38
  5. 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 38
  6. 2024SysBench: Can Large Language Models Follow System Messages?cited by 26
  7. 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 19
  8. 2024Multi-Agents are Social Groups: Investigating Social Influence of Multiple Agents in Human-Agent Interactionscited by 16
  9. 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
  10. 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Makingcited by 9
  11. 2024Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivationcited by 7
  12. 2024ChainBuddy: An AI Agent System for Generating LLM Pipelinescited by 6
6 more
  1. 2024The Evolution of LLM Adoption in Industry Data Curation Practicescited by 6
  2. 2024Enhancing Supermarket Robot Interaction: A Multi-Level LLM Conversational Interface for Handling Diverse Customer Intentscited by 5
  3. 2025Generative Interfaces for Language Modelscited by 5
  4. 2024Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Taskscited by 4
  5. 2025ACAI for SBOs: AI Co-creation for Advertising and Inspiration for Small Business Ownerscited by 2
  6. 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Eliciting Human Preferences with Language Models
  2. 2025SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs
  3. 2024Rethinking ChatGPT's Success: Usability and Cognitive Behaviors Enabled by Auto-regressive LLMs' Prompting
  4. 2025CUPID: Evaluating Personalized and Contextualized Alignment of LLMs from Interactions
  5. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
  6. 2024How to Align Large Language Models for Teaching English? Designing and Developing LLM based-Chatbot for Teaching English Conversation in EFL, Findings and Limitations
  7. 2025Do LLMs Recognize Your Latent Preferences? A Benchmark for Latent Information Discovery in Personalized Interaction
  8. 2024Comparing the Utility, Preference, and Performance of Course Material Search Functionality and Retrieval-Augmented Generation Large Language Model (RAG-LLM) AI Chatbots in Information-Seeking Tasks