Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responses
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language model (LLM) powered chatbots are primarily text-based today, and impose a large interactional cognitive load, especially for exploratory or sensemaking tasks such as planning a trip or learning about a new city. Because the interaction is textual, users have little scaffolding in the way of structure, informational "scent", or ability to specify high-level preferences or goals. We introduce ExploreLLM that allows users to structure thoughts, help explore different options, navigate through the choices and recommendations, and to more easily steer models to generate more personalized responses. We conduct a user study and show that users find it helpful to use ExploreLLM for exploratory or planning tasks, because it provides a useful schema-like structure to the task, and guides users in planning. The study also suggests that users can more easily personalize responses with high-level preferences with ExploreLLM. Together, ExploreLLM points to a future where users interact with LLMs beyond the form of chatbots, and instead designed to support complex user tasks with a tighter integration between natural language and graphical user interfaces.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 19 of its 57 references that are in the map. First posted on arXiv 1 Dec 2023.
Builds on
19 of 57 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2023Large Language Models as Optimizerscited by 830
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
- 2023Large Language Models as Tool Makerscited by 293
- 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 157
6 more
- 2023Branch-Solve-Merge Improves Large Language Model Evaluation and Generationcited by 104
- 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 65
- 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
- 2023Improving Diversity of Demographic Representation in Large Language Models via Collective-Critiques and Self-Votingcited by 46
- 2023Understanding Users' Dissatisfaction with ChatGPT Responses: Types, Resolving Tactics, and the Effect of Knowledge Levelcited by 26
- 2023Let's Do a Thought Experiment: Using Counterfactuals to Improve Moral Reasoningcited by 20
Built on by
Citing papers per year: 2024: 11; 2025: 6; 2026: 1.
18 papers.
Sort:
By area:
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2024Aligning to Thousands of Preferences via System Message Generalizationcited by 84
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AIcited by 39
- 2024TravelAgent: An AI Assistant for Personalized Travel Planningcited by 38
- 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 38
- 2024SysBench: Can Large Language Models Follow System Messages?cited by 26
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 19
- 2024Multi-Agents are Social Groups: Investigating Social Influence of Multiple Agents in Human-Agent Interactionscited by 16
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
- 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Makingcited by 9
- 2024Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivationcited by 7
- 2024ChainBuddy: An AI Agent System for Generating LLM Pipelinescited by 6
6 more
- 2024The Evolution of LLM Adoption in Industry Data Curation Practicescited by 6
- 2024Enhancing Supermarket Robot Interaction: A Multi-Level LLM Conversational Interface for Handling Diverse Customer Intentscited by 5
- 2025Generative Interfaces for Language Modelscited by 5
- 2024Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Taskscited by 4
- 2025ACAI for SBOs: AI Co-creation for Advertising and Inspiration for Small Business Ownerscited by 2
- 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planningcited by 0
- 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning4 May 2026
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation29 Oct 2025
- 2025Generative Interfaces for Language Models26 Aug 2025
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI26 May 2025
- 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Making24 Mar 2025
- 2025ACAI for SBOs: AI Co-creation for Advertising and Inspiration for Small Business Owners9 Mar 2025
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planning25 Feb 2025
- 2024The Evolution of LLM Adoption in Industry Data Curation Practices20 Dec 2024
- 2024Cocoa: Co-Planning and Co-Execution with AI Agents14 Dec 2024
- 2024Multi-Agents are Social Groups: Investigating Social Influence of Multiple Agents in Human-Agent Interactions7 Nov 2024
- 2024Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Tasks31 Oct 2024
- 2024ChainBuddy: An AI Agent System for Generating LLM Pipelines20 Sep 2024
6 more
- 2024TravelAgent: An AI Assistant for Personalized Travel Planning12 Sep 2024
- 2024SysBench: Can Large Language Models Follow System Messages?20 Aug 2024
- 2024Enhancing Supermarket Robot Interaction: A Multi-Level LLM Conversational Interface for Handling Diverse Customer Intents16 Jun 2024
- 2024Aligning to Thousands of Preferences via System Message Generalization28 May 2024
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agents28 Apr 2024
- 2024Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivation12 Feb 2024
- 2024TravelAgent: An AI Assistant for Personalized Travel Planningcited by 38
- 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 38
- 2024SysBench: Can Large Language Models Follow System Messages?cited by 26
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 19
- 2024Multi-Agents are Social Groups: Investigating Social Influence of Multiple Agents in Human-Agent Interactionscited by 16
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
- 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Makingcited by 9
- 2024Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivationcited by 7
- 2024The Evolution of LLM Adoption in Industry Data Curation Practicescited by 6
- 2024Enhancing Supermarket Robot Interaction: A Multi-Level LLM Conversational Interface for Handling Diverse Customer Intentscited by 5
- 2025Generative Interfaces for Language Modelscited by 5
- 2024Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Taskscited by 4
12 most cited of 14 All 14 (JSON)
- 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning4 May 2026
- 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation29 Oct 2025
- 2025Generative Interfaces for Language Models26 Aug 2025
- 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Making24 Mar 2025
- 2025ACAI for SBOs: AI Co-creation for Advertising and Inspiration for Small Business Owners9 Mar 2025
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planning25 Feb 2025
- 2024The Evolution of LLM Adoption in Industry Data Curation Practices20 Dec 2024
- 2024Cocoa: Co-Planning and Co-Execution with AI Agents14 Dec 2024
- 2024Multi-Agents are Social Groups: Investigating Social Influence of Multiple Agents in Human-Agent Interactions7 Nov 2024
- 2024Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Tasks31 Oct 2024
- 2024TravelAgent: An AI Assistant for Personalized Travel Planning12 Sep 2024
- 2024SysBench: Can Large Language Models Follow System Messages?20 Aug 2024
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Eliciting Human Preferences with Language Models
- 2025SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs
- 2024Rethinking ChatGPT's Success: Usability and Cognitive Behaviors Enabled by Auto-regressive LLMs' Prompting
- 2025CUPID: Evaluating Personalized and Contextualized Alignment of LLMs from Interactions
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
- 2024How to Align Large Language Models for Teaching English? Designing and Developing LLM based-Chatbot for Teaching English Conversation in EFL, Findings and Limitations
- 2025Do LLMs Recognize Your Latent Preferences? A Benchmark for Latent Information Discovery in Personalized Interaction
- 2024Comparing the Utility, Preference, and Performance of Course Material Search Functionality and Retrieval-Augmented Generation Large Language Model (RAG-LLM) AI Chatbots in Information-Seeking Tasks