CogInstrument: Modeling Cognitive Processes for Bidirectional Human-LLM Alignment in Planning Tasks
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
Although Large Language Models (LLMs) demonstrate proficiency in knowledge-intensive tasks, current interfaces frequently precipitate cognitive misalignment by failing to externalize users' underlying reasoning structures. Existing tools typically represent intent as "flat lists," thereby disregarding the causal dependencies and revisable assumptions inherent in human decision-making. We introduce CogInstrument, a system that represents user reasoning through cognitive motifs-compositional, revisable units comprising concepts linked by causal dependencies. CogInstrument extracts these motifs from natural language interactions and renders them as editable graphical structures to facilitate bidirectional alignment. This structural externalization enables both the user and the LLM to inspect, negotiate, and reconcile reasoning processes iteratively. A within-subjects study (N=12) demonstrates that CogInstrument explicitly surfaces implicit reasoning structures, facilitating more targeted revision and reusability over conventional LLM-based dialogue interfaces. By enabling users to verify the logical grounding of LLM outputs, CogInstrument significantly enhances user agency, trust, and structural control over the collaboration. This work formalizes cognitive motifs as a fundamental unit for human-LLM alignment, providing a novel framework for achieving structured, reasoning-based human-AI collaboration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 15 of its 96 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
15 of 96 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 118
- 2023The Metacognitive Demands and Opportunities of Generative AIcited by 85
- 2023Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfacescited by 71
- 2024Design Principles for Generative AI Applicationscited by 57
- 2025Creating General User Models from Computer Usecited by 44
- 2024Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Makingcited by 38
- 2023CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AIcited by 34
- 2025Simulating Society Requires Simulating Thoughtcited by 12
- 2025AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Toolscited by 8
- 2025Users' Mental Models of Generative AI Chatbot Ecosystemscited by 7
- 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Modelscited by 7
- 2025Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflowscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Cognitive Foundations for Reasoning and Their Manifestation in LLMs
- 2025Reasoning on a Spectrum: Aligning LLMs to System 1 and System 2 Thinking
- 2026Reasoning Gets Harder for LLMs Inside A Dialogue
- 2025Chain-of-Thought as a Lens: Evaluating Structured Reasoning Alignment between Human Preferences and Large Language Models
- 2025Cognition-of-Thought Elicits Social-Aligned Reasoning in Large Language Models
- 2025WHEN TO ACT, WHEN TO WAIT: Modeling the Intent-Action Alignment Problem in Dialogue
- 2026A Context Alignment Pre-processor for Enhancing the Coherence of Human-LLM Dialog
- 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models