NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification
Not on the map. Why?
Abstract (arXiv)
Conversational LLMs have been widely adopted by domain users with limited programming experience to solve domain problems. However, these users often face misalignment between their intent and generated code, resulting in frustration and rounds of clarification. This work first investigates the cause of this misalignment, which dues to bidirectional ambiguity: both user intents and coding tasks are inherently nonlinear, yet must be expressed and interpreted through linear prompts and code sequences. To address this, we propose direct intent-task matching, a new human-LLM interaction paradigm that externalizes and enables direct manipulation of the LLM understanding, i.e., the coding tasks and their relationships inferred by the LLM prior to code generation. As a proof-of-concept, this paradigm is then implemented in NeuroSync, which employs a knowledge distillation pipeline to extract LLM understanding, user intents, and their mappings, and enhances the alignment by allowing users to intuitively inspect and edit them via visualizations. We evaluate the algorithmic components of NeuroSync via technical experiments, and assess its overall usability and effectiveness via a user study (N=12). The results show that it enhances intent-task alignment, lowers cognitive effort, and improves coding efficiency.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 78 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
41 of 78 references.
References · 41
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
- 2022A Survey on In-context Learningcited by 721
- 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 599
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 268
- 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
29 more
- 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
- 2023Chain of Code: Reasoning with a Language Model-Augmented Code Emulatorcited by 123
- 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
- 2024Reinforcement Learning for LLM Post-Training: A Surveycited by 92
- 2022Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programmingcited by 91
- 2023The Metacognitive Demands and Opportunities of Generative AIcited by 87
- 2023Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfacescited by 72
- 2023Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creationcited by 64
- 2023Large Language Models Are Not Strong Abstract Reasonerscited by 53
- 2023"What It Wants Me To Say": Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Modelscited by 48
- 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
- 2023VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototypingcited by 46
- 2023Large Language Model-Aware In-Context Learning for Code Generationcited by 43
- 2022What is it like to program with artificial intelligence?cited by 39
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 39
- 2023DirectGPT: A Direct Manipulation Interface to Interact with Large Language Modelscited by 32
- 2023B-Coder: Value-Based Deep Reinforcement Learning for Program Synthesiscited by 17
- 2024KNOWNET: Guided Health Information Seeking from LLMs via Knowledge Graph Integrationcited by 15
- 2024Ivie: Lightweight Anchored Explanations of Just-Generated Codecited by 14
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanationscited by 10
- 2023Validating AI-Generated Code with Live Programmingcited by 8
- 2017Interactive Program Synthesiscited by 6
- 2024Data Playwright: Authoring Data Videos with Annotated Narrationcited by 6
- 2025Reflecting on Design Paradigms of Animated Data Video Toolscited by 6
- 2025Prompting Generative AI with Interaction-Augmented Instructionscited by 4
- 2020Scalability of Network Visualisation from a Cognitive Load Perspectivecited by 3
- 2022Graph Exploration with Embedding-Guided Layoutscited by 3
- 2024NotePlayer: Engaging Jupyter Notebooks for Dynamic Presentation of Analytical Processescited by 2
- 2024Mindalogue: LLM-Powered Nonlinear Interaction for Effective Learning and Task Explorationcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025DesignerlyLoop: Forming Design Intent through Curated Reasoning for Human-LLM Alignmentcited by 1
- 2026Semantic Prompting: Agentic Incremental Narrative Refinement through Spatial Semantic Interactioncited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026Semantic Prompting: Agentic Incremental Narrative Refinement through Spatial Semantic Interaction21 Apr 2026
- 2025DesignerlyLoop: Forming Design Intent through Curated Reasoning for Human-LLM Alignment19 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025A Survey of LLM Alignment: Instruction Understanding, Intention Reasoning, and Reliable Generation
- 2024LLM With Tools: A Survey
- 2024Code Prompting Elicits Conditional Reasoning Abilities in Text+Code LLMs
- 2025From Context to Intent: Reasoning-Guided Function-Level Code Completion
- 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents
- 2025CODE-DITING: A Reasoning-Based Metric for Functional Alignment in Code Evaluation
- 2024Rethinking ChatGPT's Success: Usability and Cognitive Behaviors Enabled by Auto-regressive LLMs' Prompting
- 2026Neuro-Symbolic Verification on Instruction Following of LLMs