mlsanityData to 14 Oct 2026

Thinkink: 2D Spatial Ink-native Interaction with LLMs

arXiv 2607.21468 ↗First posted 23 Jul 2026cs.HC cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

People often use handwritten notes and sketches to externalize ideas for ideation. To integrate large language models (LLMs) into this practice, we propose Thinkink. Prompts can be handwritten text or drawn sketches with LLM-generated responses visualized as ink-like text and sketches spatially integrated into a shared canvas. A semantic tree streamlines ink interpretation, and a lightweight UI provides explicit control using a state machine. The tool was designed using a three-stage process. A formative study (N=12) examined current practices with conventional and digital inking methods. The results informed a technical probe for a diagnostic study (N=6) identifying usability and human-LLM interaction challenges. This motivated the design of Thinkink, with a final study (N=10) examining how people incorporate it into their ideation practices. We contribute design implications and a tool for ink-native LLM interaction where the user and LLM write and draw in a shared 2D canvas.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 2 of its 45 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

2 of 45 references.

References · 2

  1. 2023LLMs as Potential Brainstorming Partners for Math and Science Problemscited by 6
  2. 2025InkFM: A Foundational Model for Full-Page Online Handwritten Note Understandingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024SketchAgent: Language-Driven Sequential Sketch Generation
  2. 2025Do Conversational Interfaces Limit Creativity? Exploring Visual Graph Systems for Creative Writing
  3. 2024A Framework for Collaborating a Large Language Model Tool in Brainstorming for Triggering Creative Thoughts
  4. 2025Insights into User Interface Innovations from a Design Thinking Workshop at deRSE25
  5. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  6. 2024Visual Prompting with Iterative Refinement for Design Critique Generation
  7. 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generation
  8. 2026State of the Art of LLM-Enabled Interaction with Visualization ↗