mlsanityData to 14 Oct 2026

Automating the Application of HCI Principles: Skills for On-Demand UI Construction, the Human-AI Space to Think, and the Future of HCI

arXiv 2610.02369 ↗First posted 1 Oct 2026cs.HC cs.AIcited by 0

New in LLM reasoning; no direction yet. LLM reasoning

Abstract (arXiv)

Human-computer interaction (HCI) is in the middle of a transition: large language models can now generate functional user interfaces (UIs) on demand from natural-language task descriptions. A user explains what they are trying to accomplish, and the system materializes a working interface to support it. This capability already exists in systems such as Claude and ChatGPT and continues to grow in fidelity as the underlying models improve. The next step along this trajectory is to move from interfaces that are merely generated to interfaces that are generated well. We propose a framework in which the dialogue between user and artificial intelligence (AI) becomes a Space to Think: a shared, structured cognitive workspace in which task decomposition produces an on-demand user interface as an extension of the user's thinking rather than as a separate artifact. Within this paradigm, classical HCI design knowledge (Nielsen's heuristics, Norman's affordance prescriptions, Web Content Accessibility Guidelines (WCAG) success criteria, cognitive-load constraints, and mixed-initiative principles) is encoded as skills: machine-readable skill.md files that the generating agent loads at runtime as software engineering tools. Skills turn HCI design knowledge into declarative, inspectable, version-controlled, and editable artifacts owned by the HCI community itself so that accessibility, learnability, and consistency become properties of a generative process rather than properties of a finished product. We outline a research agenda depicting a future where the HCI field transitions from today's design and knowledge heuristic checklist towards a future where the craft becomes machine-readable, executable, and open.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 12 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

2 of 12 references.

References · 2

  1. 2025Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Modelcited by 26
  2. 2025Towards a Working Definition of Designing Generative User Interfacescited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfaces
  2. 2026After the Interface: Relocating Human Agency in the Age of Conversational AI ↗
  3. 2025Interaction as Intelligence: Deep Research With Human-AI Partnership
  4. 2026Augmenting Interface Usability Heuristics for Reliable Computer-Use Agents
  5. 2026[MM/AI] Mental Models in Human-AI Interaction: Methods and Challenges in the Generative and Agentic AI Era (Workshop)
  6. 2025Computer-Use Agents as Judges for Generative User Interface
  7. 2025Human-AI Co-Creation: A Framework for Collaborative Design in Intelligent Systems
  8. 2026Governing Reflective Human-AI Collaboration: A Framework for Epistemic Scaffolding and Traceable Reasoning