mlsanityData to 14 Oct 2026

Affora: A Design System for Agent-Friendly Interfaces

arXiv 2609.19125 ↗First posted 16 Sep 2026cs.HC cs.AI cs.SEcited by 0

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Computer-use agents increasingly operate software designed for people, but interfaces often leave actions or task state unclear to machine readers. We present Affora, a design system that supports both readers while preserving visual freedom and familiar human workflows. Three controlled studies examine component implementations, visual variation, and interaction-design principles. Their findings inform guidance from individual components to complete sites, supported by reusable implementations and executable checks. Agent performance depends on the interaction meaning available through its interface representation; substantial visual variation remains possible when that meaning is preserved. Evaluation on independently authored interfaces shows gains where Affora addresses existing deficits, but limited effects where those deficits are absent or outside its coverage. A workflow case provides preliminary evidence of reduced interaction cost. Affora connects user experience and agent experience through a shared interface rather than a separate agent-only surface.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 5 of its 19 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

5 of 19 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Augmenting Interface Usability Heuristics for Reliable Computer-Use Agents4 May

Other references · 4

  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  2. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  3. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  4. 2024The BrowserGym Ecosystem for Web Agent Researchcited by 161

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution
  2. 2025Computer-Use Agents as Judges for Generative User Interface
  3. 2026Agent-Computer Observation Interfaces Enable Dynamic Computer Use
  4. 2025Understanding User Experiences of Computer Use Agents: Design Space and Opportunities for Building Agent UX Prototypes
  5. 2026The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying Knowledge
  6. 2026Software as Content: Dynamic Applications as the Human-Agent Interaction Layer
  7. 2026From Human Interfaces to Agent Interfaces: Rethinking Software Design in the Age of AI-Native Systems
  8. 2026Mapping the Design Space of User Experience for Computer Use Agents