mlsanityData to 14 Oct 2026

Richard: Voice-First Mobile Interaction for Persistent Tasks

arXiv 2609.39976 ↗First posted 30 Sep 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Mobile terminals need to provide application and network services while supporting users' control over their attention. We explore voice-first interaction organized around requests and delegated tasks, allowing users to leave a conversation and later inspect, revise, and retrieve the work. We present Richard, a system prototype that manages voice sessions, task execution, and result delivery separately, linking them through persistent request records. Conversation and task views provide visual feedback, while the backend coordinates immediate responses, dedicated service operations, and agent tasks. Request revisions, execution states, and notifications remain associated with the relevant task. We examine this design through Android functional records, controlled lifecycle verification, and execution records of a real programming request. Controlled verification reproduces revision, execution after confirmation, and result retention; deployed-service records show backend progress and failure feedback after client disconnection. These observations inform the design of task continuity, user control, and service integration in mobile voice interaction, providing an implementation basis for personal computing devices that accommodate intermittent user participation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 12 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

6 of 12 references.

References · 6

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
  3. 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaborationcited by 65
  4. 2019Interactive Task and Concept Learning from Natural Language Instructions and GUI Demonstrationscited by 26
  5. 2017Iris: A Conversational Agent for Complex Taskscited by 22
  6. 2019Self-Control in Cyberspace: Applying Dual Systems Theory to a Review of Digital Self-Control Toolscited by 8

Built on by

Not cited yet.