mlsanityData to 14 Oct 2026

An Intelligent AI glasses System with Multi-Agent Architecture for Real-Time Voice Processing and Task Execution

arXiv 2601.06235 ↗First posted 9 Jan 2026cs.SD cs.AI cs.HCcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

This paper presents an AI glasses system that integrates real-time voice processing, artificial intelligence(AI) agents, and cross-network streaming capabilities. The system employs dual-agent architecture where Agent 01 handles Automatic Speech Recognition (ASR) and Agent 02 manages AI processing through local Large Language Models (LLMs), Model Context Protocol (MCP) tools, and Retrieval-Augmented Generation (RAG). The system supports real-time RTSP streaming for voice and video data transmission, eye tracking data collection, and remote task execution through RabbitMQ messaging. Implementation demonstrates successful voice command processing with multilingual support and cross-platform task execution capabilities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 2 of its 11 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

2 of 11 references.

References · 2

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Toward Low-Latency End-to-End Voice Agents for Telecommunications Using Streaming ASR, Quantized LLMs, and Real-Time TTS
  2. 2024Asynchronous Tool Usage for Real-Time Agents
  3. 2026SALMONN-duo: Adaptive Dual-System Coordination for Full-Duplex Voice Agents
  4. 2026τ-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domains
  5. 2026Hear, Invoke, and Understand: A Skill-Calling Multimodal Agent for Large Audio Language Models
  6. 2026Qwen-Audio-3.1-Realtime: Towards Reliable Agentic Voice Interaction
  7. 2025PFEA: An LLM-based High-Level Natural Language Planning and Feedback Embodied Agent for Human-Centered AI
  8. 2026LTS-VoiceAgent: A Listen-Think-Speak Framework for Efficient Streaming Voice Interaction via Semantic Triggering and Incremental Reasoning