AI for Service: Proactive Assistance with AI Glasses
Not on the map. Why?
Abstract (arXiv)
In an era where AI is evolving from a passive tool into an active and adaptive companion, we introduce AI for Service (AI4Service), a new paradigm that enables proactive and real-time assistance in daily life. Existing AI services remain largely reactive, responding only to explicit user commands. We argue that a truly intelligent and helpful assistant should be capable of anticipating user needs and taking actions proactively when appropriate. To realize this vision, we propose Alpha-Service, a unified framework that addresses two fundamental challenges: Know When to intervene by detecting service opportunities from egocentric video streams, and Know How to provide both generalized and personalized services. Inspired by the von Neumann computer architecture and based on AI glasses, Alpha-Service consists of five key components: an Input Unit for perception, a Central Processing Unit for task scheduling, an Arithmetic Logic Unit for tool utilization, a Memory Unit for long-term personalization, and an Output Unit for natural human interaction. As an initial exploration, we implement Alpha-Service through a multi-agent system deployed on AI glasses. Case studies, including a real-time Blackjack advisor, a museum tour guide, and a shopping fit assistant, demonstrate its ability to seamlessly perceive the environment, infer user intent, and provide timely and useful assistance without explicit prompts.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 28 of its 47 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
28 of 47 references.
References · 28
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Qwen Technical Reportcited by 3,344
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2025Kimi-VL Technical Reportcited by 388
- 2024Agent Workflow Memorycited by 383
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 379
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
16 more
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
- 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 127
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 97
- 2024A Survey on Self-Evolution of Large Language Modelscited by 91
- 2025StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistantcited by 63
- 2025Shifting AI Efficiency From Model-Centric to Data-Centric Compressioncited by 29
- 2025Advancing Multi-Agent Systems Through Model Context Protocol: Architecture, Implementation, and Applicationscited by 23
- 2025Efficient Multi-modal Large Language Models via Progressive Consistency Distillationcited by 22
- 2025Prune2Drive: A Plug-and-Play Framework for Accelerating Vision-Language Models in Autonomous Drivingcited by 16
- 2025AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glassescited by 11
- 2025Mirai: A Wearable Proactive AI "Inner-Voice" for Contextual Nudgingcited by 6
- 2025TACTIC: Translation Agents with Cognitive-Theoretic Interactive Collaborationcited by 5
- 2023Zone-based Federated Learning for Mobile Sensing Datacited by 4
- 2021Attention-Based Sensor Fusion for Human Activity Recognition Using IMU Signalscited by 3
- 2025AI on the Pulse: Real-Time Health Anomaly Detection with Wearable and Ambient Intelligencecited by 2
- 2025Seamless Integration: The Evolution, Design, and Future Impact of Wearable Technologycited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 16.
20 papers.
Sort:
By area:
- 2025Accelerating Streaming Video Large Language Models via Hierarchical Token Compressioncited by 37
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarkscited by 33
- 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videoscited by 11
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discoverycited by 8
- 2026GIFT: Global Irreplaceability Frame Targeting for Efficient Video Understandingcited by 8
- 2026Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understandingcited by 7
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systemscited by 6
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computingcited by 6
- 2025IPCV: Information-Preserving Compression for MLLM Visual Encoderscited by 5
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Modelscited by 5
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistantcited by 5
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learningcited by 2
8 more
- 2026V-CAST: Video Curvature-Aware Spatio-Temporal Pruning for Efficient Video Large Language Modelscited by 2
- 2026Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understandingcited by 2
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialoguecited by 2
- 2026Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluationcited by 2
- 2026EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Nextcited by 1
- 2026From Seeing to Acting: Smart Glasses as First-Person Intelligence Platformscited by 0
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalizationcited by 0
- 2026Learning to Reason with Persistent Object States for Video Instance Segmentationcited by 0
- 2026Learning to Reason with Persistent Object States for Video Instance Segmentation28 Sep 2026
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization17 Sep 2026
- 2026Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation3 Sep 2026
- 2026From Seeing to Acting: Smart Glasses as First-Person Intelligence Platforms25 Aug 2026
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing14 Jun 2026
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems27 May 2026
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue19 May 2026
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistant11 May 2026
- 2026Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understanding8 May 2026
- 2026V-CAST: Video Curvature-Aware Spatio-Temporal Pruning for Efficient Video Large Language Models29 Mar 2026
- 2026GIFT: Global Irreplaceability Frame Targeting for Efficient Video Understanding26 Mar 2026
- 2026Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding19 Mar 2026
8 more
- 2026EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Next12 Mar 2026
- 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videos15 Feb 2026
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Models2 Feb 2026
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery27 Jan 2026
- 2025IPCV: Information-Preserving Compression for MLLM Visual Encoders21 Dec 2025
- 2025Accelerating Streaming Video Large Language Models via Hierarchical Token Compression30 Nov 2025
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning30 Oct 2025
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks29 Oct 2025
- 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videoscited by 11
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discoverycited by 8
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computingcited by 6
- 2025IPCV: Information-Preserving Compression for MLLM Visual Encoderscited by 5
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialoguecited by 2
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing14 Jun 2026
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue19 May 2026
- 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videos15 Feb 2026
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery27 Jan 2026
- 2025IPCV: Information-Preserving Compression for MLLM Visual Encoders21 Dec 2025
- 2026GIFT: Global Irreplaceability Frame Targeting for Efficient Video Understandingcited by 8
- 2026Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understandingcited by 7
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistantcited by 5
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learningcited by 2
- 2026Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understandingcited by 2
- 2026EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Nextcited by 1
- 2026From Seeing to Acting: Smart Glasses as First-Person Intelligence Platformscited by 0
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalizationcited by 0
- 2026Learning to Reason with Persistent Object States for Video Instance Segmentationcited by 0
- 2026Learning to Reason with Persistent Object States for Video Instance Segmentation28 Sep 2026
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization17 Sep 2026
- 2026From Seeing to Acting: Smart Glasses as First-Person Intelligence Platforms25 Aug 2026
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistant11 May 2026
- 2026Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understanding8 May 2026
- 2026GIFT: Global Irreplaceability Frame Targeting for Efficient Video Understanding26 Mar 2026
- 2026Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding19 Mar 2026
- 2026EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Next12 Mar 2026
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning30 Oct 2025