mlsanityData to 14 Oct 2026

VueBuds: Visual Intelligence with Wireless Earbuds

arXiv 2603.29095 ↗First posted 31 Mar 2026cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Despite their ubiquity, wireless earbuds remain audio-centric due to size and power constraints. We present VueBuds, the first camera-integrated wireless earbuds for egocentric vision, capable of operating within stringent power and form-factor limits. Each VueBud embeds a camera into a Sony WF-1000XM3 to stream visual data over Bluetooth to a host device for on-device vision language model (VLM) processing. We show analytically and empirically that while each camera's field of view is partially occluded by the face, the combined binocular perspective provides comprehensive forward coverage. By integrating VueBuds with VLMs, we build an end-to-end system for real-time scene understanding, translation, visual reasoning, and text reading; all from low-resolution monochrome cameras drawing under 5mW through on-demand activation. Through online and in-person user studies with 90 participants, we compare VueBuds against smart glasses across 17 visual question-answering tasks, and show that our system achieves response quality on par with Ray-Ban Meta. Our work establishes low-power camera-equipped earbuds as a compelling platform for visual intelligence, bringing rapidly advancing VLM capabilities to one of the most ubiquitous wearable form factors.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 31 Mar 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026OpenGlass: A Sensing-Computing Split Architecture for Local MLLM-Driven Real-Time Visual Assistance
  2. 2025EgoBlind: Towards Egocentric Visual Assistance for the Blind
  3. 2025Lessons Learned from Developing a Privacy-Preserving Multimodal Wearable for Local Voice-and-Vision Inference ↗
  4. 2026EgoAVU: Egocentric Audio-Visual Understanding
  5. 2026Egocentric Co-Pilot: Web-Native Smart-Glasses Agents for Assistive Egocentric AI
  6. 2025An Egocentric Vision-Language Model based Portable Real-time Smart Assistant
  7. 2026CoVSpec: Efficient Device-Edge Co-Inference for Vision-Language Models via Speculative Decoding
  8. 2026VisionAId: An Offline-First Multimodal Android Assistant for People with Visual Impairment, Featuring Personalized Object Retrieval