Adaptive Edge-Cloud Inference for Speech-to-Action Systems Using ASR and Large Language Models
Not on the map. Why?
Abstract (arXiv)
Voice-based interaction has emerged as a natural and intuitive modality for controlling IoT devices. However, speech-driven edge devices face a fundamental trade-off between cloud-based solutions, which offer stronger language understanding capabilities at the cost of latency, connectivity dependence, and privacy concerns, and edge-based solutions, which provide low latency and improved privacy but are limited by computational constraints. This paper presents ASTA, an adaptive speech-to-action solution that dynamically routes voice commands between edge and cloud inference to balance performance and system resource utilization. ASTA integrates on-device automatic speech recognition and lightweight offline language-model inference with cloud-based LLM processing, guided by real-time system metrics such as CPU workload, device temperature, and network latency. A metric-aware routing mechanism selects the inference path at runtime, while a rule-based command validation and repair component ensures successful end-to-end command execution. We implemented our solution on an NVIDIA Jetson-based edge platform and evaluated it using a diverse dataset of 80 spoken commands. Experimental results show that ASTA successfully routes all input commands for execution, achieving a balanced distribution between online and offline inference. The system attains an ASR accuracy of 62.5% and generates executable commands without repair for only 47.5% of inputs, highlighting the importance of the repair mechanism in improving robustness. These results suggest that adaptive edge-cloud orchestration is a viable approach for resilient and resource-aware voice-controlled IoT systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 14 Dec 2025.
Builds on
18 of 33 references.
References · 18
- 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 200
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2023On decoder-only architecture for speech-to-text and large language model integrationcited by 145
- 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 113
- 2024Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimizationcited by 97
- 2017Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learningcited by 67
- 2024Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognitioncited by 63
- 2021SC-GlowTTS: an Efficient Zero-Shot Multi-Speaker Text-To-Speech Modelcited by 56
- 2025LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLMcited by 7
- 2025Sanitizing Manufacturing Dataset Labels Using Vision-Language Modelscited by 6
- 2024Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systemscited by 5
- 2025Edge-ASR: Towards Low-Bit Quantization of Automatic Speech Recognition Modelscited by 5
6 more
- 2025Efficient Routing of Inference Requests across LLM Instances in Cloud-Edge Computingcited by 5
- 2025AutoPK: Leveraging LLMs and a Hybrid Similarity Metric for Advanced Retrieval of Pharmacokinetic Data from Complex Tables and Documentscited by 4
- 2024Tiny-Align: Bridging Automatic Speech Recognition and Large Language Model on the Edgecited by 2
- 2022Taxonomic Classification of IoT Smart Home Voice Controlcited by 1
- 2025HySim-LLM: Embedding-Weighted Fine-Tuning Bounds and Manifold Denoising for Domain-Adapted LLMscited by 1
- 2025Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systemscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.