mlsanityData to 14 Oct 2026

MiCU: End-to-End Smart Home Command Understanding with Large Language Model

arXiv 2606.01099 ↗First posted 31 May 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Command understanding systems in smart home ecosystems can automate device control and substantially improve user experience. However, while they perform well on precise utterances (e.g., "turn on the bedroom light"), they struggle with ambiguous or misaligned commands (e.g., "make the bedroom cozy"). Large language models (LLMs) generalize well across various domains and can outperform traditional rule-based systems on such tasks, but their effectiveness is often constrained by scarce domain-specific data, insufficient task-specific adaptation, and high computational costs. In this paper, we propose an automated training data synthesis workflow using user logs and LLMs; then we build MiCU, a domain-specific LLM that excels at command understanding. Specifically, we employ curriculum learning to inject domain knowledge into the base LLM, then we enhance its reasoning ability via cold-start training combined with reinforcement learning (RL) guided by domain-specific thinking rules. Additionally, we introduce a token compression technique that condenses device description into a single special token, substantially reducing inference overhead and enabling model-fast, an efficient variant optimized for long inputs. Extensive experiments show that MiCU significantly outperforms baselines, with an average accuracy gain of 20.01% across all device categories. We have deployed MiCU in the Xiaomi Home app, receiving approximately 1.7 million page views per day. Production evaluations show that MiCU reduces user correction rate by 1.57% and increases human audited accuracy by 32.05%. Our data and code are available at https://github.com/xiaomi-research/iotspecllm

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

16 of 37 references.

References · 16

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  4. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
  5. 2019Semantics-aware BERT for Language Understandingcited by 112
  6. 2023Evaluating Open-Domain Question Answering in the Era of Large Language Modelscited by 111
  7. 2024LongAlign: A Recipe for Long Context Alignment of Large Language Modelscited by 106
  8. 2023Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answeringcited by 41
  9. 2023Large Language Model Instruction Following: A Survey of Progresses and Challengescited by 31
  10. 2020ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understandingcited by 19
  11. 2021Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classificationcited by 14
  12. 2023Sasha: Creative Goal-Oriented Reasoning in Smart Homes with Large Language Modelscited by 11
4 more
  1. 2022Knowledge Prompting in Pre-trained Language Model for Natural Language Understandingcited by 9
  2. 2026Scheduling LLM Inference with Uncertainty-Aware Output Length Predictionscited by 8
  3. 2026Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Managementcited by 4
  4. 2026FuxiShuffle: An Adaptive and Resilient Shuffle Service for Distributed Data Processing on Alibaba Cloudcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SMH-Bench: Benchmarking LLM Agents for Environment-Grounded Reasoning and Action in Smart Homes
  2. 2026Trust Your Memory: Verifiable Control of Smart Homes through Reinforcement Learning with Multi-dimensional Rewards
  3. 2025HomeBench: Evaluating LLMs in Smart Homes with Valid and Invalid Instructions Across Single and Multiple Devices
  4. 2025On-Device LLMs for Home Assistant: Dual Role in Intent Detection and Response Generation
  5. 2026TGPO: Trace-Guided Policy Optimization for Robot Task Planning via Verifiable Subgoal Generation ↗
  6. 2026HomeFlow: A Data Flywheel for Smart Home Agent Training with Verifiable Simulation
  7. 2026Precise Robot Command Understanding Using Grammar-Constrained Large Language Models
  8. 2023Human-Centric Autonomous Systems With LLMs for User Command Reasoning