A Task Decomposition and Planning Framework for Efficient LLM Inference in AI-Enabled WiFi-Offload Networks
On the map: Efficient LLM inference and serving → Serving systems and request scheduling
Abstract (arXiv)
AI WiFi offload is emerging as a promising approach for providing large language model (LLM) services to resource-constrained wireless devices. However, unlike conventional edge computing, LLM inference over WiFi must jointly address heterogeneous model capabilities, wireless contention, uncertain task complexity, and semantic correlation among reasoning tasks. In this paper, we investigate LLM inference offloading in a multi-user multi-edge WiFi network, where each task can be executed locally, directly offloaded to a nearby edge access point (AP), or decomposed into multiple subtasks for collaborative execution across local and edge nodes. To this end, we propose a user-edge collaborative framework with an LLM-based planner that not only performs task decomposition but also infers subtask difficulty and expected output token length, enabling more accurate estimation of execution quality and latency on heterogeneous nodes. Based on these estimates, we further design a decomposition-aware scheduling strategy that jointly optimizes subtask assignment, execution, and aggregation under communication, queuing, and computation constraints. Simulation results show that the proposed framework achieves a better latency-accuracy tradeoff than local-only and nearest-edge baselines, reducing the average latency by 20% and improving the overall reward by 80%. Moreover, the distilled lightweight planner approaches the performance of the large teacher model while remaining more suitable for practical edge deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Serving systems and request scheduling, one of 12 directions in Efficient LLM inference and serving. Builds on 5 of its 11 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
5 of 11 references.
Closest ancestors · 1
Same direction, newest first
Other references · 4
- 2024Understanding the planning of LLM agents: A surveycited by 414
- 2024Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunitiescited by 83
- 2025Collaboration of Large Language Models and Small Recommendation Models for Device-Cloud Recommendationcited by 15
- 2025HybridFlow: Resource-Adaptive Subtask Routing for Efficient Edge-Cloud LLM Inferencecited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Dynamic Quality-Latency Aware Routing for LLM Inference in Wireless Edge-Device Networks
- 2025On-Device LLM for Context-Aware Wi-Fi Roaming
- 2026End-to-End Latency-Minimizing and Load-Balanced Request Scheduling for Edge LLM Inference in Agentic AI Services
- 2025Bridging On-Device and Cloud LLMs for Collaborative Reasoning: A Unified Methodology for Local Routing and Post-Training
- 2025Recursive Offloading for LLM Serving in Multi-tier Networks
- 2025Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges
- 2026RAG-driven Multi-Agent LLM Framework with Task Decomposition for Beyond 5G Auto-Configuration
- 2025LOIP:Collaborative Lossless LLM Inference Serving with Offloading-based Pipeline Parallelism on Edge Devices