Revolutionizing Turn-by-Turn Navigation with Cloud-Edge Deep Learning
On the map: Mixture-of-experts → MoE in reinforcement learning and robotics
Abstract (arXiv)
Turn-by-turn (TBT) navigation systems are integral to modern driving experiences, providing real-time audio instructions to guide drivers safely to destinations. However, existing audio instruction policy often relies on rule-based approaches that struggle to balance informational content with cognitive load, potentially leading to driver confusion or missed turns in complex environments. To overcome these difficulties, we first model the generation of navigation instructions as a multi-task learning problem by decomposing the audio content into combinations of modular elements. Then, we propose a novel deep learning framework that leverages the powerful spatiotemporal information processing capabilities of Transformers and the strong multi-task learning abilities of Mixture of Experts (MoE) to generate real-time, context-aware audio instructions for TBT driving navigation. A cloud-edge collaborative architecture is implemented to handle the computational demands of the model, ensuring scalability and real-time performance for practical applications. Experimental results in the real world demonstrate that the proposed method significantly reduces the yaw rate (the proportion of vehicles deviating from navigation routes) compared to traditional methods, delivering clearer and more effective audio instructions. This is the first large-scale application of deep learning in driving audio navigation, marking a substantial advancement in intelligent transportation and driving assistance technologies.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE in reinforcement learning and robotics, one of 12 directions in Mixture-of-experts. Builds on 17 of its 44 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
17 of 44 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 721
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 546
- 2017End-to-end Driving via Conditional Imitation Learningcited by 485
- 2024Navigation World Modelscited by 272
- 2020Transformer Networks for Trajectory Forecastingcited by 181
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
5 more
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2018CrossNet: An End-to-end Reference-based Super Resolution Network using Cross-scale Warpingcited by 91
- 2020MNN: A Universal and Efficient Inference Enginecited by 65
- 2021Multi-task Learning with Attention for End-to-end Autonomous Drivingcited by 49
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Trafficcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Efficient Driving Behavior Narration and Reasoning on Edge Device Using Large Language Models
- 2022End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems
- 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Survey
- 2026Large Multimodal Models for Embodied Intelligent Driving: The Next Frontier in Self-Driving?
- 2024VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation
- 2025Nav-EE: Navigation-Guided Early Exiting for Efficient Vision-Language Models in Autonomous Driving
- 2026MTDrive: Multi-turn Interactive Reinforcement Learning for Autonomous Driving