EdgeNav-QE: QLoRA Quantization and Dynamic Early Exit for LAM-based Navigation on Edge Devices
On the map: Efficient LLM inference and serving → Visual token pruning in multimodal models
Abstract (arXiv)
Large Action Models (LAMs) have shown immense potential in autonomous navigation by bridging high-level reasoning with low-level control. However, deploying these multi-billion parameter models on edge devices remains a significant challenge due to memory constraints and latency requirements. In this paper, we propose EdgeNav-QE, a novel framework that integrates Quantized Low-Rank Adaptation (QLoRA) with a dynamic early-exit (DEE) mechanism to optimize LAMs for real-time edge navigation. By quantizing the backbone to 4-bit precision and strategically placing early-exit branches, we enable the model to terminate inference early for simple navigation tasks while retaining full depth for complex decision-making. Experimental results on the Habitat-Sim environment with Matterport3D dataset using OpenVLA-7B backbone, demonstrate that EdgeNav-QE reduces inference latency by 82.7% and memory footprint by 66.7% compared to full-precision baselines, while maintaining 81.8% navigation success rate. Furthermore, it outperforms state-of-the-art static early-exit method by 17.9% in latency, demonstrating the superiority of content-aware adaptive computation for safety-critical applications.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Visual token pruning in multimodal models, one of 12 directions in Efficient LLM inference and serving. Builds on 28 of its 35 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
28 of 35 references.
References · 28
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
16 more
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2021A White Paper on Neural Network Quantizationcited by 453
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 435
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
- 2020DeeBERT: Dynamic Early Exiting for Accelerating BERT Inferencecited by 322
- 2023LLM-QAT: Data-Free Quantization Aware Training for Large Language Modelscited by 320
- 2020BERT Loses Patience: Fast and Robust Inference with Early Exitcited by 267
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
- 2021Towards Efficient NLP: A Standard Evaluation and A Strong Baselinecited by 44
- 2024Large Action Models: From Inception to Implementationcited by 18
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edge
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices
- 2026LQA: A Lightweight Quantized-Adaptive Framework for Vision-Language Models on the Edge
- 2025EdgeNavMamba: Mamba Optimized Object Detection for Energy Efficient Edge Devices
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation
- 2025EdgeVLA: Efficient Vision-Language-Action Models
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization