FASTNav: Fine-tuned Adaptive Small-language-models Trained for Multi-point Robot Navigation
Not on the map. Why?
Abstract (arXiv)
With the rapid development of large language models (LLM), robots are starting to enjoy the benefits of new interaction methods that large language models bring. Because edge computing fulfills the needs for rapid response, privacy, and network autonomy, we believe it facilitates the extensive deployment of large models for robot navigation across various industries. To enable local deployment of language models on edge devices, we adopt some model boosting methods. In this paper, we propose FASTNav - a method for boosting lightweight LLMs, also known as small language models (SLMs), for robot navigation. The proposed method contains three modules: fine-tuning, teacher-student iteration, and language-based multi-point robot navigation. We train and evaluate models with FASTNav in both simulation and real robots, proving that we can deploy them with low cost, high accuracy and low response time. Compared to other model compression methods, FASTNav shows potential in the local deployment of language models and tends to be a promising solution for language-guided robot navigation on edge devices.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 30 references that are in the map. First posted on arXiv 20 Nov 2024.
Builds on
25 of 30 references.
References · 25
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Qwen Technical Reportcited by 3,344
- 2023Mistral 7Bcited by 3,164
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 650
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2023LLM-QAT: Data-Free Quantization Aware Training for Large Language Modelscited by 324
- 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 231
13 more
- 2023Orca 2: Teaching Small Language Models How to Reasoncited by 159
- 2021Vision-Only Robot Navigation in a Neural Radiance Worldcited by 155
- 2023MiniLLM: On-Policy Distillation of Large Language Modelscited by 139
- 2023AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkerscited by 113
- 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
- 2020The Marathon 2: A Navigation Systemcited by 70
- 2023Dynamic Planning with a LLMcited by 61
- 2023ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formatscited by 44
- 2023Towards the Law of Capacity Gap in Distilling Language Modelscited by 44
- 2022In-context Learning Distillation: Transferring Few-shot Learning Ability of Pre-trained Language Modelscited by 37
- 2023Small Language Models Fine-tuned to Coordinate Larger Language Models improve Complex Reasoningcited by 16
- 2024Grimoire is All You Need for Enhancing Large Language Modelscited by 4
- 2024Unifying Large Language Model and Deep Reinforcement Learning for Human-in-Loop Interactive Socially-aware Navigationcited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Modelscited by 23
- 2025SmallPlan: Leverage Small Language Models for Sequential Path Planning with Simulation-Powered, LLM-Guided Distillationcited by 0
- 2026"Dear LLaVA, Please Drive": A Depth-Aware Vision-Language Agent for Closed-Loop Robotic Controlcited by 0
- 2026"Dear LLaVA, Please Drive": A Depth-Aware Vision-Language Agent for Closed-Loop Robotic Control19 Sep 2026
- 2025RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Models21 Jun 2025
- 2025SmallPlan: Leverage Small Language Models for Sequential Path Planning with Simulation-Powered, LLM-Guided Distillation1 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026GemNav: Discrete-Token Visual Robot Navigation using a Multimodal Large Language Model
- 2025Language and Planning in Robotic Navigation: A Multilingual Evaluation of State-of-the-Art Models
- 2026EdgeVLN: Runtime-Aware Deployment Ready Quantized Vision Language Navigation Model
- 2025FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Tasks
- 2024Socially-Aware Robot Navigation Enhanced by Bidirectional Natural Language Conversations Using Large Language Models
- 2026LAMP: Implicit Language Map for Robot Navigation
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models