FRESHLATENT: Channel-Aware Latent Adaptation for Resource-Constrained Embodied VLM Perception
Not on the map. Why?
Abstract (arXiv)
Mission-critical UAVs increasingly rely on split vision-language model (VLM) perception under tight onboard-resource and wireless-communication constraints. However, corruption of transmitted intermediate features creates a deployment mismatch for clean-trained split interfaces, while stronger channel-aware codecs can impose substantial onboard cost. We present FreshLatent, a lightweight channel-aware latent adapter that trains a power-normalized encoder-decoder through wireless corruption while keeping the surrounding VLM frozen. We formulate deployment around a mission-conditioned perception requirement and embedded interface cost, linking channel quality and communication budget to the operating conditions under which perception remains usable. At 0 dB and the tightest communication budget, FreshLatent improves gIoU and cIoU over clean split compression by 20.79 and 20.87 points, respectively. At the most adverse evaluated SNR (0 dB), across all three communication budgets, FreshLatent recovers 63.5-69.1% of the gIoU improvement achieved by a much heavier, range-trained feature-JSCC codec. On an NVIDIA Jetson AGX Xavier in 10-W mode, FreshLatent uses 37-40x fewer encoder parameters, 7.7-9.9x lower edge-interface latency, and 8.8-10.0x lower edge-interface energy than the heavier codec. Together, these results show that lightweight channel-aware adaptation can recover a substantial fraction of the robustness of a much larger communication interface while broadening quality-valid operation under constrained wireless conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
18 of 24 references.
References · 18
- 2023Segment Anythingcited by 8,234
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 115
- 2024Joint Source-Channel Coding: Fundamentals and Recent Progress in Practical Designscited by 32
- 2022BottleFit: Learning Compressed Representations in Deep Neural Networks for Effective and Efficient Split Computingcited by 28
- 2022Dynamic Split Computing for Efficient Deep Edge Intelligencecited by 18
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environmentscited by 11
- 2026Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospectscited by 9
- 2025UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescuecited by 7
- 2021Deep Joint Source-Channel Coding for Multi-Task Networkcited by 5
- 2025ACCESS-AV: Adaptive Communication-Computation Codesign for Sustainable Autonomous Vehicle Localization in Smart Factoriescited by 5
6 more
- 2025AVERY: Intent-Driven Adaptive VLM Split Computing via Embodied Self-Awareness for Efficient Disaster Response Systemscited by 4
- 2026PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentationcited by 3
- 2026MemoGuard: An Adaptive Runtime for Guarding Against Memory Traps in Communication-Limited Robot Navigationcited by 2
- 2026Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Modelscited by 1
- 2026FloodReasonBench: Benchmarking VLM Reasoning Segmentation for Embodied Flood Response at the Edgecited by 1
- 2026Compressing AI Traffic: Standardized Neural Network Coding of Visual-Token Representations in Split Vision-Language Inferencecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception
- 2026AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization
- 2026Leveraging Large Vision Model for Multi-UAV Co-perception in Low-Altitude Wireless Networks
- 2025GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamics
- 2025Efficient Onboard Vision-Language Inference in UAV-Enabled Low-Altitude Economy Networks via LLM-Enhanced Optimization
- 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation
- 2026RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigation
- 2026From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation