mlsanityData to 14 Oct 2026

Resource-Aware Parameter-Efficient Model Adaptation for Onboard High-Dimensional Data

arXiv 2609.33687 ↗First posted 27 Sep 2026cs.CV cs.DC cs.NIcited by 0

Not on the map. Why?

Abstract (arXiv)

Onboard satellite models often require frequent updates, but the weights adapted to earlier data distributions can quickly become outdated. However, updating large-scale model parameters in orbit presents significant challenges due to the limited uplink bandwidth of Low Earth Orbit (LEO) satellite systems, particularly for hyperspectral satellite imagery, where high-dimensional spectral-spatial inputs lead to increased model size and update costs. Existing full fine-tuning methods are thus expensive to retrain and difficult to deploy under strict communication constraints. To address this challenge, we propose NE-LoRA, a parameter-efficient adaptation framework for bandwidth-constrained onboard hyperspectral model updates. NE-LoRA combines a primary low-rank branch with a nonlinear auxiliary branch to capture both global update trends and complex spectral-spatial variations. Additionally, we introduce a differentiated training strategy for multi-matrix adapters, motivated by the asymmetric initialization and gradient dynamics of different adapter matrices. Experiments on four hyperspectral datasets and three representative backbone models demonstrate that NE-LoRA consistently outperforms LoRA-based baselines and remains competitive with, and in several cases superior to, full fine-tuning. Across the evaluated settings, NE-LoRA updates only a small fraction of the total parameters on average while preserving low deployment overhead, offering a favorable accuracy-communication trade-off for onboard hyperspectral adaptation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 44 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

10 of 44 references.

References · 10

  1. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 377
  2. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 357
  3. 2023VeRA: Vector-based Random Matrix Adaptationcited by 300
  4. 2020Metrics for Multi-Class Classification: an Overviewcited by 143
  5. 2023The Expressive Power of Low-Rank Adaptationcited by 102
  6. 2024DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distributioncited by 43
  7. 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Reviewcited by 37
  8. 2025AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mappingcited by 23
  9. 2025GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuningcited by 10
  10. 2024BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Modelscited by 8

Built on by

Not cited yet.