mlsanityData to 14 Oct 2026

Histogram-based Parameter-efficient Tuning for Passive and Active Sonar Classification

arXiv 2504.15214 ↗First posted 21 Apr 2025cs.LG cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Parameter-efficient transfer learning (PETL) methods adapt large artificial neural networks to downstream tasks without fine-tuning the entire model. However, existing additive methods, such as adapters, sometimes struggle to capture distributional shifts in intermediate feature embeddings. We propose a novel histogram-based parameter-efficient tuning (HPT) technique that captures the statistics of the target domain and modulates the embeddings. Experimental results on three downstream passive sonar datasets (ShipsEar, DeepShip, Vessel Type Underwater Acoustic Data (VTUAD)) demonstrate that HPT outperforms conventional adapters. Notably, HPT achieves 91.8% vs. 89.8% accuracy on VTUAD. For active sonar imagery (Watertank, Turntable), HPT is competitive with other PETL methods. Furthermore, HPT yields feature representations closer to those of fully fine-tuned models. Overall, HPT balances parameter savings and provides a distribution-aware alternative to existing adapters and shows a promising direction for transfer learning in resource-constrained environments. The code is publicly available: https://github.com/Advanced-Vision-and-Learning-Lab/HLAST_DeepShip_ParameterEfficient.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 21 Apr 2025.

Builds on

21 of 32 references.

References · 21

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  3. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  7. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  8. 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 872
  9. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  10. 2021AST: Audio Spectrogram Transformercited by 643
  11. 2015Return of Frustratingly Easy Domain Adaptationcited by 391
  12. 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 294
9 more
  1. 2021UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuningcited by 162
  2. 2022Head2Toe: Utilizing Intermediate Representations for Better Transfer Learningcited by 83
  3. 2018A multi-device dataset for urban acoustic scene classificationcited by 75
  4. 2021The Marine Debris Dataset for Forward-Looking Sonar Semantic Segmentationcited by 22
  5. 2020Histogram Layers for Texture Analysiscited by 19
  6. 2019Weakly Labelled AudioSet Tagging with Attention Neural Networkscited by 17
  7. 2023Advancing Test-Time Adaptation in Wild Acoustic Test Settingscited by 7
  8. 2023Histogram Layer Time Delay Neural Networks for Passive Sonar Classificationcited by 5
  9. 2024Advancing Robust Underwater Acoustic Target Recognition through Multi-task Learning and Multi-Gate Mixture-of-Expertscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.