mlsanityData to 7 Oct 2026

A Benchmark Study of Neural Network Compression Methods for Hyperspectral Image Classification

arXiv 2603.04720 ↗First posted 5 Mar 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep neural networks have achieved strong performance in image classification tasks due to their ability to learn complex patterns from high-dimensional data. However, their large computational and memory requirements often limit deployment on resource-constrained platforms such as remote sensing devices and edge systems. Network compression techniques have therefore been proposed to reduce model size and computational cost while maintaining predictive performance. In this study, we conduct a systematic evaluation of neural network compression methods for a remote sensing application, namely hyperspectral land cover classification. Specifically, we examine three widely used compression strategies for convolutional neural networks: pruning, quantization, and knowledge distillation. Experiments are conducted on two benchmark hyperspectral datasets, considering classification accuracy, memory consumption, and inference efficiency. Our results demonstrate that compressed models can significantly reduce model size and computational cost while maintaining competitive classification performance. These findings provide insights into the trade-offs between compression ratio, efficiency, and accuracy, and highlight the potential of compression techniques for enabling efficient deep learning deployment in remote sensing applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 89 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

31 of 89 references.

References · 31

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  3. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  4. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  5. 2016Pruning Filters for Efficient ConvNetscited by 1,129
  6. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  7. 2019Relational Knowledge Distillationcited by 873
  8. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 673
  9. 2017Deep Mutual Learningcited by 621
  10. 2018Rethinking the Value of Network Pruningcited by 595
  11. 2020What is the State of Neural Network Pruning?cited by 578
  12. 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 438
19 more
  1. 2015Recent Advances in Convolutional Neural Networkscited by 360
  2. 2018Soft Filter Pruning for Accelerating Deep Convolutional Neural Networkscited by 313
  3. 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
  4. 2019Correlation Congruence for Knowledge Distillationcited by 280
  5. 2021Knowledge distillation: A good teacher is patient and consistentcited by 255
  6. 2018Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neuronscited by 235
  7. 2018Knowledge Distillation by On-the-Fly Native Ensemblecited by 186
  8. 2020Regularizing Class-wise Predictions via Self-knowledge Distillationcited by 144
  9. 2022Knowledge Distillation with the Reused Teacher Classifiercited by 140
  10. 2017SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networkscited by 132
  11. 2019Online Knowledge Distillation with Diverse Peerscited by 127
  12. 2019Deep Learning for Hyperspectral Image Classification: An Overviewcited by 121
  13. 2020Self-Knowledge Distillation with Progressive Refinement of Targetscited by 106
  14. 2018Collaborative Learning for Deep Neural Networkscited by 69
  15. 2020Contrastive Distillation on Intermediate Representations for Language Model Compressioncited by 57
  16. 2021Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-guided Feature Imitationcited by 40
  17. 2021Confidence-Aware Multi-Teacher Knowledge Distillationcited by 39
  18. 2019Conditional Teacher-Student Learningcited by 32
  19. 2020Evolution of Image Segmentation using Deep Convolutional Neural Network: A Surveycited by 28

Built on by

Not cited yet.