CP-decomposition with Tensor Power Method for Convolutional Neural Networks Compression
Not on the map. Why?
Abstract (arXiv)
Convolutional Neural Networks (CNNs) has shown a great success in many areas including complex image classification tasks. However, they need a lot of memory and computational cost, which hinders them from running in relatively low-end smart devices such as smart phones. We propose a CNN compression method based on CP-decomposition and Tensor Power Method. We also propose an iterative fine tuning, with which we fine-tune the whole network after decomposing each layer, but before decomposing the next layer. Significant reduction in memory and computation cost is achieved compared to state-of-the-art previous work with no more accuracy loss.
Key facts. Cited by 30 papers in the map (data through 13 Oct 2026). First posted on arXiv 25 Jan 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 3; 2023: 9; 2024: 5; 2025: 3; 2026: 2.
30 papers.
Sort:
By area:
- 2021Tensor Methods in Computer Vision and Deep Learningcited by 52
- 2023HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networkscited by 20
- 2023Tensor Decomposition for Model Reduction in Neural Networks: A Reviewcited by 14
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Servicescited by 14
- 2023Geometry-aware training of factorized layers in tensor Tucker formatcited by 12
- 2021Low-rank Tensor Decomposition for Compression of Convolutional Neural Networks Using Funnel Regularizationcited by 6
- 2023Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Trainingcited by 5
- 2025Tensorization is a powerful but underexplored tool for compression and interpretability of neural networkscited by 4
- 2022Position: Tensor Networks are a Valuable Asset for Green AIcited by 3
- 2022Canonical convolutional neural networkscited by 3
- 2024MIGS: Multi-Identity Gaussian Splatting via Tensor Decompositioncited by 3
- 2024Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimationcited by 3
18 more
- 2021Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directionscited by 2
- 2023Robust Adversarial Defense by Tensor Factorizationcited by 2
- 2023Boosting Defect Detection in Manufacturing using Tensor Convolutional Neural Networkscited by 2
- 2021Exploiting Elasticity in Tensor Ranks for Compressing Neural Networkscited by 1
- 2021Defensive Tensorizationcited by 1
- 2021A New Measure of Model Redundancy for Compressed Convolutional Neural Networkscited by 1
- 2022Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Surveycited by 1
- 2023When Parameter-efficient Tuning Meets General-purpose Vision-language Modelscited by 1
- 2021Nonlinear Tensor Ring Networkcited by 0
- 2021Selective Multiple Power Iteration: from Tensor PCA to gradient-based exploration of landscapescited by 0
- 2023Lightweight Attribute Localizing Models for Pedestrian Attribute Recognitioncited by 0
- 2024Convolutional Neural Network Compression via Dynamic Parameter Rank Pruningcited by 0
- 2024Reduced storage direct tensor ring decomposition for convolutional neural networks compressioncited by 0
- 2024Layer-Specific Optimization: Sensitivity Based Convolution Layers Basis Searchcited by 0
- 2025Efficient CNN Compression via Multi-method Low Rank Factorization and Feature Map Similaritycited by 0
- 2025Distribution-Aware Tensor Decomposition for Compression of Convolutional Neural Networkscited by 0
- 2026Optimizing Tensor Train Decomposition in DNNs for RISC-V Architectures Using Design Space Exploration and Compiler Optimizationscited by 0
- 2026Fast Tensorization of Neural Networks via Slice-wise Feature Distillationcited by 0
- 2026Fast Tensorization of Neural Networks via Slice-wise Feature Distillation19 May 2026
- 2026Optimizing Tensor Train Decomposition in DNNs for RISC-V Architectures Using Design Space Exploration and Compiler Optimizations2 Feb 2026
- 2025Distribution-Aware Tensor Decomposition for Compression of Convolutional Neural Networks6 Nov 2025
- 2025Efficient CNN Compression via Multi-method Low Rank Factorization and Feature Map Similarity29 Sep 2025
- 2025Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks26 May 2025
- 2024Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimation25 Sep 2024
- 2024Layer-Specific Optimization: Sensitivity Based Convolution Layers Basis Search12 Aug 2024
- 2024MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition10 Jul 2024
- 2024Reduced storage direct tensor ring decomposition for convolutional neural networks compression17 May 2024
- 2024Convolutional Neural Network Compression via Dynamic Parameter Rank Pruning15 Jan 2024
- 2023Boosting Defect Detection in Manufacturing using Tensor Convolutional Neural Networks29 Dec 2023
- 2023When Parameter-efficient Tuning Meets General-purpose Vision-language Models16 Dec 2023
18 more
- 2023Robust Adversarial Defense by Tensor Factorization3 Sep 2023
- 2023Lightweight Attribute Localizing Models for Pedestrian Attribute Recognition16 Jun 2023
- 2023Geometry-aware training of factorized layers in tensor Tucker format30 May 2023
- 2023Tensor Decomposition for Model Reduction in Neural Networks: A Review26 Apr 2023
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services13 Apr 2023
- 2023Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Training22 Mar 2023
- 2023HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks20 Jan 2023
- 2022Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey22 Aug 2022
- 2022Canonical convolutional neural networks3 Jun 2022
- 2022Position: Tensor Networks are a Valuable Asset for Green AI25 May 2022
- 2021Selective Multiple Power Iteration: from Tensor PCA to gradient-based exploration of landscapes23 Dec 2021
- 2021A New Measure of Model Redundancy for Compressed Convolutional Neural Networks9 Dec 2021
- 2021Low-rank Tensor Decomposition for Compression of Convolutional Neural Networks Using Funnel Regularization7 Dec 2021
- 2021Nonlinear Tensor Ring Network12 Nov 2021
- 2021Defensive Tensorization26 Oct 2021
- 2021Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions30 Aug 2021
- 2021Tensor Methods in Computer Vision and Deep Learning7 Jul 2021
- 2021Exploiting Elasticity in Tensor Ranks for Compressing Neural Networks10 May 2021
- 2021Tensor Methods in Computer Vision and Deep Learningcited by 52
- 2023HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networkscited by 20
- 2023Tensor Decomposition for Model Reduction in Neural Networks: A Reviewcited by 14
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Servicescited by 14
- 2023Geometry-aware training of factorized layers in tensor Tucker formatcited by 12
- 2021Low-rank Tensor Decomposition for Compression of Convolutional Neural Networks Using Funnel Regularizationcited by 6
- 2023Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Trainingcited by 5
- 2025Tensorization is a powerful but underexplored tool for compression and interpretability of neural networkscited by 4
- 2022Position: Tensor Networks are a Valuable Asset for Green AIcited by 3
- 2022Canonical convolutional neural networkscited by 3
- 2024MIGS: Multi-Identity Gaussian Splatting via Tensor Decompositioncited by 3
- 2024Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimationcited by 3
12 most cited of 28 All 28 (JSON)
- 2026Optimizing Tensor Train Decomposition in DNNs for RISC-V Architectures Using Design Space Exploration and Compiler Optimizations2 Feb 2026
- 2025Distribution-Aware Tensor Decomposition for Compression of Convolutional Neural Networks6 Nov 2025
- 2025Efficient CNN Compression via Multi-method Low Rank Factorization and Feature Map Similarity29 Sep 2025
- 2025Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks26 May 2025
- 2024Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimation25 Sep 2024
- 2024Layer-Specific Optimization: Sensitivity Based Convolution Layers Basis Search12 Aug 2024
- 2024MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition10 Jul 2024
- 2024Reduced storage direct tensor ring decomposition for convolutional neural networks compression17 May 2024
- 2024Convolutional Neural Network Compression via Dynamic Parameter Rank Pruning15 Jan 2024
- 2023Boosting Defect Detection in Manufacturing using Tensor Convolutional Neural Networks29 Dec 2023
- 2023Robust Adversarial Defense by Tensor Factorization3 Sep 2023
- 2023Lightweight Attribute Localizing Models for Pedestrian Attribute Recognition16 Jun 2023
12 newest of 28 All 28 (JSON)