{"total":228,"rows":[{"id":"2103.13630","title":"A Survey of Quantization Methods for Efficient Neural Network Inference","created":"2021-03-25","cited_by_count":815,"area":null},{"id":"2301.12900","title":"DepGraph: Towards Any Structural Pruning","created":"2023-01-30","cited_by_count":203,"area":null},{"id":"2107.00910","title":"Learned Token Pruning for Transformers","created":"2021-07-02","cited_by_count":139,"area":"inference"},{"id":"2108.00708","title":"Group Fisher Pruning for Practical Network Compression","created":"2021-08-02","cited_by_count":131,"area":null},{"id":"2303.00566","title":"Structured Pruning for Deep Convolutional Neural Networks: A survey","created":"2023-03-01","cited_by_count":122,"area":null},{"id":"2110.14032","title":"MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge","created":"2021-10-26","cited_by_count":79,"area":null},{"id":"2203.08243","title":"Unified Visual Transformer Compression","created":"2022-03-15","cited_by_count":79,"area":null},{"id":"2110.13981","title":"CHIP: CHannel Independence-based Pruning for Compact Neural Networks","created":"2021-10-26","cited_by_count":78,"area":null},{"id":"2104.03438","title":"Convolutional Neural Network Pruning with Structural Redundancy Reduction","created":"2021-04-08","cited_by_count":73,"area":null},{"id":"2103.03936","title":"Pufferfish: Communication-efficient Models At No Extra Cost","created":"2021-03-05","cited_by_count":61,"area":null},{"id":"2205.05676","title":"Revisiting Random Channel Pruning for Neural Network Compression","created":"2022-05-11","cited_by_count":50,"area":null},{"id":"2307.02973","title":"Pruning vs Quantization: Which is Better?","created":"2023-07-06","cited_by_count":46,"area":null},{"id":"2101.08940","title":"Hessian-Aware Pruning and Optimal Neural Implant","created":"2021-01-22","cited_by_count":45,"area":null},{"id":"2208.02507","title":"ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity","created":"2022-08-04","cited_by_count":45,"area":null},{"id":"2203.04466","title":"The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks","created":"2022-03-09","cited_by_count":41,"area":null},{"id":"2105.11228","title":"Towards Compact CNNs via Collaborative Compression","created":"2021-05-24","cited_by_count":36,"area":null},{"id":"2203.15794","title":"CHEX: CHannel EXploration for CNN Model Compression","created":"2022-03-29","cited_by_count":36,"area":null},{"id":"2104.04382","title":"CondenseNet V2: Sparse Feature Reactivation for Deep Networks","created":"2021-04-09","cited_by_count":34,"area":null},{"id":"2108.08910","title":"Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search","created":"2021-08-18","cited_by_count":34,"area":null},{"id":"2107.11442","title":"Compressing Neural Networks: Towards Determining the Optimal Layer-wise Decomposition","created":"2021-07-23","cited_by_count":33,"area":null},{"id":"2110.13041","title":"Applications and Techniques for Fast Machine Learning in Science","created":"2021-10-25","cited_by_count":32,"area":null},{"id":"2108.12659","title":"DKM: Differentiable K-Means Clustering Layer for Neural Network Compression","created":"2021-08-28","cited_by_count":31,"area":null},{"id":"2210.13738","title":"Pruning's Effect on Generalization Through the Lens of Training and Regularization","created":"2022-10-25","cited_by_count":31,"area":null},{"id":"2207.10888","title":"FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification","created":"2022-07-22","cited_by_count":30,"area":null},{"id":"2302.03773","title":"What Matters In The Structured Pruning of Generative Language Models?","created":"2023-02-07","cited_by_count":30,"area":null},{"id":"2304.02840","title":"NTK-SAP: Improving neural network pruning by aligning training dynamics","created":"2023-04-06","cited_by_count":30,"area":null},{"id":"2106.06091","title":"DECORE: Deep Compression with Reinforcement Learning","created":"2021-06-11","cited_by_count":29,"area":null},{"id":"2409.18962","title":"Exploring Token Pruning in Vision State Space Models","created":"2024-09-27","cited_by_count":28,"area":"inference"},{"id":"2106.09857","title":"Effective Model Sparsification by Scheduled Grow-and-Prune Methods","created":"2021-06-18","cited_by_count":26,"area":null},{"id":"2102.08329","title":"An Information-Theoretic Justification for Model Pruning","created":"2021-02-16","cited_by_count":25,"area":null},{"id":"2105.03193","title":"Network Pruning That Matters: A Case Study on Retraining Variants","created":"2021-05-07","cited_by_count":25,"area":null},{"id":"2305.02538","title":"Cuttlefish: Low-Rank Model Training without All the Tuning","created":"2023-05-04","cited_by_count":25,"area":null},{"id":"2310.08670","title":"Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction","created":"2023-10-12","cited_by_count":24,"area":null},{"id":"2203.15331","title":"CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters","created":"2022-03-29","cited_by_count":20,"area":null},{"id":"2209.08554","title":"Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions","created":"2022-09-18","cited_by_count":20,"area":null},{"id":"2102.07804","title":"Scaling Up Exact Neural Network Compression by ReLU Stability","created":"2021-02-15","cited_by_count":19,"area":null},{"id":"2102.10212","title":"Hard-Attention for Scalable Image Classification","created":"2021-02-20","cited_by_count":18,"area":null},{"id":"2103.05152","title":"Knowledge Evolution in Neural Networks","created":"2021-03-09","cited_by_count":18,"area":null},{"id":"2110.14856","title":"An Operator Theoretic View on Pruning Deep Neural Networks","created":"2021-10-28","cited_by_count":18,"area":null},{"id":"2111.00162","title":"You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership","created":"2021-10-30","cited_by_count":18,"area":null},{"id":"2302.11974","title":"LightCTS: A Lightweight Framework for Correlated Time Series Forecasting","created":"2023-02-23","cited_by_count":18,"area":null},{"id":"2403.12983","title":"OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization","created":"2024-03-02","cited_by_count":18,"area":null},{"id":"2106.02694","title":"Efficient Classification of Very Large Images with Tiny Objects","created":"2021-06-04","cited_by_count":17,"area":null},{"id":"2101.07985","title":"Network Pruning using Adaptive Exemplar Filters","created":"2021-01-20","cited_by_count":16,"area":null},{"id":"2202.07190","title":"Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters","created":"2022-02-15","cited_by_count":16,"area":null},{"id":"2407.02068","title":"LPViT: Low-Power Semi-structured Pruning for Vision Transformers","created":"2024-07-02","cited_by_count":16,"area":null},{"id":"2110.14120","title":"ScaleCert: Scalable Certified Defense against Adversarial Patches with Sparse Superficial Layers","created":"2021-10-27","cited_by_count":15,"area":null},{"id":"2201.03297","title":"GhostNets on Heterogeneous Devices via Cheap Operations","created":"2022-01-10","cited_by_count":15,"area":null},{"id":"2104.11939","title":"Piggyback GAN: Efficient Lifelong Learning for Image Conditioned Generation","created":"2021-04-24","cited_by_count":14,"area":null},{"id":"2106.09309","title":"Layer Folding: Neural Network Depth Reduction using Activation Linearization","created":"2021-06-17","cited_by_count":14,"area":null},{"id":"2304.14271","title":"A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services","created":"2023-04-13","cited_by_count":14,"area":null},{"id":"2510.12474","title":"SMEC: Rethinking Matryoshka Representation Learning for Retrieval Embedding Compression","created":"2025-10-14","cited_by_count":14,"area":null},{"id":"2211.02206","title":"Soft Masking for Cost-Constrained Channel Pruning","created":"2022-11-04","cited_by_count":12,"area":null},{"id":"2305.11203","title":"PDP: Parameter-free Differentiable Pruning is All You Need","created":"2023-05-18","cited_by_count":12,"area":null},{"id":"2407.04208","title":"AMD: Automatic Multi-step Distillation of Large-scale Vision Models","created":"2024-07-05","cited_by_count":12,"area":null},{"id":"2107.10624","title":"LANA: Latency Aware Network Acceleration","created":"2021-07-12","cited_by_count":11,"area":"distill"},{"id":"2209.11204","title":"Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training","created":"2022-09-22","cited_by_count":11,"area":null},{"id":"2212.01977","title":"Distributed Pruning Towards Tiny Neural Networks in Federated Learning","created":"2022-12-05","cited_by_count":11,"area":null},{"id":"2406.02996","title":"Quantifying Task Priority for Multi-Task Optimization","created":"2024-06-05","cited_by_count":11,"area":null},{"id":"2109.10795","title":"Neural network relief: a pruning algorithm based on neural activity","created":"2021-09-22","cited_by_count":10,"area":null},{"id":"2203.13483","title":"MKQ-BERT: Quantized BERT with 4-bits Weights and Activations","created":"2022-03-25","cited_by_count":10,"area":null},{"id":"2301.05345","title":"GOHSP: A Unified Framework of Graph and Optimization-based Heterogeneous Structured Pruning for Vision Transformer","created":"2023-01-13","cited_by_count":10,"area":null},{"id":"2303.13097","title":"CP$^3$: Channel Pruning Plug-in for Point-based Networks","created":"2023-03-23","cited_by_count":10,"area":null},{"id":"2107.14444","title":"Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN","created":"2021-07-30","cited_by_count":9,"area":null},{"id":"2112.15131","title":"Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniques","created":"2021-12-30","cited_by_count":9,"area":null},{"id":"2206.02976","title":"Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm","created":"2022-06-07","cited_by_count":9,"area":null},{"id":"2207.04089","title":"SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevance","created":"2022-07-08","cited_by_count":9,"area":null},{"id":"2207.10188","title":"Bitwidth-Adaptive Quantization-Aware Neural Network Training: A Meta-Learning Approach","created":"2022-07-20","cited_by_count":9,"area":null},{"id":"2303.11923","title":"Performance-aware Approximation of Global Channel Pruning for Multitask CNNs","created":"2023-03-21","cited_by_count":9,"area":null},{"id":"2412.02852","title":"Learnable Sparsity for Vision Generative Models","created":"2024-12-03","cited_by_count":9,"area":"diffusion"},{"id":"2301.07966","title":"Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions","created":"2023-01-19","cited_by_count":8,"area":null},{"id":"2302.14670","title":"Balanced Training for Sparse GANs","created":"2023-02-28","cited_by_count":8,"area":null},{"id":"2402.07839","title":"Towards Meta-Pruning via Optimal Transport","created":"2024-02-12","cited_by_count":8,"area":null},{"id":"2403.18955","title":"Structurally Prune Anything: Any Architecture, Any Framework, Any Time","created":"2024-03-03","cited_by_count":8,"area":null},{"id":"2407.19126","title":"Greedy Output Approximation: Towards Efficient Structured Pruning for LLMs Without Retraining","created":"2024-07-26","cited_by_count":8,"area":null},{"id":"2102.00160","title":"Deep Model Compression based on the Training History","created":"2021-01-30","cited_by_count":7,"area":null},{"id":"2105.14636","title":"LEAP: Learnable Pruning for Transformer-based Models","created":"2021-05-30","cited_by_count":7,"area":null},{"id":"2111.11581","title":"Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration","created":"2021-11-22","cited_by_count":7,"area":null},{"id":"2304.09876","title":"Model Pruning Enables Localized and Efficient Federated Learning for Yield Forecasting and Data Sharing","created":"2023-04-19","cited_by_count":7,"area":null},{"id":"2408.16772","title":"An Effective Information Theoretic Framework for Channel Pruning","created":"2024-08-14","cited_by_count":7,"area":null},{"id":"2412.00143","title":"Is Oracle Pruning the True Oracle?","created":"2024-11-28","cited_by_count":7,"area":null},{"id":"2103.09716","title":"Quantitative Performance Assessment of CNN Units via Topological Entropy Calculation","created":"2021-03-17","cited_by_count":6,"area":null},{"id":"2103.10858","title":"Toward Compact Deep Neural Networks via Energy-Aware Pruning","created":"2021-03-19","cited_by_count":6,"area":null},{"id":"2103.16403","title":"Dynamic Domain Adaptation for Efficient Inference","created":"2021-03-26","cited_by_count":6,"area":null},{"id":"2105.03679","title":"EZCrop: Energy-Zoned Channels for Robust Output Pruning","created":"2021-05-08","cited_by_count":6,"area":null},{"id":"2105.06052","title":"Model Pruning Based on Quantified Similarity of Feature Maps","created":"2021-05-13","cited_by_count":6,"area":null},{"id":"2302.08185","title":"WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural Networks","created":"2023-02-16","cited_by_count":6,"area":null},{"id":"2405.02347","title":"COPAL: Continual Pruning in Large Language Generative Models","created":"2024-05-02","cited_by_count":6,"area":null},{"id":"2105.12344","title":"Probabilistic Selective Encryption of Convolutional Neural Networks for Hierarchical Services","created":"2021-05-26","cited_by_count":5,"area":null},{"id":"2107.06916","title":"Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion","created":"2021-07-14","cited_by_count":5,"area":null},{"id":"2201.06776","title":"Pruning-aware Sparse Regularization for Network Pruning","created":"2022-01-18","cited_by_count":5,"area":null},{"id":"2209.13590","title":"Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruning","created":"2022-09-27","cited_by_count":5,"area":null},{"id":"2302.03281","title":"Utility-based Perturbed Gradient Descent: An Optimizer for Continual Learning","created":"2023-02-07","cited_by_count":5,"area":null},{"id":"2303.09736","title":"Dynamic Structure Pruning for Compressing CNNs","created":"2023-03-17","cited_by_count":5,"area":null},{"id":"2306.04147","title":"CFDP: Common Frequency Domain Pruning","created":"2023-06-07","cited_by_count":5,"area":null},{"id":"2306.15337","title":"Homological Neural Networks: A Sparse Architecture for Multivariate Complexity","created":"2023-06-27","cited_by_count":5,"area":null},{"id":"2310.12612","title":"How a student becomes a teacher: learning and forgetting through Spectral methods","created":"2023-10-19","cited_by_count":5,"area":"distill"},{"id":"2401.10139","title":"Model Compression Techniques in Biometrics Applications: A Survey","created":"2024-01-18","cited_by_count":5,"area":null},{"id":"2108.00259","title":"How much pre-training is enough to discover a good subnetwork?","created":"2021-07-31","cited_by_count":4,"area":null},{"id":"2111.09635","title":"Automatic Neural Network Pruning that Efficiently Preserves the Model Accuracy","created":"2021-11-18","cited_by_count":4,"area":null}],"next_cursor":"100"}