{"total":479,"rows":[{"id":"2210.17323","title":"GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers","created":"2022-10-31","cited_by_count":1919,"area":null},{"id":"2301.00774","title":"SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot","created":"2023-01-02","cited_by_count":1121,"area":null},{"id":"2306.01708","title":"TIES-Merging: Resolving Interference When Merging Models","created":"2023-06-02","cited_by_count":818,"area":null},{"id":"2103.13630","title":"A Survey of Quantization Methods for Efficient Neural Network Inference","created":"2021-03-25","cited_by_count":815,"area":null},{"id":"2306.11695","title":"A Simple and Effective Pruning Approach for Large Language Models","created":"2023-06-20","cited_by_count":800,"area":null},{"id":"2303.06865","title":"FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU","created":"2023-03-13","cited_by_count":575,"area":null},{"id":"2401.15024","title":"SliceGPT: Compress Large Language Models by Deleting Rows and Columns","created":"2024-01-26","cited_by_count":385,"area":null},{"id":"2306.03078","title":"SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression","created":"2023-06-05","cited_by_count":367,"area":null},{"id":"2208.11580","title":"Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning","created":"2022-08-24","cited_by_count":322,"area":null},{"id":"2310.17157","title":"Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time","created":"2023-10-26","cited_by_count":252,"area":null},{"id":"2209.09858","title":"Extremely Simple Activation Shaping for Out-of-Distribution Detection","created":"2022-09-20","cited_by_count":212,"area":null},{"id":"2308.06767","title":"A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendations","created":"2023-08-13","cited_by_count":202,"area":null},{"id":"2210.06313","title":"The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers","created":"2022-10-12","cited_by_count":122,"area":null},{"id":"2303.00566","title":"Structured Pruning for Deep Convolutional Neural Networks: A survey","created":"2023-03-01","cited_by_count":122,"area":null},{"id":"2403.02181","title":"Not All Layers of LLMs Are Necessary During Inference","created":"2024-03-04","cited_by_count":96,"area":null},{"id":"2308.06077","title":"Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling","created":"2023-08-11","cited_by_count":95,"area":null},{"id":"2202.14026","title":"Robust Training under Label Noise by Over-parameterization","created":"2022-02-28","cited_by_count":93,"area":null},{"id":"2403.14123","title":"AI and Memory Wall","created":"2024-03-21","cited_by_count":92,"area":null},{"id":"2106.10404","title":"Sparse Training via Boosting Pruning Plasticity with Neuroregeneration","created":"2021-06-19","cited_by_count":84,"area":null},{"id":"2209.00099","title":"Efficient Methods for Natural Language Processing: A Survey","created":"2022-08-31","cited_by_count":78,"area":null},{"id":"2107.06925","title":"Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines","created":"2021-07-14","cited_by_count":68,"area":null},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2210.08277","title":"Deep Differentiable Logic Gate Networks","created":"2022-10-15","cited_by_count":67,"area":null},{"id":"2206.10369","title":"The State of Sparse Training in Deep Reinforcement Learning","created":"2022-06-17","cited_by_count":61,"area":null},{"id":"2106.12379","title":"AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks","created":"2021-06-23","cited_by_count":59,"area":null},{"id":"2311.09755","title":"On the Impact of Calibration Data in Post-training Quantization and Pruning","created":"2023-11-16","cited_by_count":58,"area":null},{"id":"2210.04092","title":"Advancing Model Pruning via Bi-level Optimization","created":"2022-10-08","cited_by_count":56,"area":null},{"id":"2111.13445","title":"How Well Do Sparse Imagenet Models Transfer?","created":"2021-11-26","cited_by_count":50,"area":null},{"id":"2408.13656","title":"Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic","created":"2024-08-24","cited_by_count":50,"area":null},{"id":"2106.04217","title":"Dynamic Sparse Training for Deep Reinforcement Learning","created":"2021-06-08","cited_by_count":49,"area":null},{"id":"2302.04089","title":"ZipLM: Inference-Aware Structured Pruning of Language Models","created":"2023-02-07","cited_by_count":49,"area":null},{"id":"2110.14678","title":"Meta-Learning Sparse Implicit Neural Representations","created":"2021-10-27","cited_by_count":48,"area":null},{"id":"2401.04679","title":"RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation","created":"2024-01-09","cited_by_count":48,"area":null},{"id":"2207.04606","title":"SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning","created":"2022-07-11","cited_by_count":47,"area":null},{"id":"2402.02769","title":"Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate","created":"2024-02-05","cited_by_count":47,"area":null},{"id":"2406.00600","title":"Kolmogorov-Arnold Network for Satellite Image Classification in Remote Sensing","created":"2024-06-02","cited_by_count":47,"area":null},{"id":"2208.02507","title":"ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity","created":"2022-08-04","cited_by_count":45,"area":null},{"id":"2406.02214","title":"SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining","created":"2024-06-04","cited_by_count":45,"area":null},{"id":"2106.14568","title":"Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity","created":"2021-06-28","cited_by_count":44,"area":null},{"id":"2412.18110","title":"SlimGPT: Layer-wise Structured Pruning for Large Language Models","created":"2024-12-24","cited_by_count":44,"area":null},{"id":"2309.08520","title":"Scaling Laws for Sparsely-Connected Foundation Models","created":"2023-09-15","cited_by_count":43,"area":null},{"id":"2103.06460","title":"Recent Advances on Neural Network Pruning at Initialization","created":"2021-03-11","cited_by_count":41,"area":null},{"id":"2404.08763","title":"CATS: Contextually-Aware Thresholding for Sparsity in Large Language Models","created":"2024-04-12","cited_by_count":41,"area":null},{"id":"2209.14764","title":"Model Zoos: A Dataset of Diverse Populations of Neural Network Models","created":"2022-09-29","cited_by_count":39,"area":null},{"id":"2210.06640","title":"Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities","created":"2022-10-13","cited_by_count":38,"area":null},{"id":"2305.02299","title":"Dynamic Sparse Training with Structured Sparsity","created":"2023-05-03","cited_by_count":38,"area":null},{"id":"2411.04732","title":"Convolutional Differentiable Logic Gate Networks","created":"2024-11-07","cited_by_count":37,"area":null},{"id":"2201.13096","title":"SPDY: Accurate Pruning with Speedup Guarantees","created":"2022-01-31","cited_by_count":36,"area":null},{"id":"2502.15938","title":"Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs","created":"2025-02-21","cited_by_count":35,"area":null},{"id":"2402.16840","title":"MobiLlama: Towards Accurate and Lightweight Fully Transparent GPT","created":"2024-02-26","cited_by_count":34,"area":null},{"id":"2210.01035","title":"Expediting Large-Scale Vision Transformer for Dense Prediction without Fine-tuning","created":"2022-10-03","cited_by_count":33,"area":null},{"id":"2110.13041","title":"Applications and Techniques for Fast Machine Learning in Science","created":"2021-10-25","cited_by_count":32,"area":null},{"id":"2303.03428","title":"Towards provably efficient quantum algorithms for large-scale machine-learning models","created":"2023-03-06","cited_by_count":32,"area":null},{"id":"2210.12538","title":"Compressing multidimensional weather and climate data into neural networks","created":"2022-10-22","cited_by_count":31,"area":null},{"id":"2206.01299","title":"Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees","created":"2022-06-02","cited_by_count":30,"area":null},{"id":"2210.00965","title":"Green Learning: Introduction, Examples and Outlook","created":"2022-10-03","cited_by_count":30,"area":null},{"id":"2208.06118","title":"An Algorithm-Hardware Co-Optimized Framework for Accelerating N:M Sparse Transformers","created":"2022-08-12","cited_by_count":29,"area":null},{"id":"2309.01885","title":"QuantEase: Optimization-based Quantization for Language Models","created":"2023-09-05","cited_by_count":29,"area":null},{"id":"2303.10464","title":"SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models","created":"2023-03-18","cited_by_count":28,"area":null},{"id":"2202.04736","title":"Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets","created":"2022-02-09","cited_by_count":27,"area":null},{"id":"2206.06178","title":"Efficient recurrent architectures through activity sparsity and sparse back-propagation through time","created":"2022-06-13","cited_by_count":26,"area":null},{"id":"2206.08684","title":"Sparse Double Descent: Where Network Pruning Aggravates Overfitting","created":"2022-06-17","cited_by_count":26,"area":null},{"id":"2401.16405","title":"Scaling Sparse Fine-Tuning to Large Language Models","created":"2024-01-29","cited_by_count":26,"area":null},{"id":"2302.02596","title":"Ten Lessons We Have Learned in the New \"Sparseland\": A Short Handbook for Sparse Neural Network Researchers","created":"2023-02-06","cited_by_count":25,"area":null},{"id":"2302.05601","title":"Pruning Deep Neural Networks from a Sparsity Perspective","created":"2023-02-11","cited_by_count":25,"area":null},{"id":"2312.08917","title":"An Incremental Unified Framework for Small Defect Inspection","created":"2023-12-14","cited_by_count":25,"area":null},{"id":"2206.07647","title":"Hyperparameter Sensitivity in Deep Outlier Detection: Analysis and a Scalable Hyper-Ensemble Solution","created":"2022-06-15","cited_by_count":24,"area":null},{"id":"2201.07598","title":"Near-Optimal Sparse Allreduce for Distributed Deep Learning","created":"2022-01-19","cited_by_count":23,"area":null},{"id":"2203.04940","title":"Data-Efficient Structured Pruning via Submodular Optimization","created":"2022-03-09","cited_by_count":23,"area":null},{"id":"2402.17946","title":"SparseLLM: Towards Global Pruning for Pre-trained Language Models","created":"2024-02-28","cited_by_count":23,"area":null},{"id":"2212.09840","title":"Dynamic Sparse Network for Time Series Classification: Learning What to \"see''","created":"2022-12-19","cited_by_count":22,"area":null},{"id":"2212.11110","title":"Lifelong Reinforcement Learning with Modulating Masks","created":"2022-12-21","cited_by_count":22,"area":null},{"id":"2408.13233","title":"Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Time","created":"2024-08-23","cited_by_count":22,"area":null},{"id":"2310.04621","title":"Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences","created":"2023-10-06","cited_by_count":21,"area":null},{"id":"2407.19389","title":"FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction","created":"2024-07-28","cited_by_count":21,"area":null},{"id":"2106.09269","title":"Pruning Randomly Initialized Neural Networks with Iterative Randomization","created":"2021-06-17","cited_by_count":20,"area":null},{"id":"2210.09223","title":"CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision Models","created":"2022-10-14","cited_by_count":20,"area":null},{"id":"2306.16788","title":"Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging","created":"2023-06-29","cited_by_count":20,"area":null},{"id":"2405.16325","title":"SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs","created":"2024-05-25","cited_by_count":20,"area":null},{"id":"2304.07574","title":"Exploring Incompatible Knowledge Transfer in Few-shot Image Generation","created":"2023-04-15","cited_by_count":19,"area":null},{"id":"2405.20935","title":"Effective Interplay between Sparsity and Quantization: From Theory to Practice","created":"2024-05-31","cited_by_count":19,"area":null},{"id":"2408.12151","title":"A Tighter Complexity Analysis of SparseGPT","created":"2024-08-22","cited_by_count":19,"area":null},{"id":"2207.08629","title":"Comprehensive Graph Gradual Pruning for Sparse Training in Graph Neural Networks","created":"2022-07-18","cited_by_count":18,"area":null},{"id":"2402.04744","title":"Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers","created":"2024-02-07","cited_by_count":18,"area":null},{"id":"2211.12551","title":"Sparse Probabilistic Circuits via Pruning and Growing","created":"2022-11-22","cited_by_count":17,"area":null},{"id":"2306.12230","title":"Fantastic Weights and How to Find Them: Where to Prune in Dynamic Sparse Training","created":"2023-06-21","cited_by_count":17,"area":null},{"id":"2309.10285","title":"Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity","created":"2023-09-19","cited_by_count":17,"area":null},{"id":"2105.13011","title":"Neural Network Training Using $\\ell_1$-Regularization and Bi-fidelity Data","created":"2021-05-27","cited_by_count":16,"area":null},{"id":"2110.08350","title":"Differentiable Network Pruning for Microcontrollers","created":"2021-10-15","cited_by_count":16,"area":null},{"id":"2205.11921","title":"Compression-aware Training of Neural Networks using Frank-Wolfe","created":"2022-05-24","cited_by_count":16,"area":null},{"id":"2207.12534","title":"Trainability Preserving Neural Pruning","created":"2022-07-25","cited_by_count":16,"area":null},{"id":"2209.06979","title":"Efficient Quantized Sparse Matrix Operations on Tensor Cores","created":"2022-09-14","cited_by_count":16,"area":null},{"id":"2301.05219","title":"Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning","created":"2023-01-12","cited_by_count":16,"area":null},{"id":"2310.03652","title":"Extreme sparsification of physics-augmented neural networks for interpretable model discovery in mechanics","created":"2023-10-05","cited_by_count":16,"area":null},{"id":"2312.04727","title":"E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentation","created":"2023-12-07","cited_by_count":16,"area":null},{"id":"2403.07630","title":"Hunting Attributes: Context Prototype-Aware Learning for Weakly Supervised Semantic Segmentation","created":"2024-03-12","cited_by_count":16,"area":null},{"id":"2405.15743","title":"Sparse maximal update parameterization: A holistic approach to sparse training dynamics","created":"2024-05-24","cited_by_count":16,"area":null},{"id":"2105.04319","title":"A Bregman Learning Framework for Sparse Neural Networks","created":"2021-05-10","cited_by_count":15,"area":null},{"id":"2109.04236","title":"ECQ$^{\\text{x}}$: Explainability-Driven Quantization for Low-Bit and Sparse DNNs","created":"2021-09-09","cited_by_count":15,"area":null},{"id":"2112.13896","title":"Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networks","created":"2021-12-27","cited_by_count":15,"area":null}],"next_cursor":"100"}