{"total":194,"rows":[{"id":"2403.14608","title":"Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey","created":"2024-03-21","cited_by_count":656,"area":null},{"id":"2308.06767","title":"A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendations","created":"2023-08-13","cited_by_count":202,"area":null},{"id":"2110.07560","title":"Composable Sparse Fine-Tuning for Cross-Lingual Transfer","created":"2021-10-14","cited_by_count":144,"area":null},{"id":"2112.00029","title":"Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models","created":"2021-11-30","cited_by_count":76,"area":null},{"id":"2211.07349","title":"Finding Skill Neurons in Pre-trained Transformer-based Language Models","created":"2022-11-14","cited_by_count":66,"area":null},{"id":"2103.09377","title":"Multi-Prize Lottery Ticket Hypothesis: Finding Accurate Binary Neural Networks by Pruning A Randomly Weighted Network","created":"2021-03-17","cited_by_count":55,"area":null},{"id":"2106.05933","title":"PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition","created":"2021-06-10","cited_by_count":53,"area":null},{"id":"2104.11832","title":"Playing Lottery Tickets with Vision and Language","created":"2021-04-23","cited_by_count":45,"area":null},{"id":"2103.06460","title":"Recent Advances on Neural Network Pruning at Initialization","created":"2021-03-11","cited_by_count":41,"area":null},{"id":"2203.04466","title":"The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks","created":"2022-03-09","cited_by_count":41,"area":null},{"id":"2202.12002","title":"Rare Gems: Finding Lottery Tickets at Initialization","created":"2022-02-24","cited_by_count":34,"area":null},{"id":"2103.06132","title":"MixMo: Mixing Multiple Inputs for Multiple Outputs via Deep Subnetworks","created":"2021-03-10","cited_by_count":32,"area":null},{"id":"2106.00134","title":"GANs Can Play Lottery Tickets Too","created":"2021-05-31","cited_by_count":32,"area":null},{"id":"2111.11146","title":"On the Existence of Universal Lottery Tickets","created":"2021-11-22","cited_by_count":30,"area":null},{"id":"2312.01429","title":"Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars","created":"2023-12-03","cited_by_count":30,"area":null},{"id":"2110.14068","title":"Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks","created":"2021-10-26","cited_by_count":29,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2210.02412","title":"Why Random Pruning Is All We Need to Start Sparse","created":"2022-10-05","cited_by_count":26,"area":null},{"id":"2208.04425","title":"Controlled Sparsity via Constrained Optimization or: How I Learned to Stop Tuning Penalties and Love Constraints","created":"2022-08-08","cited_by_count":25,"area":null},{"id":"2310.19103","title":"Proving Linear Mode Connectivity of Neural Networks via Optimal Transport","created":"2023-10-29","cited_by_count":25,"area":null},{"id":"2403.04861","title":"A Survey of Lottery Ticket Hypothesis","created":"2024-03-07","cited_by_count":24,"area":null},{"id":"2305.02190","title":"Rethinking Graph Lottery Tickets: Graph Sparsity Matters","created":"2023-05-03","cited_by_count":23,"area":null},{"id":"2102.11068","title":"Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not?","created":"2021-02-19","cited_by_count":22,"area":null},{"id":"2205.02321","title":"Most Activation Functions Can Win the Lottery Without Excessive Depth","created":"2022-05-04","cited_by_count":21,"area":null},{"id":"2106.09269","title":"Pruning Randomly Initialized Neural Networks with Iterative Randomization","created":"2021-06-17","cited_by_count":20,"area":null},{"id":"2108.02297","title":"Spartus: A 9.4 TOp/s FPGA-based LSTM Accelerator Exploiting Spatio-Temporal Sparsity","created":"2021-08-04","cited_by_count":20,"area":null},{"id":"2206.04270","title":"A General Framework For Proving The Equivariant Strong Lottery Ticket Hypothesis","created":"2022-06-09","cited_by_count":19,"area":null},{"id":"2202.09318","title":"DataMUX: Data Multiplexing for Neural Networks","created":"2022-02-18","cited_by_count":18,"area":null},{"id":"2209.07263","title":"Robustness in deep learning: The good (width), the bad (depth), and the ugly (initialization)","created":"2022-09-15","cited_by_count":18,"area":null},{"id":"2402.06323","title":"How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers","created":"2024-02-09","cited_by_count":18,"area":null},{"id":"2203.07808","title":"Interspace Pruning: Using Adaptive Filter Representations to Improve Training of Sparse CNNs","created":"2022-03-15","cited_by_count":16,"area":null},{"id":"2205.02343","title":"Convolutional and Residual Networks Provably Contain Lottery Tickets","created":"2022-05-04","cited_by_count":16,"area":null},{"id":"2302.02922","title":"Joint Edge-Model Sparse Learning is Provably Efficient for Graph Neural Networks","created":"2023-02-06","cited_by_count":16,"area":null},{"id":"2310.18123","title":"Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling","created":"2023-10-27","cited_by_count":16,"area":null},{"id":"2105.10065","title":"A Probabilistic Approach to Neural Network Pruning","created":"2021-05-20","cited_by_count":15,"area":null},{"id":"2106.09259","title":"A Random CNN Sees Objects: One Inductive Bias of CNN and Its Applications","created":"2021-06-17","cited_by_count":15,"area":null},{"id":"2402.19262","title":"Masks, Signs, And Learning Rate Rewinding","created":"2024-02-29","cited_by_count":15,"area":null},{"id":"2110.05667","title":"Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks","created":"2021-10-12","cited_by_count":14,"area":null},{"id":"2203.02026","title":"Provable and Efficient Continual Representation Learning","created":"2022-03-03","cited_by_count":14,"area":null},{"id":"2209.07238","title":"Generalization Properties of NAS under Activation and Skip Connection Search","created":"2022-09-15","cited_by_count":14,"area":null},{"id":"2408.09966","title":"Mask in the Mirror: Implicit Sparsification","created":"2024-08-19","cited_by_count":14,"area":null},{"id":"2111.11153","title":"Plant 'n' Seek: Can You Find the Winning Ticket?","created":"2021-11-22","cited_by_count":13,"area":null},{"id":"2207.09455","title":"To update or not to update? Neurons at equilibrium in deep models","created":"2022-07-19","cited_by_count":13,"area":null},{"id":"2205.08099","title":"Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey","created":"2022-05-17","cited_by_count":12,"area":null},{"id":"2310.16391","title":"Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization","created":"2023-10-25","cited_by_count":12,"area":null},{"id":"2308.10051","title":"The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive field","created":"2023-08-19","cited_by_count":11,"area":null},{"id":"2203.06031","title":"Exploiting Low-Rank Tensor-Train Deep Neural Networks Based on Riemannian Gradient Descent With Illustrations of Speech Processing","created":"2022-03-11","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2102.07655","title":"Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset","created":"2021-02-12","cited_by_count":9,"area":null},{"id":"2112.03406","title":"Equal Bits: Enforcing Equally Distributed Binary Network Weights","created":"2021-12-02","cited_by_count":9,"area":null},{"id":"2112.04002","title":"SHRIMP: Sparser Random Feature Models via Iterative Magnitude Pruning","created":"2021-12-07","cited_by_count":9,"area":null},{"id":"2203.14328","title":"On the Neural Tangent Kernel Analysis of Randomly Pruned Neural Networks","created":"2022-03-27","cited_by_count":9,"area":null},{"id":"2205.07320","title":"Analyzing Lottery Ticket Hypothesis from PAC-Bayesian Theory Perspective","created":"2022-05-15","cited_by_count":9,"area":null},{"id":"2210.06699","title":"Parameter-Efficient Masking Networks","created":"2022-10-13","cited_by_count":9,"area":null},{"id":"2503.06901","title":"PRO-VPT: Distribution-Adaptive Visual Prompt Tuning via Prompt Relocation","created":"2025-03-10","cited_by_count":9,"area":null},{"id":"2308.04637","title":"Sparse Binary Transformers for Multivariate Time Series Modeling","created":"2023-08-09","cited_by_count":8,"area":null},{"id":"2406.04934","title":"Optimal Recurrent Network Topologies for Dynamical Systems Reconstruction","created":"2024-06-07","cited_by_count":8,"area":null},{"id":"2202.12400","title":"The rise of the lottery heroes: why zero-shot pruning is hard","created":"2022-02-24","cited_by_count":7,"area":null},{"id":"2204.02965","title":"LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification","created":"2022-04-06","cited_by_count":7,"area":null},{"id":"2207.07858","title":"The Lottery Ticket Hypothesis for Self-attention in Convolutional Neural Network","created":"2022-07-16","cited_by_count":7,"area":null},{"id":"2209.08461","title":"Random Fourier Features for Asymmetric Kernels","created":"2022-09-18","cited_by_count":7,"area":null},{"id":"2211.01522","title":"Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Speech Processing","created":"2022-11-02","cited_by_count":7,"area":null},{"id":"2405.17420","title":"Survival of the Fittest Representation: A Case Study with Modular Addition","created":"2024-05-27","cited_by_count":7,"area":null},{"id":"2105.06052","title":"Model Pruning Based on Quantified Similarity of Feature Maps","created":"2021-05-13","cited_by_count":6,"area":null},{"id":"2206.05703","title":"PAC-Net: A Model Pruning Approach to Inductive Transfer Learning","created":"2022-06-12","cited_by_count":6,"area":null},{"id":"2303.01213","title":"DSD$^2$: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free?","created":"2023-03-02","cited_by_count":6,"area":null},{"id":"2408.11393","title":"First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models","created":"2024-08-21","cited_by_count":6,"area":null},{"id":"2511.18772","title":"Re-Key-Free, Risky-Free: Adaptable Model Usage Control","created":"2025-11-24","cited_by_count":6,"area":null},{"id":"2101.06475","title":"Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks","created":"2021-01-16","cited_by_count":5,"area":null},{"id":"2201.05229","title":"Examining and Mitigating the Impact of Crossbar Non-idealities for Accurate Implementation of Sparse Deep Neural Networks","created":"2022-01-13","cited_by_count":5,"area":null},{"id":"2206.05604","title":"A Theoretical Understanding of Neural Network Compression from Sparse Linear Approximation","created":"2022-06-11","cited_by_count":5,"area":null},{"id":"2301.11936","title":"Quantum Ridgelet Transform: Winning Lottery Ticket of Neural Networks with Quantum Computation","created":"2023-01-27","cited_by_count":5,"area":null},{"id":"2306.08125","title":"Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD","created":"2023-06-13","cited_by_count":5,"area":null},{"id":"2107.01461","title":"A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification","created":"2021-07-03","cited_by_count":4,"area":null},{"id":"2108.00259","title":"How much pre-training is enough to discover a good subnetwork?","created":"2021-07-31","cited_by_count":4,"area":null},{"id":"2110.08996","title":"Finding Everything within Random Binary Networks","created":"2021-10-18","cited_by_count":4,"area":null},{"id":"2110.11150","title":"Lottery Tickets with Nonzero Biases","created":"2021-10-21","cited_by_count":4,"area":null},{"id":"2205.10139","title":"Towards efficient feature sharing in MIMO architectures","created":"2022-05-20","cited_by_count":4,"area":null},{"id":"2205.15619","title":"Meta-ticket: Finding optimal subnetworks for few-shot learning within randomly initialized neural networks","created":"2022-05-31","cited_by_count":4,"area":null},{"id":"2408.03220","title":"Masked Random Noise for Communication Efficient Federated Learning","created":"2024-08-06","cited_by_count":4,"area":null},{"id":"2210.16169","title":"LOFT: Finding Lottery Tickets through Filter-wise Training","created":"2022-10-28","cited_by_count":3,"area":null},{"id":"2210.16589","title":"Strong Lottery Ticket Hypothesis with $\\varepsilon$--perturbation","created":"2022-10-29","cited_by_count":3,"area":null},{"id":"2212.13700","title":"Publishing Efficient On-device Models Increases Adversarial Vulnerability","created":"2022-12-28","cited_by_count":3,"area":null},{"id":"2301.00335","title":"Pruning Before Training May Improve Generalization, Provably","created":"2023-01-01","cited_by_count":3,"area":null},{"id":"2303.15953","title":"Randomly Initialized Subnetworks with Iterative Weight Recycling","created":"2023-03-28","cited_by_count":3,"area":null},{"id":"2305.12148","title":"Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network","created":"2023-05-20","cited_by_count":3,"area":null},{"id":"2311.09858","title":"Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets","created":"2023-11-16","cited_by_count":3,"area":null},{"id":"2402.02801","title":"KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models","created":"2024-02-05","cited_by_count":3,"area":null},{"id":"2404.08016","title":"ONNXPruner: ONNX-Based General Model Pruning Adapter","created":"2024-04-10","cited_by_count":3,"area":null},{"id":"2406.01755","title":"Sparser, Better, Deeper, Stronger: Improving Sparse Training with Exact Orthogonal Initialization","created":"2024-06-03","cited_by_count":3,"area":null},{"id":"2408.14601","title":"3D Point Cloud Network Pruning: When Some Weights Do not Matter","created":"2024-08-26","cited_by_count":3,"area":null},{"id":"2410.14754","title":"On the Sparsity of the Strong Lottery Ticket Hypothesis","created":"2024-10-18","cited_by_count":3,"area":null},{"id":"2411.03171","title":"Navigating Extremes: Dynamic Sparsity in Large Output Spaces","created":"2024-11-05","cited_by_count":3,"area":null},{"id":"2502.19078","title":"Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMs","created":"2025-02-26","cited_by_count":3,"area":null},{"id":"2503.08085","title":"PRISM: Privacy-Preserving Improved Stochastic Masking for Federated Generative Models","created":"2025-03-11","cited_by_count":3,"area":null},{"id":"2506.21374","title":"Pay Attention to Small Weights","created":"2025-06-26","cited_by_count":3,"area":null},{"id":"2506.23286","title":"Not All Explanations for Deep Learning Phenomena Are Equally Valuable","created":"2025-06-29","cited_by_count":3,"area":null},{"id":"2510.04500","title":"Expand Neurons, Not Parameters","created":"2025-10-06","cited_by_count":3,"area":null},{"id":"2602.01599","title":"The Multiple Ticket Hypothesis: Random Sparse Subnetworks Suffice for RLVR","created":"2026-02-02","cited_by_count":3,"area":null},{"id":"2108.13055","title":"Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions","created":"2021-08-30","cited_by_count":2,"area":null}],"next_cursor":"100"}