{"total":110,"rows":[{"id":"2205.10770","title":"Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models","created":"2022-05-22","cited_by_count":220,"area":null},{"id":"2210.08090","title":"Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning","created":"2022-10-14","cited_by_count":71,"area":null},{"id":"2307.09542","title":"Can Neural Network Memorization Be Localized?","created":"2023-07-18","cited_by_count":69,"area":null},{"id":"2212.06152","title":"Accelerating Dataset Distillation via Model Augmentation","created":"2022-12-12","cited_by_count":62,"area":null},{"id":"2105.12002","title":"Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization","created":"2021-05-25","cited_by_count":56,"area":null},{"id":"2209.14981","title":"Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging","created":"2022-09-29","cited_by_count":54,"area":null},{"id":"2107.00166","title":"Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?","created":"2021-07-01","cited_by_count":52,"area":null},{"id":"2102.04828","title":"Consensus Control for Decentralized Deep Learning","created":"2021-02-09","cited_by_count":49,"area":null},{"id":"2103.04514","title":"Nondeterminism and Instability in Neural Network Optimization","created":"2021-03-08","cited_by_count":48,"area":null},{"id":"2104.11832","title":"Playing Lottery Tickets with Vision and Language","created":"2021-04-23","cited_by_count":45,"area":null},{"id":"2103.06460","title":"Recent Advances on Neural Network Pruning at Initialization","created":"2021-03-11","cited_by_count":41,"area":null},{"id":"2110.12007","title":"When to Prune? A Policy towards Early Structural Pruning","created":"2021-10-22","cited_by_count":38,"area":null},{"id":"2206.12680","title":"Topology-aware Generalization of Decentralized SGD","created":"2022-06-25","cited_by_count":38,"area":null},{"id":"2210.03044","title":"Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask?","created":"2022-10-06","cited_by_count":38,"area":null},{"id":"2210.06640","title":"Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities","created":"2022-10-13","cited_by_count":38,"area":null},{"id":"2107.08562","title":"Rethinking Graph Auto-Encoder Models for Attributed Graph Clustering","created":"2021-07-19","cited_by_count":37,"area":null},{"id":"2210.15031","title":"Characterizing Datapoints via Second-Split Forgetting","created":"2022-10-26","cited_by_count":37,"area":null},{"id":"2106.00134","title":"GANs Can Play Lottery Tickets Too","created":"2021-05-31","cited_by_count":32,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2110.14068","title":"Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks","created":"2021-10-26","cited_by_count":29,"area":null},{"id":"2202.04736","title":"Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets","created":"2022-02-09","cited_by_count":27,"area":null},{"id":"2303.02141","title":"Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!","created":"2023-03-03","cited_by_count":27,"area":null},{"id":"2103.00397","title":"Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective","created":"2021-02-28","cited_by_count":25,"area":null},{"id":"2105.01648","title":"On Lottery Tickets and Minimal Task Representations in Deep Reinforcement Learning","created":"2021-05-04","cited_by_count":24,"area":null},{"id":"2410.10373","title":"Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late in Training","created":"2024-10-14","cited_by_count":24,"area":null},{"id":"2102.11068","title":"Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not?","created":"2021-02-19","cited_by_count":22,"area":null},{"id":"2111.07167","title":"The Three Stages of Learning Dynamics in High-Dimensional Kernel Methods","created":"2021-11-13","cited_by_count":22,"area":null},{"id":"2206.01278","title":"Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks","created":"2022-06-02","cited_by_count":21,"area":null},{"id":"2105.00303","title":"RATT: Leveraging Unlabeled Data to Guarantee Generalization","created":"2021-05-01","cited_by_count":20,"area":null},{"id":"2503.18595","title":"Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition","created":"2025-03-24","cited_by_count":19,"area":null},{"id":"2407.05694","title":"On the Limitations of Compute Thresholds as a Governance Strategy","created":"2024-07-08","cited_by_count":18,"area":null},{"id":"2106.02624","title":"ViViT: Curvature access through the generalized Gauss-Newton's low-rank structure","created":"2021-06-04","cited_by_count":16,"area":null},{"id":"2308.09543","title":"Latent State Models of Training Dynamics","created":"2023-08-18","cited_by_count":16,"area":null},{"id":"2402.19262","title":"Masks, Signs, And Learning Rate Rewinding","created":"2024-02-29","cited_by_count":15,"area":null},{"id":"2406.03880","title":"Memorization in deep learning: A survey","created":"2024-06-06","cited_by_count":15,"area":null},{"id":"2205.08099","title":"Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey","created":"2022-05-17","cited_by_count":12,"area":null},{"id":"2106.06955","title":"Towards Understanding Iterative Magnitude Pruning: Why Lottery Tickets Win","created":"2021-06-13","cited_by_count":11,"area":null},{"id":"2212.07295","title":"Maximal Initial Learning Rates in Deep ReLU Networks","created":"2022-12-14","cited_by_count":11,"area":null},{"id":"2305.12201","title":"GraVAC: Adaptive Compression for Communication-Efficient Distributed DL Training","created":"2023-05-20","cited_by_count":10,"area":null},{"id":"2307.00182","title":"Single-Stage Heavy-Tailed Food Classification","created":"2023-07-01","cited_by_count":10,"area":null},{"id":"2310.01225","title":"A path-norm toolkit for modern networks: consequences, promises and challenges","created":"2023-10-02","cited_by_count":10,"area":null},{"id":"2212.01076","title":"Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training?","created":"2022-12-02","cited_by_count":9,"area":null},{"id":"2302.09160","title":"Identifying Equivalent Training Dynamics","created":"2023-02-17","cited_by_count":9,"area":null},{"id":"2506.13234","title":"The Butterfly Effect: Neural Network Training Trajectories Are Highly Sensitive to Initial Conditions","created":"2025-06-16","cited_by_count":9,"area":null},{"id":"2110.03210","title":"Universality of Winning Tickets: A Renormalization Group Perspective","created":"2021-10-07","cited_by_count":8,"area":null},{"id":"2202.08978","title":"Cyclical Focal Loss","created":"2022-02-16","cited_by_count":8,"area":null},{"id":"2301.08897","title":"ScaDLES: Scalable Deep Learning over Streaming data at the Edge","created":"2023-01-21","cited_by_count":8,"area":null},{"id":"2102.06604","title":"Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2202.12400","title":"The rise of the lottery heroes: why zero-shot pruning is hard","created":"2022-02-24","cited_by_count":7,"area":null},{"id":"2207.08148","title":"Improving Deep Neural Network Random Initialization Through Neuronal Rewiring","created":"2022-07-17","cited_by_count":7,"area":null},{"id":"2307.07950","title":"Accelerating Distributed ML Training via Selective Synchronization","created":"2023-07-16","cited_by_count":7,"area":null},{"id":"2410.23495","title":"DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity","created":"2024-10-30","cited_by_count":7,"area":null},{"id":"2503.01052","title":"ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Party LLM Data Valuation","created":"2025-03-02","cited_by_count":7,"area":null},{"id":"2103.06733","title":"Intraclass clustering: an implicit learning ability that regularizes DNNs","created":"2021-03-11","cited_by_count":6,"area":null},{"id":"2107.02086","title":"One-Cycle Pruning: Pruning ConvNets Under a Tight Training Budget","created":"2021-07-05","cited_by_count":6,"area":null},{"id":"2310.07996","title":"Reset It and Forget It: Relearning Last-Layer Weights Improves Continual and Transfer Learning","created":"2023-10-12","cited_by_count":6,"area":null},{"id":"2312.05282","title":"Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint","created":"2023-12-08","cited_by_count":6,"area":null},{"id":"2406.01468","title":"Understanding Token Probability Encoding in Output Embeddings","created":"2024-06-03","cited_by_count":6,"area":null},{"id":"2501.06386","title":"Using Pre-trained LLMs for Multivariate Time Series Forecasting","created":"2025-01-10","cited_by_count":6,"area":null},{"id":"2502.18710","title":"Bridging Critical Gaps in Convergent Learning: How Representational Alignment Evolves Across Layers, Training, and Distribution Shifts","created":"2025-02-26","cited_by_count":6,"area":null},{"id":"2202.08835","title":"General Cyclical Training of Neural Networks","created":"2022-02-17","cited_by_count":5,"area":null},{"id":"2206.00832","title":"Fast Benchmarking of Accuracy vs. Training Time with Cyclic Learning Rates","created":"2022-06-02","cited_by_count":5,"area":null},{"id":"2305.17409","title":"On the special role of class-selective neurons in early training","created":"2023-05-27","cited_by_count":5,"area":null},{"id":"2201.11103","title":"Auto-Compressing Subset Pruning for Semantic Image Segmentation","created":"2022-01-26","cited_by_count":4,"area":null},{"id":"2405.15006","title":"A Rescaling-Invariant Lipschitz Bound Based on Path-Metrics for Modern ReLU Network Parameterizations","created":"2024-05-23","cited_by_count":4,"area":null},{"id":"2505.00649","title":"Investigating Task Arithmetic for Zero-Shot Information Retrieval","created":"2025-05-01","cited_by_count":4,"area":null},{"id":"2104.13343","title":"Sifting out the features by pruning: Are convolutional networks the winning lottery ticket of fully connected ones?","created":"2021-04-27","cited_by_count":3,"area":null},{"id":"2201.04194","title":"Neural Capacitance: A New Perspective of Neural Network Selection via Edge Dynamics","created":"2022-01-11","cited_by_count":3,"area":null},{"id":"2211.00683","title":"Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation","created":"2022-11-01","cited_by_count":3,"area":null},{"id":"2312.02493","title":"Flexible Communication for Optimal Distributed Learning over Unpredictable Networks","created":"2023-12-05","cited_by_count":3,"area":null},{"id":"2407.15200","title":"HyperbolicLR: Epoch insensitive learning rate scheduler","created":"2024-07-21","cited_by_count":3,"area":null},{"id":"2411.00360","title":"A Simple Remedy for Dataset Bias via Self-Influence: A Mislabeled Sample Perspective","created":"2024-11-01","cited_by_count":3,"area":null},{"id":"2505.13900","title":"New Evidence of the Two-Phase Learning Dynamics of Neural Networks","created":"2025-05-20","cited_by_count":3,"area":null},{"id":"2605.26161","title":"TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Models","created":"2026-05-24","cited_by_count":3,"area":null},{"id":"2303.15479","title":"Exploring the Performance of Pruning Methods in Neural Networks: An Empirical Study of the Lottery Ticket Hypothesis","created":"2023-03-26","cited_by_count":2,"area":null},{"id":"2306.00045","title":"Lottery Tickets in Evolutionary Optimization: On Sparse Backpropagation-Free Trainability","created":"2023-05-31","cited_by_count":2,"area":null},{"id":"2408.14677","title":"Can Optimization Trajectories Explain Multi-Task Transfer?","created":"2024-08-26","cited_by_count":2,"area":null},{"id":"2509.26524","title":"TAP: Two-Stage Adaptive Personalization of Multi-Task and Multi-Modal Foundation Models in Federated Learning","created":"2025-09-30","cited_by_count":2,"area":null},{"id":"2206.15387","title":"Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning","created":"2022-06-30","cited_by_count":1,"area":null},{"id":"2304.11692","title":"The Disharmony between BN and ReLU Causes Gradient Explosion, but is Offset by the Correlation between Activations","created":"2023-04-23","cited_by_count":1,"area":null},{"id":"2403.15210","title":"Early Period of Training Impacts Adaptation for Out-of-Distribution Generalization: An Empirical Study","created":"2024-03-22","cited_by_count":1,"area":null},{"id":"2405.00252","title":"Q-Newton: Hybrid Quantum-Classical Scheduling for Accelerating Neural Network Training with Newton's Gradient Descent","created":"2024-04-30","cited_by_count":1,"area":null},{"id":"2410.16392","title":"Scaffolded Language Models with Language Supervision for Mixed-Autonomy: A Survey","created":"2024-10-21","cited_by_count":1,"area":null},{"id":"2412.06545","title":"On How Iterative Magnitude Pruning Discovers Local Receptive Fields in Fully Connected Neural Networks","created":"2024-12-09","cited_by_count":1,"area":null},{"id":"2504.05357","title":"Find A Winning Sign: Sign Is All We Need to Win the Lottery","created":"2025-04-07","cited_by_count":1,"area":null},{"id":"2504.11830","title":"Emergence of Computational Structure in a Neural Network Physics Simulator","created":"2025-04-16","cited_by_count":1,"area":null},{"id":"2507.01559","title":"How Weight Resampling and Optimizers Shape the Dynamics of Continual Learning and Forgetting in Neural Networks","created":"2025-07-02","cited_by_count":1,"area":null},{"id":"2509.09030","title":"Contextual Learning for Anomaly Detection in Tabular Data","created":"2025-09-10","cited_by_count":1,"area":null},{"id":"2602.04832","title":"It's Not a Lottery, It's a Race: Understanding How Gradient Descent Adapts the Network's Capacity to the Task","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2603.10079","title":"Large Spikes in Stochastic Gradient Descent: A Large-Deviations View","created":"2026-03-10","cited_by_count":1,"area":null},{"id":"2201.11813","title":"Eigenvalues of Autoencoders in Training and at Initialization","created":"2022-01-27","cited_by_count":0,"area":null},{"id":"2203.08174","title":"Towards understanding deep learning with the natural clustering prior","created":"2022-03-15","cited_by_count":0,"area":null},{"id":"2307.08811","title":"Co(ve)rtex: ML Models as storage channels and their (mis-)applications","created":"2023-07-17","cited_by_count":0,"area":null},{"id":"2403.08265","title":"Random Search as a Baseline for Sparse Neural Network Architecture Search","created":"2024-03-13","cited_by_count":0,"area":null},{"id":"2410.24187","title":"Chasing Better Deep Image Priors between Over- and Under-parameterization","created":"2024-10-31","cited_by_count":0,"area":null},{"id":"2504.01737","title":"Enlightenment Period Improving DNN Performance","created":"2025-04-02","cited_by_count":0,"area":null},{"id":"2505.22042","title":"Estimating the Effects of Sample Training Orders for Large Language Models without Retraining","created":"2025-05-28","cited_by_count":0,"area":null},{"id":"2509.10537","title":"On Using Large-Batches in Federated Learning","created":"2025-09-05","cited_by_count":0,"area":null},{"id":"2510.05606","title":"Fractal basin geometry and the limits to predictability and reproducibility in deep learning","created":"2025-10-07","cited_by_count":0,"area":null},{"id":"2512.07142","title":"Winning the Lottery by Preserving Network Training Dynamics with Concrete Ticket Search","created":"2025-12-08","cited_by_count":0,"area":null}],"next_cursor":"100"}