{"total":95,"rows":[{"id":"2402.03293","title":"Flora: Low-Rank Adapters Are Secretly Gradient Compressors","created":"2024-02-05","cited_by_count":108,"area":null},{"id":"2106.07820","title":"On Large-Cohort Training for Federated Learning","created":"2021-06-15","cited_by_count":74,"area":null},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63,"area":null},{"id":"2210.03403","title":"TAN Without a Burn: Scaling Laws of DP-SGD","created":"2022-10-07","cited_by_count":52,"area":null},{"id":"2507.07101","title":"Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful","created":"2025-07-09","cited_by_count":41,"area":null},{"id":"2209.07999","title":"Self-Supervised Learning with an Information Maximization Criterion","created":"2022-09-16","cited_by_count":38,"area":null},{"id":"2204.03216","title":"Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal data","created":"2022-04-07","cited_by_count":37,"area":null},{"id":"2302.08982","title":"(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability","created":"2023-02-17","cited_by_count":36,"area":null},{"id":"2310.03882","title":"Small batch deep reinforcement learning","created":"2023-10-05","cited_by_count":36,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2103.17182","title":"Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization","created":"2021-03-31","cited_by_count":28,"area":null},{"id":"2203.03756","title":"Flat minima generalize for low-rank matrix recovery","created":"2022-03-07","cited_by_count":28,"area":null},{"id":"2308.06015","title":"Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregation","created":"2023-08-11","cited_by_count":22,"area":null},{"id":"2105.01646","title":"Motion-Augmented Self-Training for Video Recognition at Smaller Scale","created":"2021-05-04","cited_by_count":17,"area":null},{"id":"2402.16828","title":"Training Neural Networks from Scratch with Parallel Low-Rank Adapters","created":"2024-02-26","cited_by_count":17,"area":null},{"id":"2206.02234","title":"Two Decades of Bengali Handwritten Digit Recognition: A Survey","created":"2022-06-05","cited_by_count":13,"area":null},{"id":"2106.03743","title":"Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence","created":"2021-06-07","cited_by_count":12,"area":null},{"id":"2206.05985","title":"Modeling the Machine Learning Multiverse","created":"2022-06-13","cited_by_count":11,"area":null},{"id":"2312.00598","title":"Learning from One Continuous Video Stream","created":"2023-12-01","cited_by_count":11,"area":null},{"id":"2107.14038","title":"Point-Cloud Deep Learning of Porous Media for Permeability Prediction","created":"2021-07-18","cited_by_count":10,"area":null},{"id":"2111.00856","title":"Large-Scale Deep Learning Optimizations: A Comprehensive Survey","created":"2021-11-01","cited_by_count":10,"area":null},{"id":"2111.12320","title":"Consistency Regularization for Deep Face Anti-Spoofing","created":"2021-11-24","cited_by_count":10,"area":null},{"id":"2306.08590","title":"Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning","created":"2023-06-14","cited_by_count":10,"area":null},{"id":"2604.14108","title":"Momentum Further Constrains Sharpness at the Edge of Stochastic Stability","created":"2026-04-15","cited_by_count":10,"area":null},{"id":"2101.07715","title":"Meningioma segmentation in T1-weighted MRI leveraging global context and attention mechanisms","created":"2021-01-19","cited_by_count":9,"area":null},{"id":"2305.06435","title":"Phase transitions in the mini-batch size for sparse and dense two-layer neural networks","created":"2023-05-10","cited_by_count":9,"area":null},{"id":"2304.02658","title":"Predictive Coding as a Neuromorphic Alternative to Backpropagation: A Critical Evaluation","created":"2023-04-05","cited_by_count":8,"area":null},{"id":"2310.14809","title":"Learning spatio-temporal patterns with Neural Cellular Automata","created":"2023-10-23","cited_by_count":8,"area":null},{"id":"2506.06599","title":"Direct Prediction Set Minimization via Bilevel Conformal Classifier Training","created":"2025-06-07","cited_by_count":8,"area":null},{"id":"2303.13634","title":"Physics-informed PointNet: On how many irregular geometries can it solve an inverse problem simultaneously? Application to linear elasticity","created":"2023-03-22","cited_by_count":7,"area":null},{"id":"2311.14859","title":"An Empirical Investigation into Benchmarking Model Multiplicity for Trustworthy Machine Learning: A Case Study on Image Classification","created":"2023-11-24","cited_by_count":7,"area":null},{"id":"2102.02111","title":"Introduction to Neural Transfer Learning with Transformers for Social Science Text Analysis","created":"2021-02-03","cited_by_count":6,"area":null},{"id":"2106.03640","title":"Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training","created":"2021-06-07","cited_by_count":6,"area":null},{"id":"2201.06126","title":"Control of Dual-Sourcing Inventory Systems using Recurrent Neural Networks","created":"2022-01-16","cited_by_count":6,"area":null},{"id":"2205.15049","title":"Metrizing Fairness","created":"2022-05-30","cited_by_count":6,"area":null},{"id":"2211.10026","title":"DGD-cGAN: A Dual Generator for Image Dewatering and Restoration","created":"2022-11-18","cited_by_count":6,"area":null},{"id":"2403.07688","title":"Maxwell's Demon at Work: Efficient Pruning by Leveraging Saturation of Neurons","created":"2024-03-12","cited_by_count":6,"area":null},{"id":"2106.13777","title":"HyperNP: Interactive Visual Exploration of Multidimensional Projection Hyperparameters","created":"2021-06-25","cited_by_count":5,"area":null},{"id":"2111.04004","title":"Exponential escape efficiency of SGD from sharp minima in non-stationary regime","created":"2021-11-07","cited_by_count":5,"area":null},{"id":"2205.06936","title":"Efficient Learning of Interpretable Classification Rules","created":"2022-05-14","cited_by_count":5,"area":null},{"id":"2410.05612","title":"A Bayesian Model Selection Criterion for Selecting Pretraining Checkpoints","created":"2024-10-08","cited_by_count":5,"area":null},{"id":"2102.07500","title":"On the Impact of Device and Behavioral Heterogeneity in Federated Learning","created":"2021-02-15","cited_by_count":4,"area":null},{"id":"2202.00710","title":"Improving Sample Efficiency of Value Based Models Using Attention and Vision Transformers","created":"2022-02-01","cited_by_count":4,"area":null},{"id":"2207.09078","title":"ILASR: Privacy-Preserving Incremental Learning for Automatic Speech Recognition at Production Scale","created":"2022-07-19","cited_by_count":4,"area":null},{"id":"2210.11078","title":"Large-batch Optimization for Dense Visual Predictions","created":"2022-10-20","cited_by_count":4,"area":null},{"id":"2411.05296","title":"On Training of Kolmogorov-Arnold Networks","created":"2024-11-08","cited_by_count":4,"area":null},{"id":"2503.04470","title":"Gate-Shift-Pose: Enhancing Action Recognition in Sports with Skeleton Information","created":"2025-03-06","cited_by_count":4,"area":null},{"id":"2604.09258","title":"Nexus: Same Pretraining Loss, Better Downstream Generalization via Common Minima","created":"2026-04-10","cited_by_count":4,"area":null},{"id":"2203.00528","title":"On genetic programming representations and fitness functions for interpretable dimensionality reduction","created":"2022-03-01","cited_by_count":3,"area":null},{"id":"2208.04693","title":"How Well Do Vision Transformers (VTs) Transfer To The Non-Natural Image Domain? An Empirical Study Involving Art Classification","created":"2022-08-09","cited_by_count":3,"area":null},{"id":"2210.12184","title":"A New Perspective for Understanding Generalization Gap of Deep Neural Networks Trained with Large Batch Sizes","created":"2022-10-21","cited_by_count":3,"area":null},{"id":"2305.08611","title":"GeNAS: Neural Architecture Search with Better Generalization","created":"2023-05-15","cited_by_count":3,"area":null},{"id":"2309.05337","title":"Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems","created":"2023-09-11","cited_by_count":3,"area":null},{"id":"2408.08676","title":"Fine-tuning LLMs for Autonomous Spacecraft Control: A Case Study Using Kerbal Space Program","created":"2024-08-16","cited_by_count":3,"area":null},{"id":"2410.08229","title":"Improvement of Spiking Neural Network with Bit Planes and Color Models","created":"2024-09-28","cited_by_count":3,"area":null},{"id":"2508.00180","title":"EMA Without the Lag: Bias-Corrected Iterate Averaging Schemes","created":"2025-07-31","cited_by_count":3,"area":null},{"id":"2110.07029","title":"Adaptive Elastic Training for Sparse Deep Learning on Heterogeneous Multi-GPU Servers","created":"2021-10-13","cited_by_count":2,"area":null},{"id":"2211.00889","title":"Accelerating Parallel Stochastic Gradient Descent via Non-blocking Mini-batches","created":"2022-11-02","cited_by_count":2,"area":null},{"id":"2211.15853","title":"Disentangling the Mechanisms Behind Implicit Regularization in SGD","created":"2022-11-29","cited_by_count":2,"area":null},{"id":"2402.08344","title":"Implicit Bias in Noisy-SGD: With Applications to Differentially Private Training","created":"2024-02-13","cited_by_count":2,"area":null},{"id":"2402.12646","title":"Training Artificial Neural Networks by Coordinate Search Algorithm","created":"2024-02-20","cited_by_count":2,"area":null},{"id":"2505.13171","title":"Positional Fragility in LLMs: How Offset Effects Reshape Our Understanding of Memorization Risks","created":"2025-05-19","cited_by_count":2,"area":null},{"id":"2602.11852","title":"Prototype Transformer: Towards Language Model Architectures Interpretable by Design","created":"2026-02-12","cited_by_count":2,"area":null},{"id":"2105.08788","title":"Self-Supervised Learning for Fine-Grained Visual Categorization","created":"2021-05-18","cited_by_count":1,"area":null},{"id":"2204.07943","title":"Global-Supervised Contrastive Loss and View-Aware-Based Post-Processing for Vehicle Re-Identification","created":"2022-04-17","cited_by_count":1,"area":null},{"id":"2308.01419","title":"Graph Neural Networks for Forecasting Multivariate Realized Volatility with Spillover Effects","created":"2023-08-01","cited_by_count":1,"area":null},{"id":"2401.05730","title":"Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing","created":"2024-01-11","cited_by_count":1,"area":null},{"id":"2402.14139","title":"NeuroFlux: Memory-Efficient CNN Training Using Adaptive Local Learning","created":"2024-02-21","cited_by_count":1,"area":null},{"id":"2410.02759","title":"Forecasting Smog Clouds With Deep Learning","created":"2024-10-03","cited_by_count":1,"area":null},{"id":"2503.15638","title":"Combining physics education and machine learning research to measure evidence of students' mechanistic sensemaking","created":"2025-03-19","cited_by_count":1,"area":null},{"id":"2509.24411","title":"Hybrid Layer-Wise ANN-SNN With Surrogate Spike Encoding-Decoding Structure","created":"2025-09-29","cited_by_count":1,"area":null},{"id":"2102.09643","title":"Attempted Blind Constrained Descent Experiments","created":"2021-02-18","cited_by_count":0,"area":null},{"id":"2105.01875","title":"Modulating Regularization Frequency for Efficient Compression-Aware Model Training","created":"2021-05-05","cited_by_count":0,"area":null},{"id":"2105.10448","title":"Distinguishing artefacts: evaluating the saturation point of convolutional neural networks","created":"2021-05-21","cited_by_count":0,"area":null},{"id":"2105.10915","title":"GOALS: Gradient-Only Approximations for Line Searches Towards Robust and Consistent Training of Deep Neural Networks","created":"2021-05-23","cited_by_count":0,"area":null},{"id":"2107.13117","title":"Image color correction, enhancement, and editing","created":"2021-07-28","cited_by_count":0,"area":null},{"id":"2109.12191","title":"NanoBatch Privacy: Enabling fast Differentially Private learning on the IPU","created":"2021-09-24","cited_by_count":0,"area":null},{"id":"2109.13611","title":"Active Learning for Argument Mining: A Practical Approach","created":"2021-09-28","cited_by_count":0,"area":null},{"id":"2203.08174","title":"Towards understanding deep learning with the natural clustering prior","created":"2022-03-15","cited_by_count":0,"area":null},{"id":"2208.08085","title":"Detection and Mitigation of Byzantine Attacks in Distributed Training","created":"2022-08-17","cited_by_count":0,"area":null},{"id":"2209.06469","title":"Learning Deep Optimal Embeddings with Sinkhorn Divergences","created":"2022-09-14","cited_by_count":0,"area":null},{"id":"2209.07932","title":"Top-Tuning: a study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methods","created":"2022-09-16","cited_by_count":0,"area":null},{"id":"2210.01807","title":"TripleE: Easy Domain Generalization via Episodic Replay","created":"2022-10-04","cited_by_count":0,"area":null},{"id":"2306.08432","title":"Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression","created":"2023-06-14","cited_by_count":0,"area":null},{"id":"2412.10578","title":"CESAR: A Convolutional Echo State AutoencodeR for High-Resolution Wind Forecasting","created":"2024-12-13","cited_by_count":0,"area":null},{"id":"2503.17959","title":"Dynamic Gradient Sparse Update for Edge Training","created":"2025-03-23","cited_by_count":0,"area":null},{"id":"2506.20511","title":"Collaborative Batch Size Optimization for Federated Learning","created":"2025-06-25","cited_by_count":0,"area":null},{"id":"2507.04682","title":"Operator-based machine learning framework for generalizable prediction of unsteady treatment dynamics in stormwater infrastructure","created":"2025-07-07","cited_by_count":0,"area":null},{"id":"2509.03950","title":"Chest X-ray Pneumothorax Segmentation Using EfficientNet-B4 Transfer Learning in a U-Net Architecture","created":"2025-09-04","cited_by_count":0,"area":null},{"id":"2509.16173","title":"DIVEBATCH: Accelerating Model Training Through Gradient-Diversity Aware Batch Size Adaptation","created":"2025-09-19","cited_by_count":0,"area":null},{"id":"2605.26007","title":"Forgotten Words: Benchmarking NeoBERT for Dementia Detection in Low-Resource Conversational Filipino and English Speech","created":"2026-05-25","cited_by_count":0,"area":null},{"id":"2606.27171","title":"Stochastic Gradient Optimization with Model-Assisted Sampling","created":"2026-06-25","cited_by_count":0,"area":null},{"id":"2606.27286","title":"Simulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC","created":"2026-06-25","cited_by_count":0,"area":null},{"id":"2608.19866","title":"A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments","created":"2026-08-20","cited_by_count":0,"area":null},{"id":"2610.20158","title":"Dataset-Level Regularization for Joint-Embedding Self-Supervised Learning","created":"2026-10-14","cited_by_count":0,"area":null}],"next_cursor":null}