{"total":105,"rows":[{"id":"2111.13171","title":"Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks","created":"2021-11-25","cited_by_count":70,"area":null},{"id":"2102.08098","title":"GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training","created":"2021-02-16","cited_by_count":44,"area":null},{"id":"2106.03795","title":"Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks","created":"2021-06-07","cited_by_count":44,"area":null},{"id":"2406.09997","title":"Towards Scalable and Versatile Weight Space Learning","created":"2024-06-14","cited_by_count":41,"area":null},{"id":"2209.14764","title":"Model Zoos: A Dataset of Diverse Populations of Neural Network Models","created":"2022-09-29","cited_by_count":39,"area":null},{"id":"2410.10912","title":"AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models","created":"2024-10-14","cited_by_count":36,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2202.08494","title":"Learning continuous models for continuous physics","created":"2022-02-17","cited_by_count":28,"area":null},{"id":"2108.00781","title":"Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers","created":"2021-08-02","cited_by_count":27,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2312.00359","title":"Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training","created":"2023-12-01","cited_by_count":20,"area":null},{"id":"2410.10054","title":"AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality","created":"2024-10-14","cited_by_count":20,"area":"moe"},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20,"area":null},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19,"area":null},{"id":"2202.02842","title":"Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data","created":"2022-02-06","cited_by_count":19,"area":null},{"id":"2305.05611","title":"Metric Space Magnitude and Generalisation in Neural Networks","created":"2023-05-09","cited_by_count":15,"area":null},{"id":"2205.08187","title":"Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility","created":"2022-05-17","cited_by_count":13,"area":null},{"id":"2506.14562","title":"AlphaDecay: Module-wise Weight Decay for Heavy-Tailed Balancing in LLMs","created":"2025-06-17","cited_by_count":13,"area":null},{"id":"2206.01274","title":"Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares","created":"2022-06-02","cited_by_count":12,"area":null},{"id":"2305.18425","title":"Efficient Storage of Fine-Tuned Models via Low-Rank Approximation of Weight Residuals","created":"2023-05-28","cited_by_count":12,"area":null},{"id":"2210.07612","title":"Monotonicity and Double Descent in Uncertainty Estimation with Gaussian Processes","created":"2022-10-14","cited_by_count":11,"area":null},{"id":"2404.06106","title":"Unifying Low Dimensional Spectra in Deep Learning","created":"2024-04-09","cited_by_count":11,"area":null},{"id":"2107.09437","title":"Edge of chaos as a guiding principle for modern neural network training","created":"2021-07-20","cited_by_count":10,"area":null},{"id":"2412.00069","title":"Condense, Don't Just Prune: Enhancing Efficiency and Performance in MoE Layer Pruning","created":"2024-11-26","cited_by_count":10,"area":"moe"},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2506.06280","title":"Eigenspectrum Analysis of Neural Networks without Aspect Ratio Bias","created":"2025-06-06","cited_by_count":10,"area":null},{"id":"2110.15288","title":"Hyper-Representations: Self-Supervised Representation Learning on Neural Network Weights for Model Characteristic Prediction","created":"2021-10-28","cited_by_count":9,"area":null},{"id":"2306.14975","title":"The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets","created":"2023-06-26","cited_by_count":9,"area":null},{"id":"2602.05846","title":"Optimal scaling laws in learning hierarchical multi-index models","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2403.07264","title":"Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization","created":"2024-03-12","cited_by_count":8,"area":null},{"id":"2110.01899","title":"Random matrices in service of ML footprint: ternary random features with no performance loss","created":"2021-10-05","cited_by_count":7,"area":null},{"id":"2304.02911","title":"Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks","created":"2023-04-06","cited_by_count":7,"area":null},{"id":"2407.16427","title":"Stochastic weight matrix dynamics during learning and Dyson Brownian motion","created":"2024-07-23","cited_by_count":7,"area":null},{"id":"2606.04980","title":"AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization","created":"2026-06-03","cited_by_count":7,"area":"moe"},{"id":"2205.06689","title":"Heavy-Tail Phenomenon in Decentralized SGD","created":"2022-05-13","cited_by_count":6,"area":null},{"id":"2501.06386","title":"Using Pre-trained LLMs for Multivariate Time Series Forecasting","created":"2025-01-10","cited_by_count":6,"area":null},{"id":"2509.24914","title":"Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws","created":"2025-09-29","cited_by_count":6,"area":null},{"id":"2305.01143","title":"Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Renyi's Entropy Perspective","created":"2023-05-02","cited_by_count":5,"area":null},{"id":"2306.08125","title":"Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD","created":"2023-06-13","cited_by_count":5,"area":null},{"id":"2311.07013","title":"A PAC-Bayesian Perspective on the Interpolating Information Criterion","created":"2023-11-13","cited_by_count":5,"area":null},{"id":"2405.17391","title":"Dataset-learning duality and emergent criticality","created":"2024-05-27","cited_by_count":5,"area":null},{"id":"2509.12527","title":"Selective Risk Certification for LLM Outputs via Information-Lift Statistics: PAC-Bayes, Robustness, and Skeleton Design","created":"2025-09-16","cited_by_count":5,"area":null},{"id":"2510.02676","title":"To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration","created":"2025-10-03","cited_by_count":5,"area":null},{"id":"2605.05683","title":"Spectral Lens: Activation and Gradient Spectra as Diagnostics of LLM Optimization","created":"2026-05-07","cited_by_count":5,"area":null},{"id":"2112.00980","title":"Trap of Feature Diversity in the Learning of MLPs","created":"2021-12-02","cited_by_count":4,"area":null},{"id":"2203.14646","title":"To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding","created":"2022-03-28","cited_by_count":4,"area":null},{"id":"2304.13718","title":"Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models","created":"2023-04-26","cited_by_count":4,"area":null},{"id":"2402.01382","title":"Emergence of heavy tails in homogenized stochastic gradient descent","created":"2024-02-02","cited_by_count":4,"area":null},{"id":"2410.14602","title":"Data Diversity as Implicit Regularization: How Does Diversity Shape the Weight Space of Deep Neural Networks?","created":"2024-10-18","cited_by_count":4,"area":null},{"id":"2503.19081","title":"Residuals Are Not Enough: Limits of Physics-Informed Pre-Training for Scientific Foundation Models","created":"2025-03-24","cited_by_count":4,"area":null},{"id":"2601.03889","title":"Spectral Manifold Regularization for Stable and Modular Routing in Deep MoE Architectures","created":"2026-01-07","cited_by_count":4,"area":"moe"},{"id":"2601.22137","title":"PRISM: Distribution-free Adaptive Computation of Matrix Functions for Accelerating Neural Network Training","created":"2026-01-29","cited_by_count":4,"area":null},{"id":"2105.11025","title":"Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Bounds","created":"2021-05-23","cited_by_count":3,"area":null},{"id":"2310.18455","title":"Approximate Heavy Tails in Offline (Multi-Pass) Stochastic Gradient Descent","created":"2023-10-27","cited_by_count":3,"area":null},{"id":"2403.00258","title":"\"Lossless\" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach","created":"2024-03-01","cited_by_count":3,"area":null},{"id":"2404.07448","title":"Transferable and Principled Efficiency for Open-Vocabulary Segmentation","created":"2024-04-11","cited_by_count":3,"area":"mllm"},{"id":"2408.12385","title":"Sharper Bounds for Chebyshev Moment Matching, with Applications","created":"2024-08-22","cited_by_count":3,"area":null},{"id":"2504.18072","title":"A Model Zoo on Phase Transitions in Neural Networks","created":"2025-04-25","cited_by_count":3,"area":null},{"id":"2603.06922","title":"NerVE: Nonlinear Eigenspectrum Dynamics in LLM Feed-Forward Networks","created":"2026-03-06","cited_by_count":3,"area":null},{"id":"2605.18898","title":"A Two-Parameter Weibull Framework for Diagnosing Transformer Weight Distributions","created":"2026-05-17","cited_by_count":3,"area":null},{"id":"2605.22297","title":"One LR Doesn't Fit All: Heavy-Tail Guided Layerwise Learning Rates for LLMs","created":"2026-05-21","cited_by_count":3,"area":null},{"id":"2307.00474","title":"Moments, Random Walks, and Limits for Spectrum Approximation","created":"2023-07-02","cited_by_count":2,"area":null},{"id":"2311.01358","title":"The Universal Statistical Structure and Scaling Laws of Chaos and Turbulence","created":"2023-11-02","cited_by_count":2,"area":null},{"id":"2505.12822","title":"Emergent Specialization: Rare Token Neurons in Language Models","created":"2025-05-19","cited_by_count":2,"area":null},{"id":"2507.17748","title":"Large Learning Rates Simultaneously Achieve Robustness to Spurious Correlations and Compressibility","created":"2025-07-23","cited_by_count":2,"area":null},{"id":"2507.21049","title":"Rep-MTL: Unleashing the Power of Representation-level Task Saliency for Multi-Task Learning","created":"2025-07-28","cited_by_count":2,"area":null},{"id":"2605.06366","title":"Layer Collapse in Diffusion Language Models","created":"2026-05-07","cited_by_count":2,"area":"diffusion"},{"id":"2605.26000","title":"Statistical Inference for Stochastic Gradient Descent: Beyond Finite Variance","created":"2026-05-25","cited_by_count":2,"area":null},{"id":"2606.28486","title":"Spectral phase transitions and trainability in neural network learning dynamics","created":"2026-06-26","cited_by_count":2,"area":null},{"id":"2504.10141","title":"The Impact of Model Zoo Size and Composition on Weight Space Learning","created":"2025-04-14","cited_by_count":1,"area":null},{"id":"2505.16743","title":"TRIM: Achieving Extreme Sparsity with Targeted Row-wise Iterative Metric-driven Pruning","created":"2025-05-22","cited_by_count":1,"area":null},{"id":"2509.01349","title":"Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networks","created":"2025-09-01","cited_by_count":1,"area":null},{"id":"2509.21163","title":"Distributed Specialization: Rare-Token Neurons in Large Language Models","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2510.11234","title":"Neural Weight Compression for Language Models","created":"2025-10-13","cited_by_count":1,"area":null},{"id":"2601.06238","title":"SPINAL -- Scaling-law and Preference Integration in Neural Alignment Layers","created":"2026-01-08","cited_by_count":1,"area":"alignment"},{"id":"2602.07135","title":"Landscaper: Understanding Loss Landscapes Through Multi-Dimensional Topological Analysis","created":"2026-02-06","cited_by_count":1,"area":null},{"id":"2602.09304","title":"Statistical Roughness-Informed Machine Unlearning","created":"2026-02-10","cited_by_count":1,"area":"safety"},{"id":"2603.12272","title":"ActTail: Global Activation Sparsity in Large Language Models","created":"2026-02-18","cited_by_count":1,"area":null},{"id":"2605.07302","title":"Pretraining Induces a Reusable Spectral Basis for Downstream Task Adaptation","created":"2026-05-08","cited_by_count":1,"area":null},{"id":"2608.10850","title":"Diffract: Spectral View of LLM Domain Adaptation","created":"2026-08-11","cited_by_count":1,"area":null},{"id":"2204.12554","title":"An Empirical Study of the Occurrence of Heavy-Tails in Training a ReLU Gate","created":"2022-04-26","cited_by_count":0,"area":null},{"id":"2302.02123","title":"Greedy Ordering of Layer Weight Matrices in Transformers Improves Translation","created":"2023-02-04","cited_by_count":0,"area":null},{"id":"2304.00320","title":"Doubly Stochastic Models: Learning with Unbiased Label Noises and Inference Stability","created":"2023-04-01","cited_by_count":0,"area":null},{"id":"2412.20496","title":"Random Matrix Theory for Stochastic Gradient Descent","created":"2024-12-29","cited_by_count":0,"area":null},{"id":"2505.18535","title":"Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD","created":"2025-05-24","cited_by_count":0,"area":null},{"id":"2507.03843","title":"A Log-Linear Analytics Approach to Cost Model Regularization for Inpatient Stays through Diagnostic Code Merging","created":"2025-07-05","cited_by_count":0,"area":null},{"id":"2507.17785","title":"Self-similarity Analysis in Deep Neural Networks","created":"2025-07-23","cited_by_count":0,"area":null},{"id":"2507.22095","title":"Posterior Bayesian Neural Networks with Dependent Weights","created":"2025-07-29","cited_by_count":0,"area":null},{"id":"2602.19528","title":"Beyond Accuracy: A Unified Random Matrix Theory Diagnostic Framework for Crash Classification Models","created":"2026-02-23","cited_by_count":0,"area":null},{"id":"2603.16077","title":"MDM-Prime-v2: Binary Encoding and Index Shuffling Enable Scaling of Diffusion Language Models","created":"2026-03-17","cited_by_count":0,"area":"diffusion"},{"id":"2604.07363","title":"Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models","created":"2026-04-01","cited_by_count":0,"area":null},{"id":"2604.13081","title":"Selectivity and Shape in the Design of Forward-Forward Goodness Functions","created":"2026-03-28","cited_by_count":0,"area":null},{"id":"2605.01609","title":"Concepts Whisper: Spectral Anti-Concentration and the Dual Geometry of Transformer Representations","created":"2026-05-02","cited_by_count":0,"area":"mechinterp"},{"id":"2605.20450","title":"SMA-DP: Spectral Memory-Aware Differential Privacy for Deep Learning","created":"2026-05-19","cited_by_count":0,"area":null},{"id":"2606.00312","title":"Stochastic Rounding Increases Small Singular Values","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.02608","title":"Pruning Deep Neural Networks via the Marchenko--Pastur Distribution","created":"2026-05-23","cited_by_count":0,"area":null},{"id":"2606.09744","title":"Learning Dynamics Reveal a Hierarchy of Weight-Induced Layerwise Gram Metrics","created":"2026-06-08","cited_by_count":0,"area":null},{"id":"2607.03377","title":"Spectral Signatures of Large Language Models","created":"2026-07-03","cited_by_count":0,"area":null},{"id":"2607.03551","title":"WeightCLIP: Aligning Datasets and Models for Weight Space Learning","created":"2026-07-03","cited_by_count":0,"area":null}],"next_cursor":"100"}