{"list":"other","total":69,"rows":[{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"1409.1556","title":"Very Deep Convolutional Networks for Large-Scale Image Recognition","created":"2014-09-04","cited_by_count":15364},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2107.03374","title":"Evaluating Large Language Models Trained on Code","created":"2021-07-07","cited_by_count":8320},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2204.06125","title":"Hierarchical Text-Conditional Image Generation with CLIP Latents","created":"2022-04-13","cited_by_count":6585},{"id":"2501.12948","title":"DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning","created":"2025-01-22","cited_by_count":6330},{"id":"1312.6199","title":"Intriguing properties of neural networks","created":"2013-12-21","cited_by_count":5155},{"id":"2108.07258","title":"On the Opportunities and Risks of Foundation Models","created":"2021-08-16","cited_by_count":4033},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"2307.15043","title":"Universal and Transferable Adversarial Attacks on Aligned Language Models","created":"2023-07-27","cited_by_count":3104},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"1711.05101","title":"Decoupled Weight Decay Regularization","created":"2017-11-14","cited_by_count":1831},{"id":"1911.08731","title":"Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization","created":"2019-11-20","cited_by_count":1247},{"id":"2401.06066","title":"DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models","created":"2024-01-11","cited_by_count":867},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"2404.06395","title":"MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies","created":"2024-04-09","cited_by_count":723},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629},{"id":"1712.00409","title":"Deep Learning Scaling is Predictable, Empirically","created":"2017-12-01","cited_by_count":582},{"id":"2109.02846","title":"Datasets: A Community Library for Natural Language Processing","created":"2021-09-07","cited_by_count":530},{"id":"1912.02178","title":"Fantastic Generalization Measures and Where to Find Them","created":"2019-12-04","cited_by_count":513},{"id":"1912.02757","title":"Deep Ensembles: A Loss Landscape Perspective","created":"2019-12-05","cited_by_count":443},{"id":"2312.02696","title":"Analyzing and Improving the Training Dynamics of Diffusion Models","created":"2023-12-05","cited_by_count":402},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381},{"id":"1707.08819","title":"A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets","created":"2017-07-27","cited_by_count":377},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1811.10959","title":"Dataset Distillation","created":"2018-11-27","cited_by_count":230},{"id":"1812.04754","title":"Gradient Descent Happens in a Tiny Subspace","created":"2018-12-12","cited_by_count":217},{"id":"2208.03306","title":"Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models","created":"2022-08-05","cited_by_count":191},{"id":"1710.05941","title":"Searching for Activation Functions","created":"2017-10-16","cited_by_count":169},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154},{"id":"1706.05350","title":"L2 Regularization versus Batch and Weight Normalization","created":"2017-06-16","cited_by_count":124},{"id":"2312.13558","title":"The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction","created":"2023-12-21","cited_by_count":123},{"id":"1810.12281","title":"Three Mechanisms of Weight Decay Regularization","created":"2018-10-29","cited_by_count":113},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108},{"id":"2206.04817","title":"The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon","created":"2022-06-10","cited_by_count":94},{"id":"1906.05478","title":"Robust and interpretable blind image denoising via bias-free convolutional neural networks","created":"2019-06-13","cited_by_count":90},{"id":"2301.02679","title":"Grokking modular arithmetic","created":"2023-01-06","cited_by_count":83},{"id":"2310.04415","title":"Why Do We Need Weight Decay in Modern Deep Learning?","created":"2023-10-06","cited_by_count":72},{"id":"2202.04414","title":"Agree to Disagree: Diversity through Disagreement for Better Transferability","created":"2022-02-09","cited_by_count":70},{"id":"1907.02911","title":"Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape","created":"2019-07-05","cited_by_count":63},{"id":"2506.10772","title":"Skillful joint probabilistic weather forecasting from marginals","created":"2025-06-12","cited_by_count":63},{"id":"2110.12899","title":"No One Representation to Rule Them All: Overlapping Features of Training Methods","created":"2021-10-20","cited_by_count":58},{"id":"2202.03418","title":"Diversify and Disambiguate: Learning From Underspecified Data","created":"2022-02-07","cited_by_count":56},{"id":"2402.15555","title":"Deep Networks Always Grok and Here is Why","created":"2024-02-23","cited_by_count":51},{"id":"2501.04697","title":"Grokking at the Edge of Numerical Stability","created":"2025-01-08","cited_by_count":46},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31},{"id":"2305.16038","title":"Implicit bias of SGD in $L_{2}$-regularized linear DNNs: One-way jumps from high to low rank","created":"2023-05-25","cited_by_count":29},{"id":"2310.19103","title":"Proving Linear Mode Connectivity of Neural Networks via Optimal Transport","created":"2023-10-29","cited_by_count":25},{"id":"2012.06898","title":"Revisiting \"Qualitatively Characterizing Neural Network Optimization Problems\"","created":"2020-12-12","cited_by_count":24},{"id":"2005.00570","title":"When Ensembling Smaller Models is More Efficient than Single Large Models","created":"2020-05-01","cited_by_count":20},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20},{"id":"2206.05794","title":"SGD and Weight Decay Secretly Minimize the Rank of Your Neural Network","created":"2022-06-12","cited_by_count":19},{"id":"2305.16534","title":"Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression","created":"2023-05-25","cited_by_count":18},{"id":"2011.02952","title":"Generalized Negative Correlation Learning for Deep Ensembling","created":"2020-11-05","cited_by_count":17},{"id":"2202.00856","title":"The Role of Linear Layers in Nonlinear Interpolating Networks","created":"2022-02-02","cited_by_count":16},{"id":"2405.19454","title":"Deep Grokking: Would Deep Neural Networks Generalize Better?","created":"2024-05-29","cited_by_count":15},{"id":"2311.06597","title":"Understanding Grokking Through A Robustness Viewpoint","created":"2023-11-11","cited_by_count":12},{"id":"2402.03991","title":"Provable Emergence of Deep Neural Collapse and Low-Rank Bias in $L^2$-Regularized Nonlinear Networks","created":"2024-02-06","cited_by_count":11},{"id":"2302.05441","title":"Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features","created":"2023-02-10","cited_by_count":10},{"id":"2402.04051","title":"Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods","created":"2024-02-06","cited_by_count":9},{"id":"2505.01515","title":"Comparison of Waymo Rider-Only Crash Rates by Crash Type to Human Benchmarks at 56.7 Million Miles","created":"2025-05-02","cited_by_count":9},{"id":"2208.06894","title":"The SVD of Convolutional Weights: A CNN Interpretability Framework","created":"2022-08-14","cited_by_count":8},{"id":"2402.05966","title":"Vanishing Feature: Diagnosing Model Merging and Beyond","created":"2024-02-05","cited_by_count":5},{"id":"2502.09850","title":"Elastic Representation: Mitigating Spurious Correlations for Group Robustness","created":"2025-02-14","cited_by_count":5},{"id":"2502.20531","title":"Learning Dynamics of Deep Linear Networks Beyond the Edge of Stability","created":"2025-02-27","cited_by_count":5},{"id":"2505.23027","title":"Diverse Prototypical Ensembles Improve Robustness to Subpopulation Shift","created":"2025-05-29","cited_by_count":5},{"id":"2606.03938","title":"q0: Primitives for Hyper-Epoch Pretraining","created":"2026-06-02","cited_by_count":2},{"id":"2506.18221","title":"These Are Not All the Features You Are Looking For: A Fundamental Bottleneck in Supervised Pretraining","created":"2025-06-23","cited_by_count":1}],"next_cursor":null}