{"total":76,"rows":[{"id":"2102.06810","title":"Understanding self-supervised Learning Dynamics without Contrastive Pairs","created":"2021-02-12","cited_by_count":256,"area":null},{"id":"2311.12786","title":"Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks","created":"2023-11-21","cited_by_count":115,"area":null},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95,"area":null},{"id":"2105.14602","title":"On the geometry of generalization and memorization in deep neural networks","created":"2021-05-30","cited_by_count":73,"area":null},{"id":"2201.07395","title":"Overview frequency principle/spectral bias in deep learning","created":"2022-01-19","cited_by_count":69,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2409.14623","title":"From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks","created":"2024-09-22","cited_by_count":49,"area":null},{"id":"2102.09972","title":"Implicit Regularization in Tensor Factorization","created":"2021-02-19","cited_by_count":44,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2306.04251","title":"Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks","created":"2023-06-07","cited_by_count":39,"area":null},{"id":"2207.10430","title":"The Neural Race Reduction: Dynamics of Abstraction in Gated Networks","created":"2022-07-21","cited_by_count":37,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2205.09797","title":"Improving Multi-Task Generalization via Regularizing Spurious Correlation","created":"2022-05-19","cited_by_count":28,"area":null},{"id":"2201.11729","title":"Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks","created":"2022-01-27","cited_by_count":27,"area":null},{"id":"2106.05418","title":"Probing transfer learning with a model of synthetic correlated datasets","created":"2021-06-09","cited_by_count":25,"area":null},{"id":"2110.04947","title":"Towards Demystifying Representation Learning with Non-contrastive Self-supervision","created":"2021-10-11","cited_by_count":23,"area":null},{"id":"2405.05847","title":"Learned feature representations are biased by complexity, learning order, position, and more","created":"2024-05-09","cited_by_count":23,"area":null},{"id":"2101.01918","title":"Phase Transitions in Transfer Learning for High-Dimensional Perceptrons","created":"2021-01-06","cited_by_count":22,"area":null},{"id":"2203.14661","title":"Random matrix analysis of deep neural network weight matrices","created":"2022-03-28","cited_by_count":21,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2206.03198","title":"Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow","created":"2022-06-07","cited_by_count":20,"area":null},{"id":"2312.00935","title":"Understanding Unimodal Bias in Multimodal Deep Linear Networks","created":"2023-12-01","cited_by_count":19,"area":null},{"id":"2405.20236","title":"Disentangling and Mitigating the Impact of Task Similarity for Continual Learning","created":"2024-05-30","cited_by_count":19,"area":null},{"id":"2405.13456","title":"Deep linear networks for regression are implicitly regularized towards flat minima","created":"2024-05-22","cited_by_count":17,"area":null},{"id":"2208.06931","title":"A Theory for Knowledge Transfer in Continual Learning","created":"2022-08-14","cited_by_count":16,"area":null},{"id":"2409.14981","title":"On The Specialization of Neural Modules","created":"2024-09-23","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2410.08194","title":"Features are fate: a theory of transfer learning in high-dimensional regression","created":"2024-10-10","cited_by_count":13,"area":null},{"id":"2210.17449","title":"Globally Gated Deep Linear Networks","created":"2022-10-31","cited_by_count":12,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2104.04874","title":"SGD Implicitly Regularizes Generalization Error","created":"2021-04-10","cited_by_count":10,"area":null},{"id":"2402.09142","title":"When Representations Align: Universality in Representation Learning Dynamics","created":"2024-02-14","cited_by_count":10,"area":null},{"id":"2603.00742","title":"To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters","created":"2026-02-28","cited_by_count":10,"area":null},{"id":"2206.03927","title":"Boundary between noise and information applied to filtering neural network weight matrices","created":"2022-06-08","cited_by_count":9,"area":null},{"id":"2502.08416","title":"Multifidelity Simulation-based Inference for Computationally Expensive Simulators","created":"2025-02-12","cited_by_count":9,"area":null},{"id":"2502.21009","title":"Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)","created":"2025-02-28","cited_by_count":9,"area":null},{"id":"2110.05960","title":"Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations","created":"2021-10-11","cited_by_count":8,"area":null},{"id":"2106.11486","title":"Unsupervised Embedding Adaptation via Early-Stage Feature Reconstruction for Few-Shot Classification","created":"2021-06-22","cited_by_count":7,"area":null},{"id":"2203.05443","title":"Bias-variance decomposition of overparameterized regression with random linear features","created":"2022-03-10","cited_by_count":7,"area":null},{"id":"2211.11623","title":"Linear Stability Hypothesis and Rank Stratification for Nonlinear Models","created":"2022-11-21","cited_by_count":7,"area":null},{"id":"2103.05621","title":"The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression","created":"2021-03-09","cited_by_count":6,"area":null},{"id":"2112.07806","title":"Representation Alignment in Neural Networks","created":"2021-12-15","cited_by_count":6,"area":null},{"id":"2503.02526","title":"A Theory of Initialisation's Impact on Specialisation","created":"2025-03-04","cited_by_count":6,"area":null},{"id":"2206.08558","title":"How You Start Matters for Generalization","created":"2022-06-17","cited_by_count":5,"area":null},{"id":"2306.10404","title":"The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions","created":"2023-06-17","cited_by_count":5,"area":null},{"id":"2602.20062","title":"A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning","created":"2026-02-23","cited_by_count":5,"area":null},{"id":"2103.14108","title":"The Geometry of Over-parameterized Regression and Adversarial Perturbations","created":"2021-03-25","cited_by_count":4,"area":null},{"id":"2112.00980","title":"Trap of Feature Diversity in the Learning of MLPs","created":"2021-12-02","cited_by_count":4,"area":null},{"id":"2306.04901","title":"Generalization Performance of Transfer Learning: Overparameterized and Underparameterized Regimes","created":"2023-06-08","cited_by_count":4,"area":null},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4,"area":null},{"id":"2406.12615","title":"When Are Bias-Free ReLU Networks Effectively Linear Networks?","created":"2024-06-18","cited_by_count":4,"area":null},{"id":"2406.17467","title":"Early learning of the optimal constant solution in neural networks and humans","created":"2024-06-25","cited_by_count":3,"area":null},{"id":"2407.09845","title":"Towards Understanding Epoch-wise Double descent in Two-layer Linear Neural Networks","created":"2024-07-13","cited_by_count":3,"area":null},{"id":"2304.06326","title":"Understanding Overfitting in Adversarial Training via Kernel Regression","created":"2023-04-13","cited_by_count":2,"area":null},{"id":"2410.04264","title":"Decoupling Dynamical Richness from Representation Learning: Towards Practical Measurement","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2501.02364","title":"Linearly Separable Features in Shallow Nonlinear Networks: Width Scales Polynomially with Intrinsic Data Dimension","created":"2025-01-04","cited_by_count":2,"area":null},{"id":"2503.06181","title":"Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks","created":"2025-03-08","cited_by_count":2,"area":null},{"id":"2601.06961","title":"The Impact of Anisotropic Covariance Structure on the Training Dynamics and Generalization Error of Linear Networks","created":"2026-01-11","cited_by_count":2,"area":null},{"id":"2201.07203","title":"Emergent Instabilities in Algorithmic Feedback Loops","created":"2022-01-18","cited_by_count":1,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2408.13767","title":"Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning","created":"2024-08-25","cited_by_count":1,"area":null},{"id":"2605.20105","title":"Optimal Representation Size: High-Dimensional Analysis of Pretraining and Linear Probing","created":"2026-05-19","cited_by_count":1,"area":null},{"id":"2609.38998","title":"Not all solutions are created equal: An analytical dissociation of functional and representational similarity in deep linear neural networks","created":"2026-09-30","cited_by_count":1,"area":null},{"id":"2303.01429","title":"Optimal transfer protocol by incremental layer defrosting","created":"2023-03-02","cited_by_count":0,"area":null},{"id":"2306.06731","title":"An information-Theoretic Approach to Semi-supervised Transfer Learning","created":"2023-06-11","cited_by_count":0,"area":null},{"id":"2308.13300","title":"Learning Compact Neural Networks with Deep Overparameterised Multitask Learning","created":"2023-08-25","cited_by_count":0,"area":null},{"id":"2312.08519","title":"Reconciling Shared versus Context-Specific Information in a Neural Network Model of Latent Causes","created":"2023-12-13","cited_by_count":0,"area":null},{"id":"2505.13742","title":"Understanding Task Representations in Neural Networks via Bayesian Ablation","created":"2025-05-19","cited_by_count":0,"area":null},{"id":"2511.08401","title":"Source-Optimal Training is Transfer-Suboptimal","created":"2025-11-11","cited_by_count":0,"area":null},{"id":"2605.22972","title":"A mathematical theory of balancing relational generalization and memorization","created":"2026-05-21","cited_by_count":0,"area":null},{"id":"2605.26973","title":"Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks","created":"2026-05-26","cited_by_count":0,"area":null},{"id":"2606.05219","title":"Gradient Descent with Large Step Size Restores Symmetry in Deep Linear Networks with Multi-Pathway","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2607.07884","title":"Optimal Learning Rate Scaling Depends on Data in Deep Scalar Linear Networks","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2609.33708","title":"A Spectral Theory of Compositional Learning","created":"2026-09-27","cited_by_count":0,"area":null}],"next_cursor":null}