{"total":104,"rows":[{"id":"2104.13478","title":"Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges","created":"2021-04-27","cited_by_count":1167,"area":null},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227,"area":null},{"id":"2208.06677","title":"Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models","created":"2022-08-13","cited_by_count":174,"area":null},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102,"area":null},{"id":"2105.04550","title":"Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth","created":"2021-05-10","cited_by_count":55,"area":null},{"id":"2106.09992","title":"Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis","created":"2021-06-18","cited_by_count":52,"area":null},{"id":"2307.14023","title":"Are Transformers with One Layer Self-Attention Using Low-Rank Weight Matrices Universal Approximators?","created":"2023-07-26","cited_by_count":47,"area":null},{"id":"2202.00275","title":"Architecture Matters in Continual Learning","created":"2022-02-01","cited_by_count":46,"area":null},{"id":"2110.03187","title":"On the Optimal Memorization Power of ReLU Neural Networks","created":"2021-10-07","cited_by_count":40,"area":null},{"id":"2201.08025","title":"Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape","created":"2022-01-20","cited_by_count":39,"area":null},{"id":"2301.00712","title":"On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis","created":"2023-01-02","cited_by_count":39,"area":null},{"id":"2102.07346","title":"On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers","created":"2021-02-15","cited_by_count":35,"area":null},{"id":"2201.12680","title":"Understanding Deep Contrastive Learning via Coordinate-wise Optimization","created":"2022-01-29","cited_by_count":35,"area":null},{"id":"2406.02997","title":"Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs","created":"2024-06-05","cited_by_count":34,"area":null},{"id":"2305.18787","title":"Universality and Limitations of Prompt Tuning","created":"2023-05-30","cited_by_count":30,"area":null},{"id":"2110.12661","title":"ZerO Initialization: Initializing Neural Networks with only Zeros and Ones","created":"2021-10-25","cited_by_count":28,"area":null},{"id":"2108.01538","title":"Geometry of Linear Convolutional Networks","created":"2021-08-03","cited_by_count":27,"area":null},{"id":"2103.15632","title":"Regular Polytope Networks","created":"2021-03-29","cited_by_count":24,"area":null},{"id":"2107.13289","title":"The loss landscape of deep linear neural networks: a second-order analysis","created":"2021-07-28","cited_by_count":24,"area":null},{"id":"2202.04777","title":"Exact Solutions of a Deep Linear Network","created":"2022-02-10","cited_by_count":24,"area":null},{"id":"2203.16462","title":"Convergence of gradient descent for deep neural networks","created":"2022-03-30","cited_by_count":24,"area":null},{"id":"2201.13094","title":"Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformer","created":"2022-01-31","cited_by_count":22,"area":null},{"id":"2104.07916","title":"Augmenting Deep Classifiers with Polynomial Neural Networks","created":"2021-04-16","cited_by_count":21,"area":null},{"id":"2106.13792","title":"Proxy Convexity: A Unified Framework for the Analysis of Neural Networks Trained by Gradient Descent","created":"2021-06-25","cited_by_count":21,"area":null},{"id":"2205.12856","title":"Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function","created":"2022-05-25","cited_by_count":20,"area":null},{"id":"2306.16361","title":"Beyond NTK with Vanilla Gradient Descent: A Mean-Field Analysis of Neural Networks with Polynomial Width, Samples, and Time","created":"2023-06-28","cited_by_count":20,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2205.04009","title":"Posterior Collapse of a Linear Latent Variable Model","created":"2022-05-09","cited_by_count":18,"area":null},{"id":"2212.14852","title":"An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models","created":"2022-12-30","cited_by_count":16,"area":null},{"id":"2310.10699","title":"Reusing Pretrained Models by Multi-linear Operators for Efficient Training","created":"2023-10-16","cited_by_count":15,"area":null},{"id":"2106.07724","title":"An Exponential Improvement on the Memorization Capacity of Deep Threshold Networks","created":"2021-06-14","cited_by_count":14,"area":null},{"id":"2111.07632","title":"CoReS: Compatible Representations via Stationarity","created":"2021-11-15","cited_by_count":14,"area":null},{"id":"2209.08005","title":"Stability and Generalization for Markov Chain Stochastic Gradient Methods","created":"2022-09-16","cited_by_count":14,"area":null},{"id":"2206.05922","title":"From Perception to Programs: Regularize, Overparameterize, and Amortize","created":"2022-06-13","cited_by_count":13,"area":null},{"id":"2302.11962","title":"Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods","created":"2023-02-23","cited_by_count":12,"area":null},{"id":"2102.09671","title":"When Are Solutions Connected in Deep Networks?","created":"2021-02-18","cited_by_count":11,"area":null},{"id":"2207.00684","title":"Transforming PageRank into an Infinite-Depth Graph Neural Network","created":"2022-07-01","cited_by_count":11,"area":null},{"id":"2412.06289","title":"S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity","created":"2024-12-09","cited_by_count":10,"area":null},{"id":"2202.08070","title":"On Measuring Excess Capacity in Neural Networks","created":"2022-02-16","cited_by_count":9,"area":null},{"id":"2212.00261","title":"Task Discovery: Finding the Tasks that Neural Networks Generalize on","created":"2022-12-01","cited_by_count":9,"area":null},{"id":"2401.09902","title":"Interplay between depth and width for interpolation in neural ODEs","created":"2024-01-18","cited_by_count":9,"area":null},{"id":"2103.13462","title":"Why Do Local Methods Solve Nonconvex Problems?","created":"2021-03-24","cited_by_count":8,"area":null},{"id":"2102.13233","title":"Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations","created":"2021-02-25","cited_by_count":7,"area":null},{"id":"2206.09149","title":"Piecewise Linear Neural Networks and Deep Learning","created":"2022-06-18","cited_by_count":7,"area":null},{"id":"2303.03027","title":"Critical Points and Convergence Analysis of Generative Deep Linear Networks Trained with Bures-Wasserstein Loss","created":"2023-03-06","cited_by_count":7,"area":null},{"id":"2306.05023","title":"Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoders","created":"2023-06-08","cited_by_count":7,"area":null},{"id":"2509.25351","title":"Gradient Descent with Large Step Sizes: Chaos and Fractal Convergence Region","created":"2025-09-29","cited_by_count":7,"area":null},{"id":"2110.11464","title":"FDGATII : Fast Dynamic Graph Attention with Initial Residual and Identity Mapping","created":"2021-10-21","cited_by_count":6,"area":null},{"id":"2111.05496","title":"ResNEsts and DenseNEsts: Block-based DNN Models with Improved Representation Guarantees","created":"2021-11-10","cited_by_count":6,"area":null},{"id":"2205.11716","title":"Randomly Initialized One-Layer Neural Networks Make Data Linearly Separable","created":"2022-05-24","cited_by_count":6,"area":null},{"id":"2205.12510","title":"Exact Phase Transitions in Deep Learning","created":"2022-05-25","cited_by_count":6,"area":null},{"id":"2506.05249","title":"On the Convergence of Gradient Descent on Learning Transformers with Residual Connections","created":"2025-06-05","cited_by_count":6,"area":null},{"id":"2301.06116","title":"Maximally Compact and Separated Features with Regular Polytope Networks","created":"2023-01-15","cited_by_count":5,"area":null},{"id":"2403.04978","title":"Stacking as Accelerated Gradient Descent","created":"2024-03-08","cited_by_count":5,"area":null},{"id":"2503.04626","title":"IDInit: A Universal and Stable Initialization Method for Neural Network Training","created":"2025-03-06","cited_by_count":5,"area":null},{"id":"2602.09009","title":"ANCRe: Adaptive Neural Connection Reassignment for Efficient Depth Scaling","created":"2026-02-09","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2103.11414","title":"Deepened Graph Auto-Encoders Help Stabilize and Enhance Link Prediction","created":"2021-03-21","cited_by_count":4,"area":null},{"id":"2112.00980","title":"Trap of Feature Diversity in the Learning of MLPs","created":"2021-12-02","cited_by_count":4,"area":null},{"id":"2204.08306","title":"A Convergence Analysis of Nesterov's Accelerated Gradient Method in Training Deep Linear Neural Networks","created":"2022-04-18","cited_by_count":4,"area":null},{"id":"2303.04336","title":"QuickSRNet: Plain Single-Image Super-Resolution Architecture for Faster Inference on Mobile Platforms","created":"2023-03-08","cited_by_count":4,"area":null},{"id":"2306.00342","title":"Combining Explicit and Implicit Regularization for Efficient Learning in Deep Networks","created":"2023-06-01","cited_by_count":4,"area":null},{"id":"2312.13807","title":"Cluster-based classification with neural ODEs via control","created":"2023-12-21","cited_by_count":4,"area":null},{"id":"2402.05696","title":"Fixed width treelike neural networks capacity analysis -- generic activations","created":"2024-02-08","cited_by_count":4,"area":null},{"id":"2407.20724","title":"Exploring Loss Landscapes through the Lens of Spin Glass Theory","created":"2024-07-30","cited_by_count":4,"area":null},{"id":"2605.25880","title":"The Quantization Benefits of Residual-Free Transformers","created":"2026-05-25","cited_by_count":4,"area":null},{"id":"2106.03763","title":"Vanishing Curvature and the Power of Adaptive Methods in Randomly Initialized Deep Networks","created":"2021-06-07","cited_by_count":3,"area":null},{"id":"2201.12724","title":"Stochastic Neural Networks with Infinite Width are Deterministic","created":"2022-01-30","cited_by_count":3,"area":null},{"id":"2204.07261","title":"Convergence and Implicit Regularization Properties of Gradient Descent for Deep Residual Networks","created":"2022-04-14","cited_by_count":3,"area":null},{"id":"2204.10536","title":"Sharper Utility Bounds for Differentially Private Models","created":"2022-04-22","cited_by_count":3,"area":null},{"id":"2303.11247","title":"Memorization Capacity of Neural Networks with Conditional Computation","created":"2023-03-20","cited_by_count":3,"area":null},{"id":"2312.08244","title":"Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper bounds","created":"2023-12-13","cited_by_count":3,"area":null},{"id":"2312.08257","title":"\\emph{Lifted} RDT based capacity analysis of the 1-hidden layer treelike \\emph{sign} perceptrons neural networks","created":"2023-12-13","cited_by_count":3,"area":null},{"id":"2505.02281","title":"Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles","created":"2025-05-04","cited_by_count":3,"area":null},{"id":"2602.08306","title":"TextResNet: Decoupling and Routing Optimization Signals in Compound AI Systems via Deep Residual Tuning","created":"2026-02-09","cited_by_count":3,"area":null},{"id":"2102.04338","title":"The Landscape of Multi-Layer Linear Neural Network From the Perspective of Algebraic Geometry","created":"2021-01-30","cited_by_count":2,"area":null},{"id":"2310.12660","title":"Gradient Descent Fails to Learn High-frequency Functions and Modular Arithmetic","created":"2023-10-19","cited_by_count":2,"area":null},{"id":"2402.02569","title":"On the Complexity of Finite-Sum Smooth Optimization under the Polyak-{\\L}ojasiewicz Condition","created":"2024-02-04","cited_by_count":2,"area":null},{"id":"2409.06555","title":"Constructive Universal Approximation and Finite Sample Memorization by Narrow Deep ReLU Networks","created":"2024-09-10","cited_by_count":2,"area":null},{"id":"2602.07697","title":"On the Infinite Width and Depth Limits of Predictive Coding Networks","created":"2026-02-07","cited_by_count":2,"area":null},{"id":"2606.23364","title":"Convergence of Gradient Descent for General Neural Network Architectures Beyond the NTK Regime","created":"2026-06-22","cited_by_count":2,"area":null},{"id":"2201.12052","title":"Improved Overparametrization Bounds for Global Convergence of Stochastic Gradient Descent for Shallow Neural Networks","created":"2022-01-28","cited_by_count":1,"area":null},{"id":"2205.06571","title":"Convergence Analysis of Deep Residual Networks","created":"2022-05-13","cited_by_count":1,"area":null},{"id":"2403.12764","title":"Neural Parameter Regression for Explicit Representations of PDE Solution Operators","created":"2024-03-19","cited_by_count":1,"area":null},{"id":"2408.07815","title":"Algebraic Representations for Faster Predictions in Convolutional Neural Networks","created":"2024-08-14","cited_by_count":1,"area":null},{"id":"2408.13767","title":"Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning","created":"2024-08-25","cited_by_count":1,"area":null},{"id":"2410.08497","title":"Towards Sharper Risk Bounds for Minimax Problems","created":"2024-10-11","cited_by_count":1,"area":null},{"id":"2411.00372","title":"Generalizability of Memorization Neural Networks","created":"2024-11-01","cited_by_count":1,"area":null},{"id":"2503.06385","title":"A Good Start Matters: Enhancing Continual Learning with Data-Driven Weight Initialization","created":"2025-03-09","cited_by_count":1,"area":null},{"id":"2506.24120","title":"Data Uniformity Improves Training Efficiency and More, with a Convergence Framework Beyond the NTK Regime","created":"2025-06-30","cited_by_count":1,"area":null},{"id":"2507.20089","title":"Meta Fusion: A Unified Framework For Multimodality Fusion with Mutual Learning","created":"2025-07-27","cited_by_count":1,"area":null},{"id":"2103.07287","title":"Neural Networks with Complex-Valued Weights Have No Spurious Local Minima","created":"2021-01-31","cited_by_count":0,"area":null},{"id":"2103.16355","title":"Nonlinear Weighted Directed Acyclic Graph and A Priori Estimates for Neural Networks","created":"2021-03-30","cited_by_count":0,"area":null},{"id":"2111.05232","title":"Learning Rates for Nonconvex Pairwise Learning","created":"2021-11-09","cited_by_count":0,"area":null},{"id":"2201.02761","title":"Global Convergence Analysis of Deep Linear Networks with A One-neuron Layer","created":"2022-01-08","cited_by_count":0,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null},{"id":"2206.04490","title":"Redundancy in Deep Linear Neural Networks","created":"2022-06-09","cited_by_count":0,"area":null},{"id":"2210.10725","title":"SML:Enhance the Network Smoothness with Skip Meta Logit for CTR Prediction","created":"2022-10-09","cited_by_count":0,"area":null},{"id":"2308.10630","title":"A Homogenization Approach for Gradient-Dominated Stochastic Optimization","created":"2023-08-21","cited_by_count":0,"area":null},{"id":"2408.00359","title":"Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks","created":"2024-08-01","cited_by_count":0,"area":null}],"next_cursor":"100"}