{"list":"other","total":117,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1607.06450","title":"Layer Normalization","created":"2016-07-21","cited_by_count":5669},{"id":"1901.05103","title":"DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation","created":"2019-01-16","cited_by_count":2689},{"id":"1803.08494","title":"Group Normalization","created":"2018-03-22","cited_by_count":1524},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"2104.13478","title":"Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges","created":"2021-04-27","cited_by_count":1167},{"id":"1602.07576","title":"Group Equivariant Convolutional Networks","created":"2016-02-24","cited_by_count":1165},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1802.10026","title":"Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs","created":"2018-02-27","cited_by_count":588},{"id":"1602.07868","title":"Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks","created":"2016-02-25","cited_by_count":543},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"1911.08251","title":"General $E(2)$-Equivariant Steerable CNNs","created":"2019-11-19","cited_by_count":446},{"id":"1910.07104","title":"Orthogonal Gradient Descent for Continual Learning","created":"2019-10-15","cited_by_count":369},{"id":"1812.09902","title":"Invariant and Equivariant Graph Networks","created":"2018-12-24","cited_by_count":346},{"id":"1906.04721","title":"Data-Free Quantization Through Weight Equalization and Bias Correction","created":"2019-06-11","cited_by_count":336},{"id":"1803.00885","title":"Essentially No Barriers in Neural Network Energy Landscape","created":"2018-03-02","cited_by_count":330},{"id":"1802.03690","title":"On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups","created":"2018-02-11","cited_by_count":300},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291},{"id":"1802.06509","title":"On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization","created":"2018-02-19","cited_by_count":284},{"id":"1711.07289","title":"Learning Steerable Filters for Rotation Equivariant CNNs","created":"2017-11-20","cited_by_count":194},{"id":"2201.12204","title":"From data to functa: Your data point is a function and you can treat it like one","created":"2022-01-28","cited_by_count":187},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"1806.00900","title":"Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced","created":"2018-06-04","cited_by_count":177},{"id":"1805.12076","title":"Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networks","created":"2018-05-30","cited_by_count":142},{"id":"1702.08389","title":"Equivariance Through Parameter-Sharing","created":"2017-02-27","cited_by_count":141},{"id":"2105.12221","title":"Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances","created":"2021-05-25","cited_by_count":127},{"id":"1706.05350","title":"L2 Regularization versus Batch and Weight Normalization","created":"2017-06-16","cited_by_count":124},{"id":"1506.02617","title":"Path-SGD: Path-Normalized Optimization in Deep Neural Networks","created":"2015-06-08","cited_by_count":120},{"id":"2002.11448","title":"Predicting Neural Network Accuracy from Weights","created":"2020-02-26","cited_by_count":110},{"id":"2301.12780","title":"Equivariant Architectures for Learning in Deep Weight Spaces","created":"2023-01-30","cited_by_count":107},{"id":"2306.06955","title":"A Brief Review of Hypernetworks in Deep Learning","created":"2023-06-12","cited_by_count":102},{"id":"2012.04728","title":"Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics","created":"2020-12-08","cited_by_count":96},{"id":"1709.06079","title":"Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks","created":"2017-09-16","cited_by_count":92},{"id":"1910.00744","title":"Reverse-Engineering Deep ReLU Networks","created":"2019-10-02","cited_by_count":83},{"id":"2102.13042","title":"Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling","created":"2021-02-25","cited_by_count":75},{"id":"2302.14040","title":"Permutation Equivariant Neural Functionals","created":"2023-02-27","cited_by_count":70},{"id":"1905.12207","title":"On the Expressive Power of Deep Polynomial Neural Networks","created":"2019-05-29","cited_by_count":66},{"id":"2105.13926","title":"Geometric Deep Learning and Equivariant Neural Networks","created":"2021-05-28","cited_by_count":65},{"id":"2205.14258","title":"On the Symmetries of Deep Learning Models and their Internal Representations","created":"2022-05-27","cited_by_count":64},{"id":"1907.02911","title":"Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape","created":"2019-07-05","cited_by_count":63},{"id":"1910.05505","title":"Learning deep linear neural networks: Riemannian gradient flows and convergence to global minimizers","created":"2019-10-12","cited_by_count":61},{"id":"2101.12249","title":"A Survey of Complex-Valued Neural Networks","created":"2021-01-28","cited_by_count":61},{"id":"2403.12143","title":"Graph Neural Networks for Learning Equivariant Representations of Neural Networks","created":"2024-03-18","cited_by_count":59},{"id":"2312.04501","title":"Graph Metanetworks for Processing Diverse Neural Architectures","created":"2023-12-07","cited_by_count":57},{"id":"2305.13546","title":"Neural Functional Transformers","created":"2023-05-22","cited_by_count":52},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50},{"id":"2110.03677","title":"Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect","created":"2021-10-07","cited_by_count":50},{"id":"2202.00089","title":"Understanding AdamW through Proximal Methods and Scale-Freeness","created":"2022-01-31","cited_by_count":46},{"id":"1902.01917","title":"Same, Same But Different - Recovering Neural Network Quantization Error Through Weight Factorization","created":"2019-02-05","cited_by_count":45},{"id":"2307.00144","title":"Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows","created":"2023-06-30","cited_by_count":45},{"id":"2402.13144","title":"Neural Network Diffusion","created":"2024-02-20","cited_by_count":42},{"id":"2406.09997","title":"Towards Scalable and Versatile Weight Space Learning","created":"2024-06-14","cited_by_count":41},{"id":"1804.10200","title":"The loss landscape of overparameterized neural networks","created":"2018-04-26","cited_by_count":39},{"id":"2306.06179","title":"Hidden symmetries of ReLU networks","created":"2023-06-09","cited_by_count":39},{"id":"2210.17216","title":"Symmetries, flat minima, and the conserved quantities of gradient flow","created":"2022-10-31","cited_by_count":35},{"id":"2310.13397","title":"Equivariant Deep Weight Space Alignment","created":"2023-10-20","cited_by_count":35},{"id":"2201.11968","title":"Training invariances and the low-rank phenomenon: beyond linear networks","created":"2022-01-28","cited_by_count":33},{"id":"2202.00980","title":"Robust Training of Neural Networks Using Scale Invariant Architectures","created":"2022-02-02","cited_by_count":29},{"id":"2303.04143","title":"Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?","created":"2023-03-07","cited_by_count":29},{"id":"2202.03038","title":"Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry","created":"2022-02-07","cited_by_count":28},{"id":"1802.03713","title":"$\\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space","created":"2018-02-11","cited_by_count":27},{"id":"2402.05232","title":"Universal Neural Functionals","created":"2024-02-07","cited_by_count":26},{"id":"2205.10637","title":"Symmetry Teleportation for Accelerated Optimization","created":"2022-05-21","cited_by_count":25},{"id":"2309.16932","title":"Symmetry Induces Structure and Constraint of Learning","created":"2023-09-29","cited_by_count":25},{"id":"2503.10633","title":"We Should Chart an Atlas of All the World's Models","created":"2025-03-13","cited_by_count":25},{"id":"2112.12982","title":"Parameter identifiability of a deep feedforward ReLU neural network","created":"2021-12-24","cited_by_count":24},{"id":"2402.04081","title":"Improved Generalization of Weight Space Networks via Augmentations","created":"2024-02-06","cited_by_count":24},{"id":"2406.10685","title":"Scale Equivariant Graph Metanetworks","created":"2024-06-15","cited_by_count":24},{"id":"2209.07509","title":"Random initialisations performing above chance and how to find them","created":"2022-09-15","cited_by_count":23},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23},{"id":"2410.04207","title":"Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models","created":"2024-10-05","cited_by_count":22},{"id":"2410.04209","title":"Equivariant Neural Functional Networks for Transformers","created":"2024-10-05","cited_by_count":22},{"id":"2209.04036","title":"Functional dimension of feedforward ReLU neural networks","created":"2022-09-08","cited_by_count":21},{"id":"2304.02902","title":"Towards Efficient MCMC Sampling in Bayesian Neural Networks by Exploiting Symmetry","created":"2023-04-06","cited_by_count":21},{"id":"2405.20231","title":"The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof","created":"2024-05-30","cited_by_count":21},{"id":"2501.18915","title":"Algebra Unveils Deep Learning -- An Invitation to Neuroalgebraic Geometry","created":"2025-01-31","cited_by_count":21},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19},{"id":"2210.00638","title":"What shapes the loss landscape of self-supervised learning?","created":"2022-10-02","cited_by_count":19},{"id":"2012.01118","title":"Neural Teleportation","created":"2020-12-02","cited_by_count":18},{"id":"2208.03113","title":"On the non-universality of deep learning: quantifying the cost of symmetry","created":"2022-08-05","cited_by_count":18},{"id":"2310.18935","title":"Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data","created":"2023-10-29","cited_by_count":18},{"id":"1803.01273","title":"Accelerating Natural Gradient with Higher-Order Invariance","created":"2018-03-04","cited_by_count":17},{"id":"2409.11697","title":"Monomial Matrix Group Equivariant Neural Functional Networks","created":"2024-09-18","cited_by_count":17},{"id":"1902.10416","title":"Equi-normalization of Neural Networks","created":"2019-02-27","cited_by_count":16},{"id":"2302.07384","title":"The Geometry of Neural Nets' Parameter Spaces Under Reparametrization","created":"2023-02-14","cited_by_count":16},{"id":"2408.17221","title":"Geometry of Lightning Self-Attention: Identifiability and Dimension","created":"2024-08-30","cited_by_count":16},{"id":"2502.00264","title":"Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion","created":"2025-02-01","cited_by_count":16},{"id":"1511.01754","title":"Symmetry-invariant optimization in deep networks","created":"2015-11-05","cited_by_count":15},{"id":"2304.12794","title":"Expand-and-Cluster: Parameter Recovery of Neural Networks","created":"2023-04-25","cited_by_count":15},{"id":"2408.04569","title":"Activation degree thresholds and expressiveness of polynomial neural networks","created":"2024-08-08","cited_by_count":14},{"id":"2310.08287","title":"A Symmetry-Aware Exploration of Bayesian Neural Network Posteriors","created":"2023-10-12","cited_by_count":12},{"id":"2007.06567","title":"Lossless Compression of Structured Convolutional Models via Lifting","created":"2020-07-13","cited_by_count":11},{"id":"2310.07235","title":"Are GATs Out of Balance?","created":"2023-10-11","cited_by_count":10},{"id":"2505.23681","title":"Understanding Mode Connectivity via Parameter Space Symmetry","created":"2025-05-29","cited_by_count":10},{"id":"2504.19274","title":"TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks","created":"2025-04-27","cited_by_count":9}],"next_cursor":"100"}