{"total":249,"rows":[{"id":"2109.14545","title":"Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark","created":"2021-09-29","cited_by_count":155,"area":null},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102,"area":null},{"id":"2110.14012","title":"Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification","created":"2021-10-26","cited_by_count":80,"area":null},{"id":"2212.11870","title":"Impossibility Theorems for Feature Attribution","created":"2022-12-22","cited_by_count":78,"area":null},{"id":"2103.05127","title":"Model Complexity of Deep Learning: A Survey","created":"2021-03-08","cited_by_count":65,"area":null},{"id":"2111.00898","title":"Availability Attacks Create Shortcuts","created":"2021-11-01","cited_by_count":62,"area":null},{"id":"2105.03361","title":"What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory","created":"2021-05-07","cited_by_count":60,"area":null},{"id":"2105.14835","title":"Towards Lower Bounds on the Depth of ReLU Neural Networks","created":"2021-05-31","cited_by_count":56,"area":null},{"id":"2211.14400","title":"Optimal Approximation Rates for Deep ReLU Neural Networks on Sobolev and Besov Spaces","created":"2022-11-25","cited_by_count":51,"area":null},{"id":"2405.17394","title":"The Expressive Capacity of State Space Models: A Formal Language Perspective","created":"2024-05-27","cited_by_count":46,"area":null},{"id":"2303.05033","title":"Out-of-distribution Detection with Implicit Outlier Transformation","created":"2023-03-09","cited_by_count":43,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2203.04466","title":"The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks","created":"2022-03-09","cited_by_count":41,"area":null},{"id":"2209.13083","title":"Why neural networks find simple solutions: the many regularizers of geometric complexity","created":"2022-09-27","cited_by_count":39,"area":null},{"id":"2305.00241","title":"When Deep Learning Meets Polyhedral Theory: A Survey","created":"2023-04-29","cited_by_count":39,"area":null},{"id":"2404.04393","title":"Counting Like Transformers: Compiling Temporal Counting Logic Into Softmax Transformers","created":"2024-04-05","cited_by_count":39,"area":null},{"id":"2209.15055","title":"Implicit Bias of Large Depth Networks: a Notion of Rank for Nonlinear Functions","created":"2022-09-29","cited_by_count":38,"area":null},{"id":"2104.08135","title":"Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums","created":"2021-04-16","cited_by_count":37,"area":null},{"id":"2302.12553","title":"Lower Bounds on the Depth of Integral ReLU Neural Networks via Lattice Polytopes","created":"2023-02-24","cited_by_count":36,"area":null},{"id":"2106.06468","title":"Locally Sparse Neural Networks for Tabular Biomedical Data","created":"2021-06-11","cited_by_count":34,"area":null},{"id":"2306.04719","title":"Don't trust your eyes: on the (un)reliability of feature visualizations","created":"2023-06-07","cited_by_count":32,"area":null},{"id":"2111.11146","title":"On the Existence of Universal Lottery Tickets","created":"2021-11-22","cited_by_count":30,"area":null},{"id":"2206.01558","title":"Disentangling Epistemic and Aleatoric Uncertainty in Reinforcement Learning","created":"2022-06-03","cited_by_count":27,"area":null},{"id":"2210.07236","title":"Improved Bounds on Neural Complexity for Representing Piecewise Linear Functions","created":"2022-10-13","cited_by_count":26,"area":null},{"id":"2111.03577","title":"Mixtures of Laplace Approximations for Improved Post-Hoc Uncertainty in Deep Learning","created":"2021-11-05","cited_by_count":25,"area":null},{"id":"2403.11871","title":"The Real Tropical Geometry of Neural Networks","created":"2024-03-18","cited_by_count":24,"area":null},{"id":"2101.09113","title":"Pareto GAN: Extending the Representational Power of GANs to Heavy-Tailed Distributions","created":"2021-01-22","cited_by_count":23,"area":null},{"id":"2105.12508","title":"Adversarial Robustness against Multiple and Single $l_p$-Threat Models via Quick Fine-Tuning of Robust Classifiers","created":"2021-05-26","cited_by_count":23,"area":null},{"id":"2303.17045","title":"Training Neural Networks is NP-Hard in Fixed Dimension","created":"2023-03-29","cited_by_count":23,"area":null},{"id":"2102.05610","title":"Searching for Fast Model Families on Datacenter Accelerators","created":"2021-02-10","cited_by_count":22,"area":null},{"id":"2105.08675","title":"The Computational Complexity of ReLU Network Training Parameterized by Data Dimensionality","created":"2021-05-18","cited_by_count":22,"area":null},{"id":"2106.02601","title":"Learning Hard Optimization Problems: A Data Generation Perspective","created":"2021-06-04","cited_by_count":21,"area":null},{"id":"2206.08615","title":"On the Number of Regions of Piecewise Linear Neural Networks","created":"2022-06-17","cited_by_count":21,"area":null},{"id":"2209.04036","title":"Functional dimension of feedforward ReLU neural networks","created":"2022-09-08","cited_by_count":21,"area":null},{"id":"2501.18915","title":"Algebra Unveils Deep Learning -- An Invitation to Neuroalgebraic Geometry","created":"2025-01-31","cited_by_count":21,"area":null},{"id":"2102.01621","title":"Depth separation beyond radial functions","created":"2021-02-02","cited_by_count":18,"area":null},{"id":"2106.04260","title":"Provably Robust Detection of Out-of-distribution Data (almost) for free","created":"2021-06-08","cited_by_count":18,"area":null},{"id":"2502.06283","title":"On the Expressiveness of Rational ReLU Neural Networks With Bounded Depth","created":"2025-02-10","cited_by_count":18,"area":null},{"id":"2305.19008","title":"Bottleneck Structure in Learned Features: Low-Dimension vs Regularity Tradeoff","created":"2023-05-30","cited_by_count":17,"area":null},{"id":"2410.04887","title":"Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse","created":"2024-10-07","cited_by_count":16,"area":null},{"id":"2109.00190","title":"Approximation Properties of Deep ReLU CNNs","created":"2021-09-01","cited_by_count":15,"area":null},{"id":"2201.01965","title":"Efficient Global Optimization of Two-Layer ReLU Networks: Quadratic-Time Algorithms and Adversarial Training","created":"2022-01-06","cited_by_count":15,"area":null},{"id":"2204.01368","title":"Training Fully Connected Neural Networks is $\\exists\\mathbb{R}$-Complete","created":"2022-04-04","cited_by_count":15,"area":null},{"id":"2101.02429","title":"Neural Spectrahedra and Semidefinite Lifts: Global Convex Optimization of Polynomial Activation Neural Networks in Fully Polynomial-Time","created":"2021-01-07","cited_by_count":14,"area":null},{"id":"2103.01007","title":"Error Estimates for the Deep Ritz Method with Boundary Penalty","created":"2021-03-01","cited_by_count":14,"area":null},{"id":"2110.09548","title":"Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks","created":"2021-10-18","cited_by_count":14,"area":null},{"id":"2210.13447","title":"Precision Machine Learning","created":"2022-10-24","cited_by_count":14,"area":null},{"id":"2105.04471","title":"Natural Posterior Network: Deep Bayesian Uncertainty for Exponential Family Distributions","created":"2021-05-10","cited_by_count":13,"area":null},{"id":"2108.05643","title":"On minimal representations of shallow ReLU networks","created":"2021-08-12","cited_by_count":13,"area":null},{"id":"2110.07682","title":"Sound and Complete Neural Network Repair with Minimality and Locality Guarantees","created":"2021-10-14","cited_by_count":13,"area":null},{"id":"2111.07183","title":"Reliably-stabilizing piecewise-affine neural network controllers","created":"2021-11-13","cited_by_count":13,"area":null},{"id":"2111.08922","title":"Traversing the Local Polytopes of ReLU Neural Networks: A Unified Approach for Network Verification","created":"2021-11-17","cited_by_count":13,"area":null},{"id":"2111.11153","title":"Plant 'n' Seek: Can You Find the Winning Ticket?","created":"2021-11-22","cited_by_count":13,"area":null},{"id":"2202.11749","title":"Are All Linear Regions Created Equal?","created":"2022-02-23","cited_by_count":13,"area":null},{"id":"2301.11701","title":"TransNet: Transferable Neural Networks for Partial Differential Equations","created":"2023-01-27","cited_by_count":13,"area":null},{"id":"2308.05509","title":"On the Optimal Expressive Power of ReLU DNNs and Its Application in Approximation with Kolmogorov Superposition Theorem","created":"2023-08-10","cited_by_count":13,"area":null},{"id":"2406.11828","title":"Learning sum of diverse features: computational hardness and efficient gradient-based training for ridge combinations","created":"2024-06-17","cited_by_count":13,"area":null},{"id":"2102.06635","title":"ReLU Neural Networks of Polynomial Size for Exact Maximum Flow Computation","created":"2021-02-12","cited_by_count":12,"area":null},{"id":"2105.04156","title":"ReLU Deep Neural Networks from the Hierarchical Basis Perspective","created":"2021-05-10","cited_by_count":12,"area":null},{"id":"2111.08117","title":"Neural networks with linear threshold activations: structure and algorithms","created":"2021-11-15","cited_by_count":12,"area":null},{"id":"2112.13544","title":"FitAct: Error Resilient Deep Neural Networks via Fine-Grained Post-Trainable Activation Functions","created":"2021-12-27","cited_by_count":12,"area":null},{"id":"2307.09212","title":"How Many Neurons Does it Take to Approximate the Maximum?","created":"2023-07-18","cited_by_count":12,"area":null},{"id":"2505.14338","title":"Better Neural Network Expressivity: Subdividing the Simplex","created":"2025-05-20","cited_by_count":12,"area":null},{"id":"2307.02318","title":"Deep Contract Design via Discontinuous Networks","created":"2023-07-05","cited_by_count":11,"area":null},{"id":"2402.03625","title":"Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time","created":"2024-02-06","cited_by_count":11,"area":null},{"id":"2402.15315","title":"On Minimal Depth in Neural Networks","created":"2024-02-23","cited_by_count":11,"area":null},{"id":"2502.09324","title":"Depth-Bounds for Neural Networks via the Braid Arrangement","created":"2025-02-13","cited_by_count":11,"area":null},{"id":"2505.06169","title":"On the Depth of Monotone ReLU Neural Networks and ICNNs","created":"2025-05-09","cited_by_count":11,"area":null},{"id":"2110.03448","title":"Multi-Head ReLU Implicit Neural Representation Networks","created":"2021-10-07","cited_by_count":10,"area":null},{"id":"2211.08404","title":"Non-Linear Coordination Graphs","created":"2022-10-26","cited_by_count":10,"area":null},{"id":"2306.10987","title":"A VAE Approach to Sample Multivariate Extremes","created":"2023-06-19","cited_by_count":10,"area":null},{"id":"2306.17418","title":"ReLU Neural Networks, Polyhedral Decompositions, and Persistent Homolog","created":"2023-06-30","cited_by_count":10,"area":null},{"id":"2310.01225","title":"A path-norm toolkit for modern networks: consequences, promises and challenges","created":"2023-10-02","cited_by_count":10,"area":null},{"id":"2310.11130","title":"Topological Expressivity of ReLU Neural Networks","created":"2023-10-17","cited_by_count":10,"area":null},{"id":"2401.03451","title":"Optimization Over Trained Neural Networks: Taking a Relaxing Walk","created":"2024-01-07","cited_by_count":10,"area":null},{"id":"2405.02330","title":"Adaptive Semantic Token Selection for AI-native Goal-oriented Communications","created":"2024-04-25","cited_by_count":10,"area":null},{"id":"2203.11355","title":"Origami in N dimensions: How feed-forward networks manufacture linear separability","created":"2022-03-21","cited_by_count":9,"area":null},{"id":"2312.16483","title":"Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation","created":"2023-12-27","cited_by_count":9,"area":null},{"id":"2402.08010","title":"Which Frequencies do CNNs Need? Emergent Bottleneck Structure in Feature Learning","created":"2024-02-12","cited_by_count":9,"area":null},{"id":"2410.04907","title":"Decomposition Polyhedra of Piecewise Linear Functions","created":"2024-10-07","cited_by_count":9,"area":null},{"id":"2411.03006","title":"Neural Networks and (Virtual) Extended Formulations","created":"2024-11-05","cited_by_count":9,"area":null},{"id":"2203.09555","title":"On the expressive power of message-passing neural networks as global feature map transformers","created":"2022-03-17","cited_by_count":8,"area":null},{"id":"2204.06062","title":"Local and global topological complexity measures OF ReLU neural network functions","created":"2022-04-12","cited_by_count":8,"area":null},{"id":"2205.11874","title":"Approximation speed of quantized vs. unquantized ReLU neural networks and beyond","created":"2022-05-24","cited_by_count":8,"area":null},{"id":"2301.07966","title":"Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions","created":"2023-01-19","cited_by_count":8,"area":null},{"id":"2312.14276","title":"Deep Neural Networks and Finite Elements of Any Order on Arbitrary Dimensions","created":"2023-12-21","cited_by_count":8,"area":null},{"id":"2111.15090","title":"The Geometric Occam's Razor Implicit in Deep Learning","created":"2021-11-30","cited_by_count":7,"area":null},{"id":"2206.09149","title":"Piecewise Linear Neural Networks and Deep Learning","created":"2022-06-18","cited_by_count":7,"area":null},{"id":"2210.13611","title":"Understanding the Evolution of Linear Regions in Deep Reinforcement Learning","created":"2022-10-24","cited_by_count":7,"area":null},{"id":"2305.16933","title":"Representing Piecewise Linear Functions by Functions with Small Arity","created":"2023-05-26","cited_by_count":7,"area":null},{"id":"2312.12657","title":"The Convex Landscape of Neural Networks: Characterizing Global Optima and Stationary Points via Lasso Models","created":"2023-12-19","cited_by_count":7,"area":null},{"id":"2505.16716","title":"The Computational Complexity of Counting Linear Regions in ReLU Neural Networks","created":"2025-05-22","cited_by_count":7,"area":null},{"id":"2210.08339","title":"Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systems","created":"2022-10-15","cited_by_count":6,"area":null},{"id":"2312.16699","title":"Computational Tradeoffs of Optimization-Based Bound Tightening in ReLU Networks","created":"2023-12-27","cited_by_count":6,"area":null},{"id":"2501.03017","title":"Convexity in ReLU Neural Networks: beyond ICNNs?","created":"2025-01-06","cited_by_count":6,"area":null},{"id":"2510.00368","title":"The Transformer Cookbook","created":"2025-10-01","cited_by_count":6,"area":null},{"id":"2106.04186","title":"What training reveals about neural network complexity","created":"2021-06-08","cited_by_count":5,"area":null},{"id":"2108.02327","title":"PI3NN: Out-of-distribution-aware prediction intervals from three neural networks","created":"2021-08-05","cited_by_count":5,"area":null},{"id":"2109.10935","title":"Robust Generalization of Quadratic Neural Networks via Function Identification","created":"2021-09-22","cited_by_count":5,"area":null},{"id":"2305.09145","title":"Deep ReLU Networks Have Surprisingly Simple Polytopes","created":"2023-05-16","cited_by_count":5,"area":null}],"next_cursor":"100"}