{"total":306,"rows":[{"id":"2102.06171","title":"High-Performance Large-Scale Image Recognition Without Normalization","created":"2021-02-11","cited_by_count":360,"area":null},{"id":"2102.11535","title":"Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective","created":"2021-02-23","cited_by_count":169,"area":null},{"id":"2310.17513","title":"The Expressive Power of Low-Rank Adaptation","created":"2023-10-26","cited_by_count":102,"area":"diffusion"},{"id":"2402.18762","title":"Disentangling the Causes of Plasticity Loss in Neural Networks","created":"2024-02-29","cited_by_count":86,"area":"deeprl"},{"id":"2404.03264","title":"Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directions","created":"2024-04-04","cited_by_count":77,"area":null},{"id":"2102.01063","title":"Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition","created":"2021-02-01","cited_by_count":73,"area":null},{"id":"2103.05127","title":"Model Complexity of Deep Learning: A Survey","created":"2021-03-08","cited_by_count":65,"area":null},{"id":"2112.08348","title":"Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts","created":"2021-12-15","cited_by_count":64,"area":null},{"id":"2407.01800","title":"Normalization and effective learning rates in reinforcement learning","created":"2024-07-01","cited_by_count":58,"area":"deeprl"},{"id":"2105.14835","title":"Towards Lower Bounds on the Depth of ReLU Neural Networks","created":"2021-05-31","cited_by_count":56,"area":null},{"id":"2201.10355","title":"Neural Architecture Search for Spiking Neural Networks","created":"2022-01-23","cited_by_count":53,"area":null},{"id":"2402.15555","title":"Deep Networks Always Grok and Here is Why","created":"2024-02-23","cited_by_count":51,"area":null},{"id":"2403.02241","title":"Neural Redshift: Random Networks are not Random Functions","created":"2024-03-04","cited_by_count":43,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2305.00241","title":"When Deep Learning Meets Polyhedral Theory: A Survey","created":"2023-04-29","cited_by_count":39,"area":null},{"id":"2104.08135","title":"Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums","created":"2021-04-16","cited_by_count":37,"area":null},{"id":"2207.10430","title":"The Neural Race Reduction: Dynamics of Abstraction in Gated Networks","created":"2022-07-21","cited_by_count":37,"area":null},{"id":"2211.16327","title":"On the Power of Foundation Models","created":"2022-11-29","cited_by_count":37,"area":null},{"id":"2302.12553","title":"Lower Bounds on the Depth of Integral ReLU Neural Networks via Lattice Polytopes","created":"2023-02-24","cited_by_count":36,"area":null},{"id":"2305.19753","title":"The Tunnel Effect: Building Data Representations in Deep Neural Networks","created":"2023-05-31","cited_by_count":34,"area":null},{"id":"2306.06529","title":"Neural Injective Functions for Multisets, Measures and Graphs via a Finite Witness Theorem","created":"2023-06-10","cited_by_count":34,"area":null},{"id":"2103.16886","title":"Neural Response Interpretation through the Lens of Critical Pathways","created":"2021-03-31","cited_by_count":32,"area":null},{"id":"2410.19730","title":"Counting Ability of Large Language Models and Impact of Tokenization","created":"2024-10-25","cited_by_count":32,"area":"lr"},{"id":"2210.04345","title":"LieGG: Studying Learned Lie Group Generators","created":"2022-10-09","cited_by_count":31,"area":null},{"id":"2302.12828","title":"SplineCam: Exact Visualization and Characterization of Deep Network Geometry and Decision Boundaries","created":"2023-02-24","cited_by_count":31,"area":null},{"id":"2503.10084","title":"Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs","created":"2025-03-13","cited_by_count":31,"area":null},{"id":"2604.28119","title":"Do Sparse Autoencoders Capture Concept Manifolds?","created":"2026-04-30","cited_by_count":31,"area":"mechinterp"},{"id":"2109.00817","title":"NASI: Label- and Data-agnostic Neural Architecture Search at Initialization","created":"2021-09-02","cited_by_count":28,"area":null},{"id":"2210.07236","title":"Improved Bounds on Neural Complexity for Representing Piecewise Linear Functions","created":"2022-10-13","cited_by_count":26,"area":null},{"id":"2106.13361","title":"Multifidelity Modeling for Physics-Informed Neural Networks (PINNs)","created":"2021-06-25","cited_by_count":25,"area":null},{"id":"2403.11871","title":"The Real Tropical Geometry of Neural Networks","created":"2024-03-18","cited_by_count":24,"area":null},{"id":"2106.08314","title":"Causal Navigation by Continuous-time Neural Networks","created":"2021-06-15","cited_by_count":23,"area":"offlinerl"},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2206.08615","title":"On the Number of Regions of Piecewise Linear Neural Networks","created":"2022-06-17","cited_by_count":21,"area":null},{"id":"2211.03232","title":"Exponentially Improving the Complexity of Simulating the Weisfeiler-Lehman Test with Graph Neural Networks","created":"2022-11-06","cited_by_count":21,"area":null},{"id":"2304.02034","title":"Effective Theory of Transformers at Initialization","created":"2023-04-04","cited_by_count":21,"area":null},{"id":"2307.01998","title":"Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities","created":"2023-07-05","cited_by_count":21,"area":null},{"id":"2106.06152","title":"On the Robustness of Average Losses for Partial-Label Learning","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2107.09370","title":"An Embedding of ReLU Networks and an Analysis of their Identifiability","created":"2021-07-20","cited_by_count":20,"area":null},{"id":"2102.07804","title":"Scaling Up Exact Neural Network Compression by ReLU Stability","created":"2021-02-15","cited_by_count":19,"area":null},{"id":"2202.10847","title":"UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography","created":"2022-02-22","cited_by_count":19,"area":null},{"id":"2206.01342","title":"Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning","created":"2022-06-02","cited_by_count":19,"area":null},{"id":"2210.04909","title":"Meta-Principled Family of Hyperparameter Scaling Strategies","created":"2022-10-10","cited_by_count":19,"area":null},{"id":"2302.01934","title":"A neural operator-based surrogate solver for free-form electromagnetic inverse design","created":"2023-02-04","cited_by_count":19,"area":null},{"id":"2102.01621","title":"Depth separation beyond radial functions","created":"2021-02-02","cited_by_count":18,"area":null},{"id":"2502.06283","title":"On the Expressiveness of Rational ReLU Neural Networks With Bounded Depth","created":"2025-02-10","cited_by_count":18,"area":null},{"id":"2512.01643","title":"ViT$^3$: Unlocking Test-Time Training in Vision","created":"2025-12-01","cited_by_count":18,"area":null},{"id":"2102.10492","title":"Deep ReLU Networks Preserve Expected Length","created":"2021-02-21","cited_by_count":17,"area":null},{"id":"2206.02972","title":"Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics","created":"2022-06-07","cited_by_count":16,"area":null},{"id":"2107.00379","title":"On the Expected Complexity of Maxout Networks","created":"2021-07-01","cited_by_count":15,"area":null},{"id":"2107.13191","title":"Neural Network Approximation of Refinable Functions","created":"2021-07-28","cited_by_count":15,"area":null},{"id":"2203.06462","title":"Low-Rank Softmax Can Have Unargmaxable Classes in Theory but Rarely in Practice","created":"2022-03-12","cited_by_count":15,"area":null},{"id":"2204.01368","title":"Training Fully Connected Neural Networks is $\\exists\\mathbb{R}$-Complete","created":"2022-04-04","cited_by_count":15,"area":null},{"id":"2407.12895","title":"A Survey on Universal Approximation Theorems","created":"2024-07-17","cited_by_count":15,"area":null},{"id":"2206.08255","title":"Gradient-Based Adversarial and Out-of-Distribution Detection","created":"2022-06-16","cited_by_count":14,"area":null},{"id":"2306.07212","title":"Polyhedral Complex Extraction from ReLU Networks using Edge Subdivision","created":"2023-06-12","cited_by_count":14,"area":null},{"id":"2310.05918","title":"Grokking as Compression: A Nonlinear Complexity Perspective","created":"2023-10-09","cited_by_count":14,"area":null},{"id":"2408.04569","title":"Activation degree thresholds and expressiveness of polynomial neural networks","created":"2024-08-08","cited_by_count":14,"area":null},{"id":"2506.03951","title":"Rethinking the Stability-Plasticity Trade-off in Continual Learning from an Architectural Perspective","created":"2025-06-04","cited_by_count":14,"area":null},{"id":"2506.07998","title":"Generative Modeling of Weights: Generalization or Memorization?","created":"2025-06-09","cited_by_count":14,"area":null},{"id":"2202.11749","title":"Are All Linear Regions Created Equal?","created":"2022-02-23","cited_by_count":13,"area":null},{"id":"2305.02334","title":"Structures of Neural Network Effective Theories","created":"2023-05-03","cited_by_count":13,"area":null},{"id":"2102.06635","title":"ReLU Neural Networks of Polynomial Size for Exact Maximum Flow Computation","created":"2021-02-12","cited_by_count":12,"area":null},{"id":"2106.03186","title":"Reverse Engineering the Neural Tangent Kernel","created":"2021-06-06","cited_by_count":12,"area":null},{"id":"2110.04328","title":"Distinguishing rule- and exemplar-based generalization in learning systems","created":"2021-10-08","cited_by_count":12,"area":null},{"id":"2202.04925","title":"Decomposing neural networks as mappings of correlation functions","created":"2022-02-10","cited_by_count":12,"area":null},{"id":"2301.00008","title":"Effects of Data Geometry in Early Deep Learning","created":"2022-12-29","cited_by_count":12,"area":null},{"id":"2211.16551","title":"Numerical evidence against advantage with quantum fidelity kernels on classical data","created":"2022-11-29","cited_by_count":11,"area":null},{"id":"2212.07295","title":"Maximal Initial Learning Rates in Deep ReLU Networks","created":"2022-12-14","cited_by_count":11,"area":null},{"id":"2301.12309","title":"On the Lipschitz Constant of Deep Networks and Double Descent","created":"2023-01-28","cited_by_count":11,"area":null},{"id":"2306.17418","title":"ReLU Neural Networks, Polyhedral Decompositions, and Persistent Homolog","created":"2023-06-30","cited_by_count":10,"area":null},{"id":"2307.13149","title":"Discovering interpretable elastoplasticity models via the neural polynomial method enabled symbolic regressions","created":"2023-07-24","cited_by_count":10,"area":null},{"id":"2401.03451","title":"Optimization Over Trained Neural Networks: Taking a Relaxing Walk","created":"2024-01-07","cited_by_count":10,"area":null},{"id":"2410.01635","title":"Does Graph Prompt Work? A Data Operation Perspective with Theoretical Analysis","created":"2024-10-02","cited_by_count":10,"area":null},{"id":"2508.00230","title":"Towards Higher Effective Rank in Parameter-efficient Fine-tuning using Khatri--Rao Product","created":"2025-08-01","cited_by_count":10,"area":null},{"id":"2106.08365","title":"Test Sample Accuracy Scales with Training Sample Density in Neural Networks","created":"2021-06-15","cited_by_count":9,"area":null},{"id":"2203.11355","title":"Origami in N dimensions: How feed-forward networks manufacture linear separability","created":"2022-03-21","cited_by_count":9,"area":null},{"id":"2206.00228","title":"Lower and Upper Bounds for Numbers of Linear Regions of Graph Convolutional Networks","created":"2022-06-01","cited_by_count":9,"area":null},{"id":"2305.00608","title":"Differentiable Neural Networks with RePU Activation: with Applications to Score Estimation and Isotonic Regression","created":"2023-05-01","cited_by_count":9,"area":null},{"id":"2405.19816","title":"Growing Tiny Networks: Spotting Expressivity Bottlenecks and Fixing Them Optimally","created":"2024-05-30","cited_by_count":9,"area":null},{"id":"2412.18283","title":"On the Local Complexity of Linear Regions in Deep ReLU Networks","created":"2024-12-24","cited_by_count":9,"area":null},{"id":"2503.22178","title":"AdaRank: Adaptive Rank Pruning for Enhanced Model Merging","created":"2025-03-28","cited_by_count":9,"area":null},{"id":"2504.13112","title":"Hadamard product in deep learning: Introduction, Advances and Challenges","created":"2025-04-17","cited_by_count":9,"area":null},{"id":"2107.06304","title":"Privacy Vulnerability of Split Computing to Data-Free Model Inversion Attacks","created":"2021-07-13","cited_by_count":8,"area":null},{"id":"2209.14778","title":"Batch Normalization Explained","created":"2022-09-29","cited_by_count":8,"area":null},{"id":"2210.05742","title":"Curved Representation Space of Vision Transformers","created":"2022-10-11","cited_by_count":8,"area":null},{"id":"2301.07966","title":"Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions","created":"2023-01-19","cited_by_count":8,"area":null},{"id":"2410.01870","title":"PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers","created":"2024-10-02","cited_by_count":8,"area":null},{"id":"2505.02537","title":"Advancing Constrained Monotonic Neural Networks: Achieving Universal Approximation Beyond Bounded Activations","created":"2025-05-05","cited_by_count":8,"area":null},{"id":"2103.05793","title":"Universal Approximation of Residual Flows in Maximum Mean Discrepancy","created":"2021-03-10","cited_by_count":7,"area":null},{"id":"2104.00008","title":"Why is AI hard and Physics simple?","created":"2021-03-31","cited_by_count":7,"area":null},{"id":"2108.11939","title":"Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics","created":"2021-08-26","cited_by_count":7,"area":null},{"id":"2206.09149","title":"Piecewise Linear Neural Networks and Deep Learning","created":"2022-06-18","cited_by_count":7,"area":null},{"id":"2208.01134","title":"Improving the Trainability of Deep Neural Networks through Layerwise Batch-Entropy Regularization","created":"2022-08-01","cited_by_count":7,"area":null},{"id":"2210.13212","title":"A Dimension-Augmented Physics-Informed Neural Network (DaPINN) with High Level Accuracy and Efficiency","created":"2022-10-19","cited_by_count":7,"area":null},{"id":"2210.13611","title":"Understanding the Evolution of Linear Regions in Deep Reinforcement Learning","created":"2022-10-24","cited_by_count":7,"area":null},{"id":"2212.11811","title":"Renormalization in the neural network-quantum field theory correspondence","created":"2022-12-22","cited_by_count":7,"area":null},{"id":"2308.03812","title":"Noncompact uniform universal approximation","created":"2023-08-07","cited_by_count":7,"area":null},{"id":"2310.01691","title":"Zero-Shot Continuous Prompt Transfer: Generalizing Task Semantics Across Language Models","created":"2023-10-02","cited_by_count":7,"area":null},{"id":"2310.14062","title":"On the Neural Tangent Kernel of Equilibrium Models","created":"2023-10-21","cited_by_count":7,"area":null}],"next_cursor":"100"}