{"total":91,"rows":[{"id":"2105.14491","title":"How Attentive are Graph Attention Networks?","created":"2021-05-30","cited_by_count":835,"area":null},{"id":"2305.19466","title":"The Impact of Positional Encoding on Length Generalization in Transformers","created":"2023-05-31","cited_by_count":327,"area":null},{"id":"2209.10655","title":"Mega: Moving Average Equipped Gated Attention","created":"2022-09-21","cited_by_count":179,"area":null},{"id":"2305.00241","title":"When Deep Learning Meets Polyhedral Theory: A Survey","created":"2023-04-29","cited_by_count":39,"area":null},{"id":"2110.03303","title":"Universal Approximation Under Constraints is Possible with Transformers","created":"2021-10-07","cited_by_count":32,"area":null},{"id":"2410.10807","title":"HardNet: Hard-Constrained Neural Networks with Universal Approximation Guarantees","created":"2024-10-14","cited_by_count":31,"area":null},{"id":"2206.09527","title":"Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activations","created":"2022-06-20","cited_by_count":29,"area":null},{"id":"2209.11395","title":"Achieve the Minimum Width of Neural Networks for Universal Approximation","created":"2022-09-23","cited_by_count":26,"area":null},{"id":"2201.13094","title":"Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformer","created":"2022-01-31","cited_by_count":22,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2309.10402","title":"Minimum width for universal approximation using ReLU networks on compact domain","created":"2023-09-19","cited_by_count":18,"area":null},{"id":"2208.13219","title":"Visualizing high-dimensional loss landscapes with Hessian directions","created":"2022-08-28","cited_by_count":16,"area":null},{"id":"2407.12895","title":"A Survey on Universal Approximation Theorems","created":"2024-07-17","cited_by_count":15,"area":null},{"id":"2305.18460","title":"Minimum Width of Leaky-ReLU Neural Networks for Uniform Universal Approximation","created":"2023-05-29","cited_by_count":13,"area":null},{"id":"2105.04046","title":"A likelihood approach to nonparametric estimation of a singular distribution using deep generative models","created":"2021-05-09","cited_by_count":12,"area":null},{"id":"2209.06788","title":"Small Transformers Compute Universal Metric Embeddings","created":"2022-09-14","cited_by_count":12,"area":null},{"id":"2211.13866","title":"Minimal Width for Universal Property of Deep RNN","created":"2022-11-25","cited_by_count":12,"area":null},{"id":"2502.09844","title":"Solving Empirical Bayes via Transformers","created":"2025-02-14","cited_by_count":11,"area":null},{"id":"2202.03841","title":"Width is Less Important than Depth in ReLU Neural Networks","created":"2022-02-08","cited_by_count":10,"area":null},{"id":"2401.03451","title":"Optimization Over Trained Neural Networks: Taking a Relaxing Walk","created":"2024-01-07","cited_by_count":10,"area":null},{"id":"2404.08921","title":"PNeRV: Enhancing Spatial Consistency via Pyramidal Neural Representation for Videos","created":"2024-04-13","cited_by_count":10,"area":null},{"id":"2202.02710","title":"Spectrally Adapted Physics-Informed Neural Networks for Solving Unbounded Domain Problems","created":"2022-02-06","cited_by_count":9,"area":null},{"id":"2406.01255","title":"On the Nonlinearity of Layer Normalization","created":"2024-06-03","cited_by_count":9,"area":null},{"id":"2408.16389","title":"Addressing common misinterpretations of KART and UAT in neural network literature","created":"2024-08-29","cited_by_count":9,"area":null},{"id":"2302.10524","title":"LU-Net: Invertible Neural Networks Based on Matrix Factorization","created":"2023-02-21","cited_by_count":8,"area":null},{"id":"2311.03733","title":"Improved weight initialization for deep and narrow feedforward neural network","created":"2023-11-07","cited_by_count":7,"area":null},{"id":"2201.06126","title":"Control of Dual-Sourcing Inventory Systems using Recurrent Neural Networks","created":"2022-01-16","cited_by_count":6,"area":null},{"id":"2204.11231","title":"Do ReLU Networks Have An Edge When Approximating Compactly-Supported Functions?","created":"2022-04-24","cited_by_count":6,"area":null},{"id":"2305.12205","title":"Vocabulary for Universal Approximation: A Linguistic Perspective of Mapping Compositions","created":"2023-05-20","cited_by_count":6,"area":null},{"id":"2312.16699","title":"Computational Tradeoffs of Optimization-Based Bound Tightening in ReLU Networks","created":"2023-12-27","cited_by_count":6,"area":null},{"id":"2401.07174","title":"On the (In)Compatibility between Group Fairness and Individual Fairness","created":"2024-01-13","cited_by_count":6,"area":null},{"id":"2401.15121","title":"Expressive Power of ReLU and Step Networks under Floating-Point Operations","created":"2024-01-26","cited_by_count":5,"area":null},{"id":"2410.02242","title":"Robust Weight Initialization for Tanh Neural Networks with Fixed Point Analysis","created":"2024-10-03","cited_by_count":5,"area":null},{"id":"2209.10909","title":"Vanilla Feedforward Neural Networks as a Discretization of Dynamical Systems","created":"2022-09-22","cited_by_count":4,"area":null},{"id":"2304.07247","title":"The R-mAtrIx Net","created":"2023-04-14","cited_by_count":4,"area":null},{"id":"2304.10552","title":"Approximation and interpolation of deep neural networks","created":"2023-04-20","cited_by_count":4,"area":null},{"id":"2409.00297","title":"On Expressive Power of Quantized Neural Networks under Fixed-Point Arithmetic","created":"2024-08-30","cited_by_count":4,"area":null},{"id":"2409.20383","title":"Beyond Derivative Pathology of PINNs: Variable Splitting Strategy with Convergence Analysis","created":"2024-09-30","cited_by_count":4,"area":null},{"id":"2504.15110","title":"Approximation Rates in Besov Norms and Sample-Complexity of Kolmogorov-Arnold Networks with Residual Connections","created":"2025-04-21","cited_by_count":4,"area":null},{"id":"2301.13370","title":"On the Correctness of Automatic Differentiation for Neural Networks with Machine-Representable Parameters","created":"2023-01-31","cited_by_count":3,"area":null},{"id":"2305.16910","title":"Universal approximation with complex-valued deep narrow neural networks","created":"2023-05-26","cited_by_count":3,"area":null},{"id":"2403.13851","title":"Control of Medical Digital Twins with Artificial Neural Networks","created":"2024-03-18","cited_by_count":3,"area":null},{"id":"2405.14147","title":"Minimum number of neurons in fully connected layers of a given neural network (the first approximation)","created":"2024-05-23","cited_by_count":3,"area":null},{"id":"2504.07371","title":"Minimum width for universal approximation using squashable activation functions","created":"2025-04-10","cited_by_count":3,"area":null},{"id":"2310.03529","title":"Deep Ridgelet Transform: Voice with Koopman Operator Proves Universality of Formal Deep Networks","created":"2023-10-05","cited_by_count":2,"area":null},{"id":"2402.02407","title":"Defining Neural Network Architecture through Polytope Structures of Dataset","created":"2024-02-04","cited_by_count":2,"area":null},{"id":"2405.13682","title":"Deep Ridgelet Transform and Unified Universality Theorem for Deep and Shallow Joint-Group-Equivariant Machines","created":"2024-05-22","cited_by_count":2,"area":null},{"id":"2409.02363","title":"Optimal Neural Network Approximation for High-Dimensional Continuous Functions","created":"2024-09-04","cited_by_count":2,"area":null},{"id":"2409.06555","title":"Constructive Universal Approximation and Finite Sample Memorization by Narrow Deep ReLU Networks","created":"2024-09-10","cited_by_count":2,"area":null},{"id":"2503.15696","title":"Approximation properties of neural ODEs","created":"2025-03-19","cited_by_count":2,"area":null},{"id":"2511.06837","title":"Minimum Width of Deep Narrow Networks for Universal Approximation","created":"2025-11-10","cited_by_count":2,"area":null},{"id":"2605.31231","title":"A holomorphic neural network framework for 3D boundary value problems governed by harmonic potentials","created":"2026-05-29","cited_by_count":2,"area":null},{"id":"2112.05673","title":"Neural Multi-Quantile Forecasting for Optimal Inventory Management","created":"2021-12-10","cited_by_count":1,"area":null},{"id":"2211.08018","title":"Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networks","created":"2022-11-15","cited_by_count":1,"area":null},{"id":"2211.13935","title":"LU decomposition and Toeplitz decomposition of a neural network","created":"2022-11-25","cited_by_count":1,"area":null},{"id":"2305.16375","title":"Data Topology-Dependent Upper Bounds of Neural Network Widths","created":"2023-05-25","cited_by_count":1,"area":null},{"id":"2408.06996","title":"Blessing of Dimensionality for Approximating Sobolev Classes on Manifolds","created":"2024-08-13","cited_by_count":1,"area":null},{"id":"2410.00396","title":"Dynamic neuron approach to deep neural networks: Decoupling neurons for renormalization group analysis","created":"2024-10-01","cited_by_count":1,"area":null},{"id":"2411.00372","title":"Generalizability of Memorization Neural Networks","created":"2024-11-01","cited_by_count":1,"area":null},{"id":"2504.11397","title":"MLPs and KANs for data-driven learning in physical problems: A performance comparison","created":"2025-04-15","cited_by_count":1,"area":null},{"id":"2505.01995","title":"Extended Fiducial Inference for Individual Treatment Effects via Deep Neural Networks","created":"2025-05-04","cited_by_count":1,"area":null},{"id":"2506.24120","title":"Data Uniformity Improves Training Efficiency and More, with a Convergence Framework Beyond the NTK Regime","created":"2025-06-30","cited_by_count":1,"area":null},{"id":"2512.03678","title":"Feature-aware Modulation for Learning from Temporal Tabular Data","created":"2025-12-03","cited_by_count":1,"area":null},{"id":"2512.18059","title":"Approximation and learning with compositional tensor trains","created":"2025-12-19","cited_by_count":1,"area":null},{"id":"2601.01295","title":"Sobolev Approximation of Deep ReLU Networks in Log-Barron Space","created":"2026-01-03","cited_by_count":1,"area":null},{"id":"2605.28704","title":"Expressive Power of Floating-Point Neural Networks with Arbitrary Reduction Orders and Inexact Activation Implementations","created":"2026-05-27","cited_by_count":1,"area":null},{"id":"2606.31856","title":"Low-dimensional topology of deep neural networks","created":"2026-06-30","cited_by_count":1,"area":null},{"id":"2105.12894","title":"MAGI-X: Manifold-Constrained Gaussian Process Inference for Unknown System Dynamics","created":"2021-05-27","cited_by_count":0,"area":null},{"id":"2112.15026","title":"Two Instances of Interpretable Neural Network for Universal Approximations","created":"2021-12-30","cited_by_count":0,"area":null},{"id":"2201.05089","title":"Using Computational Intelligence for solving the Ornstein-Zernike equation","created":"2021-11-17","cited_by_count":0,"area":null},{"id":"2208.01440","title":"Viskositas: Viscosity Prediction of Multicomponent Chemical Systems","created":"2022-08-02","cited_by_count":0,"area":null},{"id":"2208.07787","title":"Delaunay-Triangulation-Based Learning with Hessian Total-Variation Regularization","created":"2022-08-16","cited_by_count":0,"area":null},{"id":"2212.07934","title":"Extending Universal Approximation Guarantees: A Theoretical Justification for the Continuity of Real-World Learning Tasks","created":"2022-12-06","cited_by_count":0,"area":null},{"id":"2301.09381","title":"A Structural Approach to the Design of Domain Specific Neural Network Architectures","created":"2023-01-23","cited_by_count":0,"area":null},{"id":"2305.13519","title":"Development of Non-Linear Equations for Predicting Electrical Conductivity in Silicates","created":"2023-05-22","cited_by_count":0,"area":null},{"id":"2403.17607","title":"Fully-fused Multi-Layer Perceptrons on Intel Data Center GPUs","created":"2024-03-26","cited_by_count":0,"area":null},{"id":"2405.10957","title":"Statistical Mechanics and Artificial Neural Networks: Principles, Models, and Applications","created":"2024-04-05","cited_by_count":0,"area":null},{"id":"2408.00359","title":"Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks","created":"2024-08-01","cited_by_count":0,"area":null},{"id":"2503.10469","title":"Deep Learning based discovery of Integrable Systems","created":"2025-03-13","cited_by_count":0,"area":null},{"id":"2505.13142","title":"Parallel Layer Normalization for Universal Approximation","created":"2025-05-19","cited_by_count":0,"area":null},{"id":"2506.08033","title":"Feasibility Study of CNNs and MLPs for Radiation Heat Transfer in 2-D Furnaces with Spectrally Participative Gases","created":"2025-06-02","cited_by_count":0,"area":null},{"id":"2507.06267","title":"Neural Network-Based Parameter Estimation for Non-Autonomous Differential Equations with Discontinuous Signals","created":"2025-07-08","cited_by_count":0,"area":null},{"id":"2511.06376","title":"Vocabulary In-Context Learning in Transformers: Benefits of Positional Encoding","created":"2025-11-09","cited_by_count":0,"area":null},{"id":"2601.00672","title":"Sparse FEONet: A Low-Cost, Memory-Efficient Operator Network via Finite-Element Local Sparsity for Parametric PDEs","created":"2026-01-02","cited_by_count":0,"area":null},{"id":"2601.18264","title":"Neural Network Approximation: A View from Polytope Decomposition","created":"2026-01-26","cited_by_count":0,"area":null},{"id":"2603.00064","title":"The minimal width of universal $p$-adic ReLU neural networks","created":"2026-02-10","cited_by_count":0,"area":null},{"id":"2605.21451","title":"Approximation Theory for Neural Networks: Old and New","created":"2026-05-20","cited_by_count":0,"area":null},{"id":"2605.24437","title":"CAffNet: Hard Constraint-Affine Neural Networks","created":"2026-05-23","cited_by_count":0,"area":null},{"id":"2607.04597","title":"Minimum Block Width for Universal Approximation by Residual Neural Networks with Inner Width One","created":"2026-07-06","cited_by_count":0,"area":null},{"id":"2607.13574","title":"Approximation of solutions of parameter-dependent problems by residual neural networks","created":"2026-07-15","cited_by_count":0,"area":null},{"id":"2610.20229","title":"The minimal width of neural networks and immersions of real projective space","created":"2026-10-14","cited_by_count":0,"area":null}],"next_cursor":null}