{"total":169,"rows":[{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187,"area":null},{"id":"2107.07871","title":"Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations","created":"2021-07-16","cited_by_count":145,"area":null},{"id":"2308.08468","title":"An Expert's Guide to Training Physics-informed Neural Networks","created":"2023-08-16","cited_by_count":126,"area":null},{"id":"2110.01654","title":"Improved architectures and training algorithms for deep operator networks","created":"2021-10-04","cited_by_count":86,"area":null},{"id":"2410.13228","title":"From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning","created":"2024-10-17","cited_by_count":73,"area":null},{"id":"2201.07395","title":"Overview frequency principle/spectral bias in deep learning","created":"2022-01-19","cited_by_count":69,"area":null},{"id":"2104.09125","title":"SAPE: Spatially-Adaptive Progressive Encoding for Neural Optimization","created":"2021-04-19","cited_by_count":59,"area":null},{"id":"2310.19793","title":"On Learning Gaussian Multi-index Models with Gradient Flow","created":"2023-10-30","cited_by_count":57,"area":null},{"id":"2105.09513","title":"Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions","created":"2021-05-20","cited_by_count":49,"area":null},{"id":"2111.15242","title":"ConDA: Unsupervised Domain Adaptation for LiDAR Segmentation via Regularized Domain Concatenation","created":"2021-11-30","cited_by_count":41,"area":null},{"id":"2107.03144","title":"Neural Contextual Bandits without Regret","created":"2021-07-07","cited_by_count":40,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2504.16109","title":"Representation Learning for Tabular Data: A Comprehensive Survey","created":"2025-04-17","cited_by_count":36,"area":null},{"id":"2302.05933","title":"Generalization Ability of Wide Neural Networks on $\\mathbb{R}$","created":"2023-02-12","cited_by_count":30,"area":null},{"id":"2104.10343","title":"Sensitivity as a Complexity Measure for Sequence Classification Tasks","created":"2021-04-21","cited_by_count":28,"area":null},{"id":"2208.04924","title":"On the Activation Function Dependence of the Spectral Bias of Neural Networks","created":"2022-08-09","cited_by_count":28,"area":null},{"id":"2311.08819","title":"Frequency Domain-based Dataset Distillation","created":"2023-11-15","cited_by_count":28,"area":null},{"id":"2312.15995","title":"Generalization in Kernel Regression Under Realistic Assumptions","created":"2023-12-26","cited_by_count":27,"area":null},{"id":"2110.03922","title":"The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks","created":"2021-10-08","cited_by_count":26,"area":null},{"id":"2207.05952","title":"Implicit regularization of dropout","created":"2022-07-13","cited_by_count":25,"area":null},{"id":"2211.15188","title":"Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs","created":"2022-11-28","cited_by_count":25,"area":null},{"id":"2407.10005","title":"Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond","created":"2024-07-13","cited_by_count":24,"area":null},{"id":"2106.03243","title":"Neural Active Learning with Performance Guarantees","created":"2021-06-06","cited_by_count":22,"area":null},{"id":"2111.07167","title":"The Three Stages of Learning Dynamics in High-Dimensional Kernel Methods","created":"2021-11-13","cited_by_count":22,"area":null},{"id":"2104.03093","title":"Spectral Analysis of the Neural Tangent Kernel for Deep Residual Networks","created":"2021-04-07","cited_by_count":21,"area":null},{"id":"2206.10121","title":"Finite Expression Method for Solving High-Dimensional Partial Differential Equations","created":"2022-06-21","cited_by_count":21,"area":null},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2101.04844","title":"Reproducing Activation Function for Deep Learning","created":"2021-01-13","cited_by_count":19,"area":null},{"id":"2202.13473","title":"The Spectral Bias of Polynomial Neural Networks","created":"2022-02-27","cited_by_count":19,"area":null},{"id":"2206.04672","title":"Overcoming the Spectral Bias of Neural Value Approximation","created":"2022-06-09","cited_by_count":19,"area":null},{"id":"2510.22980","title":"How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data","created":"2025-10-27","cited_by_count":19,"area":null},{"id":"2301.05839","title":"NCP: Neural Correspondence Prior for Effective Unsupervised Shape Matching","created":"2023-01-14","cited_by_count":18,"area":null},{"id":"2312.01061","title":"Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction","created":"2023-12-02","cited_by_count":17,"area":null},{"id":"2410.02035","title":"Tuning Frequency Bias of State Space Models","created":"2024-10-02","cited_by_count":17,"area":null},{"id":"2306.09909","title":"Neural Volumetric Reconstruction for Coherent Synthetic Aperture Sonar","created":"2023-06-16","cited_by_count":16,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2103.11488","title":"The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation","created":"2021-03-21","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2407.13621","title":"Differential Privacy Mechanisms in Neural Tangent Kernel Regression","created":"2024-07-18","cited_by_count":14,"area":null},{"id":"2410.16105","title":"Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learning","created":"2024-10-21","cited_by_count":14,"area":null},{"id":"2111.02278","title":"Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks","created":"2021-11-03","cited_by_count":13,"area":null},{"id":"2210.01274","title":"Random Weight Factorization Improves the Training of Continuous Neural Representations","created":"2022-10-03","cited_by_count":13,"area":null},{"id":"2303.15484","title":"Regularize implicit neural representation by itself","created":"2023-03-27","cited_by_count":13,"area":null},{"id":"2402.05173","title":"Towards Understanding Inductive Bias in Transformers: A View From Infinity","created":"2024-02-07","cited_by_count":13,"area":null},{"id":"2405.14630","title":"Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension","created":"2024-05-23","cited_by_count":13,"area":null},{"id":"2406.06287","title":"VS-PINN: A fast and efficient training of physics-informed neural networks using variable-scaling methods for solving PDEs with stiff behavior","created":"2024-06-10","cited_by_count":13,"area":null},{"id":"2106.03186","title":"Reverse Engineering the Neural Tangent Kernel","created":"2021-06-06","cited_by_count":12,"area":null},{"id":"2210.00272","title":"FINDE: Neural Differential Equations for Finding and Preserving Invariant Quantities","created":"2022-10-01","cited_by_count":12,"area":null},{"id":"2402.10681","title":"Physics-informed MeshGraphNets (PI-MGNs): Neural finite element solvers for non-stationary and nonlinear simulations on arbitrary meshes","created":"2024-02-16","cited_by_count":12,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2401.08309","title":"Anchor function: a type of benchmark functions for studying language models","created":"2024-01-16","cited_by_count":11,"area":null},{"id":"2410.04779","title":"Fast Training of Sinusoidal Neural Fields via Scaling Initialization","created":"2024-10-07","cited_by_count":11,"area":null},{"id":"2103.11093","title":"Exploring The Effect of High-frequency Components in GANs Training","created":"2021-03-20","cited_by_count":10,"area":null},{"id":"2105.05553","title":"Principal Components Bias in Over-parameterized Linear Models, and its Manifestation in Deep Neural Networks","created":"2021-05-12","cited_by_count":10,"area":null},{"id":"2112.06660","title":"Subspace Decomposition based DNN algorithm for elliptic type multi-scale PDEs","created":"2021-12-10","cited_by_count":10,"area":null},{"id":"2402.05913","title":"Efficient Stagewise Pretraining via Progressive Subnetworks","created":"2024-02-08","cited_by_count":10,"area":null},{"id":"2201.04738","title":"Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks","created":"2022-01-12","cited_by_count":9,"area":null},{"id":"2306.09478","title":"Understanding and Mitigating Extrapolation Failures in Physics-Informed Neural Networks","created":"2023-06-15","cited_by_count":9,"area":null},{"id":"2307.14531","title":"Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum","created":"2023-07-26","cited_by_count":9,"area":null},{"id":"2401.02810","title":"Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning","created":"2024-01-05","cited_by_count":9,"area":null},{"id":"2501.01681","title":"SNeRV: Spectra-preserving Neural Representation for Video","created":"2025-01-03","cited_by_count":9,"area":null},{"id":"2504.13112","title":"Hadamard product in deep learning: Introduction, Advances and Challenges","created":"2025-04-17","cited_by_count":9,"area":null},{"id":"2410.06300","title":"SHAP values via sparse Fourier representation","created":"2024-10-08","cited_by_count":8,"area":null},{"id":"2209.07736","title":"Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study","created":"2022-09-16","cited_by_count":7,"area":null},{"id":"2303.02034","title":"Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies","created":"2023-03-03","cited_by_count":7,"area":null},{"id":"2406.09935","title":"Predicting the Susceptibility of Examples to Catastrophic Forgetting","created":"2024-06-14","cited_by_count":7,"area":null},{"id":"2409.03891","title":"Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality","created":"2024-09-05","cited_by_count":7,"area":null},{"id":"2206.14820","title":"Strong Lensing Source Reconstruction Using Continuous Neural Fields","created":"2022-06-29","cited_by_count":6,"area":null},{"id":"2208.09145","title":"Semi-analytic PINN methods for singularly perturbed boundary value problems","created":"2022-08-19","cited_by_count":6,"area":null},{"id":"2403.13134","title":"Robust NAS under adversarial training: benchmark, theory, and beyond","created":"2024-03-19","cited_by_count":6,"area":null},{"id":"2511.18777","title":"SAOT: An Enhanced Locality-Aware Spectral Transformer for Solving PDEs","created":"2025-11-24","cited_by_count":6,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2305.09145","title":"Deep ReLU Networks Have Surprisingly Simple Polytopes","created":"2023-05-16","cited_by_count":5,"area":null},{"id":"2404.12063","title":"FastVPINNs: Tensor-Driven Acceleration of VPINNs for Complex Geometries","created":"2024-04-18","cited_by_count":5,"area":null},{"id":"2405.20062","title":"Can the accuracy bias by facial hairstyle be reduced through balancing the training data?","created":"2024-05-30","cited_by_count":5,"area":null},{"id":"2503.03519","title":"Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization","created":"2025-03-05","cited_by_count":5,"area":null},{"id":"2506.22555","title":"Spectral Bias in Variational Quantum Machine Learning","created":"2025-06-27","cited_by_count":5,"area":null},{"id":"2508.03965","title":"BubbleOKAN: A Physics-Informed Interpretable Neural Operator for High-Frequency Bubble Dynamics","created":"2025-08-05","cited_by_count":5,"area":null},{"id":"2101.00747","title":"Frequency Principle in Deep Learning Beyond Gradient-descent-based Training","created":"2021-01-04","cited_by_count":4,"area":null},{"id":"2105.00507","title":"Universal scaling laws in the gradient descent training of neural networks","created":"2021-05-02","cited_by_count":4,"area":null},{"id":"2105.11675","title":"An Upper Limit of Decaying Rate with Respect to Frequency in Deep Neural Network","created":"2021-05-25","cited_by_count":4,"area":null},{"id":"2206.14862","title":"Momentum Diminishes the Effect of Spectral Bias in Physics-Informed Neural Networks","created":"2022-06-29","cited_by_count":4,"area":null},{"id":"2302.11883","title":"PIFON-EPT: MR-Based Electrical Property Tomography Using Physics-Informed Fourier Networks","created":"2023-02-23","cited_by_count":4,"area":null},{"id":"2308.14370","title":"Model-based learning for location-to-channel mapping","created":"2023-08-28","cited_by_count":4,"area":null},{"id":"2311.06224","title":"Harnessing Synthetic Datasets: The Role of Shape Bias in Deep Neural Network Generalization","created":"2023-11-10","cited_by_count":4,"area":null},{"id":"2312.02239","title":"Model-based Deep Learning for Beam Prediction based on a Channel Chart","created":"2023-12-04","cited_by_count":4,"area":null},{"id":"2405.14957","title":"Understanding the dynamics of the frequency bias in neural networks","created":"2024-05-23","cited_by_count":4,"area":null},{"id":"2407.13841","title":"Many Perception Tasks are Highly Redundant Functions of their Input Data","created":"2024-07-18","cited_by_count":4,"area":null},{"id":"2503.11029","title":"Neural Tangent Kernel of Neural Networks with Loss Informed by Differential Operators","created":"2025-03-14","cited_by_count":4,"area":null},{"id":"2511.18278","title":"From Tables to Signals: Revealing Spectral Adaptivity in TabPFN","created":"2025-11-23","cited_by_count":4,"area":null},{"id":"2603.24654","title":"Spectral methods: crucial for machine learning, natural for quantum computers?","created":"2026-03-25","cited_by_count":4,"area":null},{"id":"2111.03972","title":"Understanding Layer-wise Contributions in Deep Neural Networks through Spectral Analysis","created":"2021-11-06","cited_by_count":3,"area":null},{"id":"2301.05816","title":"Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics","created":"2023-01-14","cited_by_count":3,"area":null},{"id":"2310.05105","title":"How Graph Neural Networks Learn: Lessons from Training Dynamics","created":"2023-10-08","cited_by_count":3,"area":null},{"id":"2402.00332","title":"Comparing Spectral Bias and Robustness For Two-Layer Neural Networks: SGD vs Adaptive Random Fourier Features","created":"2024-02-01","cited_by_count":3,"area":null},{"id":"2405.17479","title":"A rationale from frequency perspective for grokking in training neural network","created":"2024-05-24","cited_by_count":3,"area":null},{"id":"2406.17467","title":"Early learning of the optimal constant solution in neural networks and humans","created":"2024-06-25","cited_by_count":3,"area":null},{"id":"2407.07719","title":"Model-based learning for multi-antenna multi-frequency location-to-channel mapping","created":"2024-06-17","cited_by_count":3,"area":null}],"next_cursor":"100"}