{"list":"other","total":85,"rows":[{"id":"1708.07747","title":"Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms","created":"2017-08-25","cited_by_count":4349},{"id":"1606.08415","title":"Gaussian Error Linear Units (GELUs)","created":"2016-06-27","cited_by_count":3502},{"id":"2006.09661","title":"Implicit Neural Representations with Periodic Activation Functions","created":"2020-06-17","cited_by_count":2238},{"id":"2004.07780","title":"Shortcut Learning in Deep Neural Networks","created":"2020-04-16","cited_by_count":1969},{"id":"1806.08734","title":"On the Spectral Bias of Neural Networks","created":"2018-06-22","cited_by_count":1341},{"id":"1712.09913","title":"Visualizing the Loss Landscape of Neural Nets","created":"2017-12-28","cited_by_count":1130},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"2404.19756","title":"KAN: Kolmogorov-Arnold Networks","created":"2024-04-30","cited_by_count":649},{"id":"2309.00770","title":"Bias and Fairness in Large Language Models: A Survey","created":"2023-09-02","cited_by_count":639},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629},{"id":"2111.11426","title":"Neural Fields in Visual Computing and Beyond","created":"2021-11-22","cited_by_count":540},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"1901.06523","title":"Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks","created":"2019-01-19","cited_by_count":368},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"2310.03716","title":"A Long Way to Go: Investigating Length Correlations in RLHF","created":"2023-10-05","cited_by_count":291},{"id":"2011.15091","title":"Inductive Biases for Deep Learning of Higher-Level Cognition","created":"2020-11-30","cited_by_count":275},{"id":"2011.09468","title":"Gradient Starvation: A Learning Proclivity in Neural Networks","created":"2020-11-18","cited_by_count":267},{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230},{"id":"2305.02997","title":"When Do Neural Nets Outperform Boosted Trees on Tabular Data?","created":"2023-05-04","cited_by_count":223},{"id":"2301.05187","title":"WIRE: Wavelet Implicit Neural Representations","created":"2023-01-05","cited_by_count":220},{"id":"1905.11604","title":"SGD on Neural Networks Learns Functions of Increasing Complexity","created":"2019-05-28","cited_by_count":204},{"id":"2310.16028","title":"What Algorithms can Transformers Learn? A Study in Length Generalization","created":"2023-10-24","cited_by_count":199},{"id":"2203.05556","title":"On Embeddings for Numerical Features in Tabular Deep Learning","created":"2022-03-10","cited_by_count":186},{"id":"1805.08522","title":"Deep learning generalizes because the parameter-function map is biased towards simple functions","created":"2018-05-22","cited_by_count":183},{"id":"1807.01251","title":"Training behavior of deep neural network in frequency domain","created":"2018-07-03","cited_by_count":174},{"id":"1710.05941","title":"Searching for Activation Functions","created":"2017-10-16","cited_by_count":169},{"id":"2109.14545","title":"Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark","created":"2021-09-29","cited_by_count":155},{"id":"2403.03950","title":"Stop Regressing: Training Value Functions via Classification for Scalable Deep RL","created":"2024-03-06","cited_by_count":144},{"id":"2301.08727","title":"Neural Architecture Search: Insights from 1000 Papers","created":"2023-01-20","cited_by_count":139},{"id":"2006.07322","title":"Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks","created":"2020-06-12","cited_by_count":138},{"id":"2111.15135","title":"Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs","created":"2021-11-30","cited_by_count":135},{"id":"2006.12433","title":"What shapes feature representations? Exploring datasets, architectures, and training","created":"2020-06-22","cited_by_count":126},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108},{"id":"1608.08225","title":"Why does deep and cheap learning work so well?","created":"2016-08-29","cited_by_count":100},{"id":"1710.10686","title":"Regularization for Deep Learning: A Taxonomy","created":"2017-10-29","cited_by_count":91},{"id":"2005.00817","title":"A survey on modern trainable activation functions","created":"2020-05-02","cited_by_count":89},{"id":"2105.05612","title":"Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization","created":"2021-05-12","cited_by_count":83},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83},{"id":"2301.02679","title":"Grokking modular arithmetic","created":"2023-01-06","cited_by_count":83},{"id":"2007.11207","title":"Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains","created":"2020-07-22","cited_by_count":79},{"id":"2211.12316","title":"Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions","created":"2022-11-22","cited_by_count":70},{"id":"2201.07395","title":"Overview frequency principle/spectral bias in deep learning","created":"2022-01-19","cited_by_count":69},{"id":"2105.05246","title":"Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspective","created":"2021-05-11","cited_by_count":65},{"id":"2304.05366","title":"The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning","created":"2023-04-11","cited_by_count":63},{"id":"2110.03095","title":"Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective","created":"2021-10-06","cited_by_count":57},{"id":"1605.06743","title":"Inductive Bias of Deep Convolutional Networks through Pooling Geometry","created":"2016-05-22","cited_by_count":53},{"id":"2006.15191","title":"Is SGD a Bayesian sampler? Well, almost","created":"2020-06-26","cited_by_count":50},{"id":"2209.00613","title":"ID and OOD Performance Are Sometimes Inversely Correlated on Real-world Datasets","created":"2022-09-01","cited_by_count":44},{"id":"2012.07969","title":"A case for new neural network smoothness constraints","created":"2020-12-14","cited_by_count":43},{"id":"2403.02241","title":"Neural Redshift: Random Networks are not Random Functions","created":"2024-03-04","cited_by_count":43},{"id":"2209.13083","title":"Why neural networks find simple solutions: the many regularizers of geometric complexity","created":"2022-09-27","cited_by_count":39},{"id":"2110.02424","title":"Spectral Bias in Practice: The Role of Function Frequency in Generalization","created":"2021-10-06","cited_by_count":37},{"id":"2401.07402","title":"Improved Implicit Neural Representation with Fourier Reparameterized Training","created":"2024-01-15","cited_by_count":36},{"id":"2308.12553","title":"Don't blame Dataset Shift! Shortcut Learning due to Gradients and Cross Entropy","created":"2023-08-24","cited_by_count":30},{"id":"2209.02681","title":"How important are activation functions in regression and classification? A survey, performance comparison, and future directions","created":"2022-09-06","cited_by_count":29},{"id":"2211.05641","title":"Regression as Classification: Influence of Task Formulation on Neural Network Features","created":"2022-11-10","cited_by_count":29},{"id":"2104.10343","title":"Sensitivity as a Complexity Measure for Sequence Classification Tasks","created":"2021-04-21","cited_by_count":28},{"id":"2207.02598","title":"Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning","created":"2022-07-06","cited_by_count":26},{"id":"1909.11522","title":"Neural networks are a priori biased towards Boolean functions with low entropy","created":"2019-09-25","cited_by_count":24},{"id":"2210.16222","title":"Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions","created":"2022-10-28","cited_by_count":24},{"id":"2206.04672","title":"Overcoming the Spectral Bias of Neural Value Approximation","created":"2022-06-09","cited_by_count":19},{"id":"1803.07739","title":"Assessing Shape Bias Property of Convolutional Neural Networks","created":"2018-03-21","cited_by_count":18},{"id":"1809.06848","title":"On the Learning Dynamics of Deep Neural Networks","created":"2018-09-18","cited_by_count":18},{"id":"2002.07224","title":"Evolutionary Optimization of Deep Learning Activation Functions","created":"2020-02-17","cited_by_count":18},{"id":"2112.03257","title":"Functional Regularization for Reinforcement Learning via Learned Fourier Features","created":"2021-12-06","cited_by_count":17},{"id":"2410.04368","title":"Algorithmic Capabilities of Random Transformers","created":"2024-10-06","cited_by_count":17},{"id":"2108.03214","title":"Simple Modifications to Improve Tabular Neural Networks","created":"2021-08-06","cited_by_count":14},{"id":"1605.05509","title":"Learning activation functions from data using cubic spline interpolation","created":"2016-05-18","cited_by_count":13},{"id":"1806.10064","title":"Adaptive Blending Units: Trainable Activation Functions for Deep Neural Networks","created":"2018-06-26","cited_by_count":13},{"id":"2212.06641","title":"Simplicity Bias Leads to Amplified Performance Disparities","created":"2022-12-13","cited_by_count":11},{"id":"2402.13425","title":"Investigating the Histogram Loss in Regression","created":"2024-02-20","cited_by_count":11},{"id":"2405.17299","title":"Simplicity Bias of Two-Layer Networks beyond Linearly Separable Data","created":"2024-05-27","cited_by_count":11},{"id":"1902.03306","title":"A simple and efficient architecture for trainable activation functions","created":"2019-02-08","cited_by_count":10},{"id":"2405.18296","title":"Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training","created":"2024-05-28","cited_by_count":8},{"id":"2407.07564","title":"Trainable Highly-expressive Activation Functions","created":"2024-07-10","cited_by_count":6},{"id":"2407.08567","title":"Adaptive Parametric Activation: Unifying and Generalising Activation Functions Across Tasks","created":"2024-07-11","cited_by_count":6},{"id":"2407.06756","title":"Frequency and Generalisation of Periodic Activation Functions in Reinforcement Learning","created":"2024-07-09","cited_by_count":4},{"id":"2012.09318","title":"Applying Deutsch's concept of good explanations to artificial intelligence and neuroscience -- an initial exploration","created":"2020-12-16","cited_by_count":3},{"id":"2403.00963","title":"Tree-Regularized Tabular Embeddings","created":"2024-03-01","cited_by_count":3},{"id":"2405.17479","title":"A rationale from frequency perspective for grokking in training neural network","created":"2024-05-24","cited_by_count":3},{"id":"2406.15109","title":"Brain-Like Language Processing via a Shallow Untrained Multihead Attention Network","created":"2024-06-21","cited_by_count":3},{"id":"2410.03140","title":"In-context Learning in Presence of Spurious Correlations","created":"2024-10-04","cited_by_count":3},{"id":"2410.02735","title":"OOD-Chameleon: Is Algorithm Selection for OOD Generalization Learnable?","created":"2024-10-03","cited_by_count":2}],"next_cursor":null}