{"list":"other","total":96,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"1801.01290","title":"Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor","created":"2018-01-04","cited_by_count":4885},{"id":"1612.00796","title":"Overcoming catastrophic forgetting in neural networks","created":"2016-12-02","cited_by_count":4787},{"id":"2006.07733","title":"Bootstrap your own latent: A new approach to self-supervised Learning","created":"2020-06-13","cited_by_count":4750},{"id":"1508.07909","title":"Neural Machine Translation of Rare Words with Subword Units","created":"2015-08-31","cited_by_count":2918},{"id":"1904.09751","title":"The Curious Case of Neural Text Degeneration","created":"2019-04-22","cited_by_count":2916},{"id":"2303.04137","title":"Diffusion Policy: Visuomotor Policy Learning via Action Diffusion","created":"2023-03-07","cited_by_count":2838},{"id":"2304.01373","title":"Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling","created":"2023-04-03","cited_by_count":1786},{"id":"1706.02677","title":"Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour","created":"2017-06-08","cited_by_count":1492},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1812.02900","title":"Off-Policy Deep Reinforcement Learning without Exploration","created":"2018-12-07","cited_by_count":1241},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"1712.09913","title":"Visualizing the Loss Landscape of Neural Nets","created":"2017-12-28","cited_by_count":1130},{"id":"1906.00949","title":"Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reduction","created":"2019-06-03","cited_by_count":840},{"id":"1709.06560","title":"Deep Reinforcement Learning that Matters","created":"2017-09-19","cited_by_count":754},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"2106.02039","title":"Offline Reinforcement Learning as One Big Sequence Modeling Problem","created":"2021-06-03","cited_by_count":644},{"id":"1912.05671","title":"Linear Mode Connectivity and the Lottery Ticket Hypothesis","created":"2019-12-11","cited_by_count":637},{"id":"1509.01240","title":"Train faster, generalize better: Stability of stochastic gradient descent","created":"2015-09-03","cited_by_count":552},{"id":"1710.02410","title":"End-to-end Driving via Conditional Imitation Learning","created":"2017-10-06","cited_by_count":485},{"id":"2109.00137","title":"Implicit Behavioral Cloning","created":"2021-09-01","cited_by_count":452},{"id":"2305.07759","title":"TinyStories: How Small Can Language Models Be and Still Speak Coherent English?","created":"2023-05-12","cited_by_count":449},{"id":"1711.00489","title":"Don't Decay the Learning Rate, Increase the Batch Size","created":"2017-11-01","cited_by_count":320},{"id":"2206.11251","title":"Behavior Transformers: Cloning $k$ modes with one stone","created":"2022-06-22","cited_by_count":304},{"id":"1704.04289","title":"Stochastic Gradient Descent as Approximate Bayesian Inference","created":"2017-04-13","cited_by_count":300},{"id":"1610.09512","title":"Contextual Decision Processes with Low Bellman Rank are PAC-Learnable","created":"2016-10-29","cited_by_count":292},{"id":"1703.00887","title":"How to Escape Saddle Points Efficiently","created":"2017-03-02","cited_by_count":285},{"id":"1709.06009","title":"Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents","created":"2017-09-18","cited_by_count":269},{"id":"1801.05039","title":"Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulator","created":"2018-01-15","cited_by_count":250},{"id":"2102.00815","title":"Bellman Eluder Dimension: New Rich Classes of RL Problems, and Sample-Efficient Algorithms","created":"2021-02-01","cited_by_count":223},{"id":"2112.13487","title":"The Statistical Complexity of Interactive Decision Making","created":"2021-12-27","cited_by_count":218},{"id":"1703.09327","title":"DART: Noise Injection for Robust Imitation Learning","created":"2017-03-27","cited_by_count":191},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187},{"id":"2112.10751","title":"RvS: What is Essential for Offline RL via Supervised Learning?","created":"2021-12-20","cited_by_count":185},{"id":"2103.10897","title":"Bilinear Classes: A Structural Framework for Provable Generalization in RL","created":"2021-03-19","cited_by_count":178},{"id":"1804.06893","title":"A Study on Overfitting in Deep Reinforcement Learning","created":"2018-04-18","cited_by_count":174},{"id":"1907.04595","title":"Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks","created":"2019-07-10","cited_by_count":162},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161},{"id":"1802.08334","title":"Learning Without Mixing: Towards A Sharp Analysis of Linear System Identification","created":"2018-02-22","cited_by_count":158},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144},{"id":"1705.09886","title":"Convergence Analysis of Two-layer Neural Networks with ReLU Activation","created":"2017-05-28","cited_by_count":137},{"id":"2010.11895","title":"What are the Statistical Limits of Offline RL with Linear Function Approximation?","created":"2020-10-22","cited_by_count":136},{"id":"1810.12282","title":"Assessing Generalization in Deep Reinforcement Learning","created":"2018-10-29","cited_by_count":133},{"id":"2007.01547","title":"Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers","created":"2020-07-03","cited_by_count":119},{"id":"2001.09576","title":"Naive Exploration is Optimal for Online LQR","created":"2020-01-27","cited_by_count":116},{"id":"1811.01558","title":"Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations","created":"2018-11-05","cited_by_count":114},{"id":"2204.01171","title":"Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation","created":"2022-04-03","cited_by_count":108},{"id":"2205.10287","title":"On the SDEs and Scaling Rules for Adaptive Gradient Algorithms","created":"2022-05-20","cited_by_count":104},{"id":"1812.05217","title":"Tight Analyses for Non-Smooth Stochastic Gradient Descent","created":"2018-12-13","cited_by_count":97},{"id":"2012.04728","title":"Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics","created":"2020-12-08","cited_by_count":96},{"id":"1902.08721","title":"Online Control with Adversarial Disturbances","created":"2019-02-23","cited_by_count":92},{"id":"2106.16163","title":"The MultiBERTs: BERT Reproductions for Robustness Analysis","created":"2021-06-30","cited_by_count":92},{"id":"1902.00744","title":"Asymmetric Valleys: Beyond Sharp and Flat Local Minima","created":"2019-02-02","cited_by_count":90},{"id":"2006.12466","title":"Information Theoretic Regret Bounds for Online Nonlinear Control","created":"2020-06-22","cited_by_count":90},{"id":"1812.01251","title":"Near optimal finite time identification of arbitrary linear dynamical systems","created":"2018-12-04","cited_by_count":89},{"id":"2202.00817","title":"Do Differentiable Simulators Give Better Policy Gradients?","created":"2022-02-02","cited_by_count":89},{"id":"1805.09388","title":"Regret Bounds for Robust Adaptive Control of the Linear Quadratic Regulator","created":"2018-05-23","cited_by_count":86},{"id":"2001.09254","title":"Improper Learning for Non-Stochastic Control","created":"2020-01-25","cited_by_count":83},{"id":"2306.00946","title":"Exposing Attention Glitches with Flip-Flop Language Modeling","created":"2023-06-01","cited_by_count":75},{"id":"1806.04498","title":"The Unusual Effectiveness of Averaging in GAN Training","created":"2018-06-12","cited_by_count":73},{"id":"2111.10919","title":"Offline Reinforcement Learning: Fundamental Barriers for Value Function Approximation","created":"2021-11-21","cited_by_count":71},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68},{"id":"2010.02916","title":"Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate","created":"2020-10-06","cited_by_count":59},{"id":"1902.01240","title":"PIPPS: Flexible Model-Based Policy Search Robust to the Curse of Chaos","created":"2019-02-04","cited_by_count":56},{"id":"2012.08005","title":"Exponential Lower Bounds for Batch Reinforcement Learning: Batch RL can be Exponentially Harder than Online RL","created":"2020-12-14","cited_by_count":55},{"id":"2209.14981","title":"Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging","created":"2022-09-29","cited_by_count":54},{"id":"2306.11816","title":"Learning to Generate Better Than Your LLM","created":"2023-06-20","cited_by_count":49},{"id":"1812.04529","title":"On the Ineffectiveness of Variance Reduced Optimization for Deep Learning","created":"2018-12-11","cited_by_count":48},{"id":"2007.06650","title":"Black-Box Control for Linear Dynamical Systems","created":"2020-07-13","cited_by_count":43},{"id":"2002.11803","title":"Disentangling Adaptive Gradient Methods from Learning Rates","created":"2020-02-26","cited_by_count":42},{"id":"2307.06440","title":"No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models","created":"2023-07-12","cited_by_count":41},{"id":"2011.06719","title":"Grasping with Chopsticks: Combating Covariate Shift in Model-free Imitation Learning for Fine Manipulation","created":"2020-11-13","cited_by_count":38},{"id":"2102.09161","title":"On the Sample Complexity of Stability Constrained Imitation Learning","created":"2021-02-18","cited_by_count":38},{"id":"2103.04947","title":"Instabilities of Offline RL with Pre-Trained Neural Representation","created":"2021-03-08","cited_by_count":38},{"id":"2306.03241","title":"Early Weight Averaging meets High Learning Rates for LLM Pre-training","created":"2023-06-05","cited_by_count":37},{"id":"1906.05664","title":"Calibration, Entropy Rates, and Memory in Language Models","created":"2019-06-11","cited_by_count":32},{"id":"2108.04190","title":"On the Power of Differentiable Learning versus PAC and SQ Learning","created":"2021-08-09","cited_by_count":28},{"id":"2011.07931","title":"Do Offline Metrics Predict Online Performance in Recommender Systems?","created":"2020-11-07","cited_by_count":25},{"id":"2110.06418","title":"Stabilizing Dynamical Systems via Policy Gradient Methods","created":"2021-10-13","cited_by_count":25},{"id":"2205.13026","title":"Preference Dynamics Under Personalized Recommendations","created":"2022-05-25","cited_by_count":25},{"id":"2006.05910","title":"Making Non-Stochastic Control (Almost) as Easy as Stochastic","created":"2020-06-10","cited_by_count":24},{"id":"2307.13813","title":"How to Scale Your EMA","created":"2023-07-25","cited_by_count":24},{"id":"2001.02992","title":"Poly-time universality and limitations of deep learning","created":"2020-01-07","cited_by_count":23},{"id":"2205.14812","title":"TaSIL: Taylor Series Imitation Learning","created":"2022-05-30","cited_by_count":21},{"id":"2301.02312","title":"Training trajectories, mini-batch losses and the curious role of the learning rate","created":"2023-01-05","cited_by_count":21},{"id":"2211.09619","title":"Introduction to Online Control","created":"2022-11-17","cited_by_count":19},{"id":"2002.02064","title":"No-Regret Prediction in Marginally Stable Systems","created":"2020-02-06","cited_by_count":18},{"id":"1911.07626","title":"Convex Formulation of Overparameterized Deep Neural Networks","created":"2019-11-18","cited_by_count":16},{"id":"2208.02789","title":"Feature selection with gradient descent on two-layer networks in low-rotation regimes","created":"2022-08-04","cited_by_count":14},{"id":"2103.12945","title":"On Imitation Learning of Linear Control Policies: Enforcing Stability and Robustness Constraints via LMI Conditions","created":"2021-03-24","cited_by_count":10},{"id":"2205.13056","title":"Efficient and Near-Optimal Smoothed Online Learning for Generalized Linear Functions","created":"2022-05-25","cited_by_count":10},{"id":"2301.11187","title":"Smoothed Online Learning for Prediction in Piecewise Affine Systems","created":"2023-01-26","cited_by_count":9},{"id":"2302.05430","title":"Oracle-Efficient Smoothed Online Learning for Piecewise Continuous Decision Making","created":"2023-02-10","cited_by_count":5},{"id":"2103.15010","title":"On the Stability of Nonlinear Receding Horizon Control: A Geometric Perspective","created":"2021-03-27","cited_by_count":4},{"id":"2305.09619","title":"The Power of Learned Locally Linear Models for Nonlinear Policy Optimization","created":"2023-05-16","cited_by_count":3}],"next_cursor":null}