{"list":"other","total":67,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"1706.06083","title":"Towards Deep Learning Models Resistant to Adversarial Attacks","created":"2017-06-19","cited_by_count":6415},{"id":"1910.01108","title":"DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter","created":"2019-10-02","cited_by_count":4307},{"id":"2012.07805","title":"Extracting Training Data from Large Language Models","created":"2020-12-14","cited_by_count":2189},{"id":"2002.08909","title":"REALM: Retrieval-Augmented Language Model Pre-Training","created":"2020-02-10","cited_by_count":2141},{"id":"1905.02244","title":"Searching for MobileNetV3","created":"2019-05-06","cited_by_count":1994},{"id":"1603.05027","title":"Identity Mappings in Deep Residual Networks","created":"2016-03-16","cited_by_count":1965},{"id":"1909.01066","title":"Language Models as Knowledge Bases?","created":"2019-09-03","cited_by_count":1936},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1902.02918","title":"Certified Adversarial Robustness via Randomized Smoothing","created":"2019-02-08","cited_by_count":1340},{"id":"2112.04426","title":"Improving language models by retrieving from trillions of tokens","created":"2021-12-08","cited_by_count":1293},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"1911.00172","title":"Generalization through Memorization: Nearest Neighbor Language Models","created":"2019-11-01","cited_by_count":800},{"id":"2202.07646","title":"Quantifying Memorization Across Neural Language Models","created":"2022-02-15","cited_by_count":763},{"id":"2002.08910","title":"How Much Knowledge Can You Pack Into the Parameters of a Language Model?","created":"2020-02-10","cited_by_count":719},{"id":"1706.08498","title":"Spectrally-normalized margin bounds for neural networks","created":"2017-06-26","cited_by_count":686},{"id":"1511.04508","title":"Distillation as a Defense to Adversarial Perturbations against Deep Neural Networks","created":"2015-11-14","cited_by_count":678},{"id":"1812.05159","title":"An Empirical Study of Example Forgetting during Deep Neural Network Learning","created":"2018-12-12","cited_by_count":678},{"id":"1904.02868","title":"Data Shapley: Equitable Valuation of Data for Machine Learning","created":"2019-04-05","cited_by_count":629},{"id":"2002.08484","title":"Estimating Training Data Influence by Tracing Gradient Descent","created":"2020-02-19","cited_by_count":580},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1703.11008","title":"Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data","created":"2017-03-31","cited_by_count":533},{"id":"2107.07075","title":"Deep Learning on a Data Diet: Finding Important Examples Early in Training","created":"2021-07-15","cited_by_count":533},{"id":"2008.03703","title":"What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation","created":"2020-08-09","cited_by_count":497},{"id":"1906.05271","title":"Does Learning Require Memorization? A Short Tale about a Long Tail","created":"2019-06-12","cited_by_count":460},{"id":"1910.01348","title":"On the Efficacy of Knowledge Distillation","created":"2019-10-03","cited_by_count":381},{"id":"2005.04345","title":"An Investigation of Why Overparameterization Exacerbates Spurious Correlations","created":"2020-05-09","cited_by_count":310},{"id":"2106.05237","title":"Knowledge distillation: A good teacher is patient and consistent","created":"2021-06-09","cited_by_count":259},{"id":"2110.12088","title":"Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations","created":"2021-10-22","cited_by_count":256},{"id":"2206.07137","title":"Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt","created":"2022-06-14","cited_by_count":236},{"id":"2003.02819","title":"Does label smoothing mitigate label noise?","created":"2020-03-05","cited_by_count":204},{"id":"1808.00387","title":"Just Interpolate: Kernel \"Ridgeless\" Regression Can Generalize","created":"2018-08-01","cited_by_count":190},{"id":"1911.05248","title":"What Do Compressed Deep Neural Networks Forget?","created":"2019-11-13","cited_by_count":171},{"id":"2112.12938","title":"Counterfactual Memorization in Neural Language Models","created":"2021-12-24","cited_by_count":156},{"id":"2304.11158","title":"Emergent and Predictable Memorization in Large Language Models","created":"2023-04-21","cited_by_count":148},{"id":"2106.09647","title":"Deep Learning Through the Lens of Example Difficulty","created":"2021-06-17","cited_by_count":141},{"id":"1907.05242","title":"Large Memory Layers with Product Keys","created":"2019-07-10","cited_by_count":124},{"id":"1911.02727","title":"Understanding Knowledge Distillation in Non-autoregressive Machine Translation","created":"2019-11-07","cited_by_count":122},{"id":"2012.06421","title":"When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning?","created":"2020-12-11","cited_by_count":104},{"id":"1806.05161","title":"Overfitting or perfect fitting? Risk bounds for classification and regression rules that interpolate","created":"2018-06-13","cited_by_count":99},{"id":"2002.03206","title":"Characterizing Structural Regularities of Labeled Data in Overparameterized Models","created":"2020-02-08","cited_by_count":93},{"id":"2007.12826","title":"The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Training","created":"2020-07-25","cited_by_count":84},{"id":"1710.10174","title":"SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Data","created":"2017-10-27","cited_by_count":79},{"id":"2105.14602","title":"On the geometry of generalization and memorization in deep neural networks","created":"2021-05-30","cited_by_count":73},{"id":"2307.09542","title":"Can Neural Network Memorization Be Localized?","created":"2023-07-18","cited_by_count":69},{"id":"1909.12362","title":"Overparameterized Neural Networks Implement Associative Memory","created":"2019-09-26","cited_by_count":45},{"id":"2106.10865","title":"Benign Overfitting in Multiclass Classification: All Roads Lead to Interpolation","created":"2021-06-21","cited_by_count":42},{"id":"2202.00155","title":"Fortuitous Forgetting in Connectionist Networks","created":"2022-02-01","cited_by_count":39},{"id":"2210.15031","title":"Characterizing Datapoints via Second-Split Forgetting","created":"2022-10-26","cited_by_count":37},{"id":"2301.00930","title":"Data Valuation Without Training of a Model","created":"2023-01-03","cited_by_count":35},{"id":"2209.05310","title":"On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models","created":"2022-09-12","cited_by_count":34},{"id":"1902.04698","title":"Identity Crisis: Memorization and Generalization under Extreme Overparameterization","created":"2019-02-13","cited_by_count":33},{"id":"2106.10494","title":"Teacher's pet: understanding and mitigating biases in distillation","created":"2021-06-19","cited_by_count":21},{"id":"2203.12171","title":"An Empirical Study of Memorization in NLP","created":"2022-03-23","cited_by_count":21},{"id":"2008.13363","title":"Extreme Memorization via Scale of Initialization","created":"2020-08-31","cited_by_count":18},{"id":"2106.03062","title":"On Training Sample Memorization: Lessons from Benchmarking Generative Modeling with a Large-scale Competition","created":"2021-06-06","cited_by_count":18},{"id":"2006.02855","title":"Network size and weights size for memorization with two-layers neural networks","created":"2020-06-04","cited_by_count":17},{"id":"2202.09889","title":"Memorize to Generalize: on the Necessity of Interpolation in High Dimensional Linear Regression","created":"2022-02-20","cited_by_count":14},{"id":"2302.01576","title":"ResMem: Learn what you can and memorize the rest","created":"2023-02-03","cited_by_count":13},{"id":"1911.09537","title":"Neural Network Memorization Dissection","created":"2019-11-21","cited_by_count":7},{"id":"2206.07892","title":"Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence","created":"2022-06-16","cited_by_count":6},{"id":"2211.07625","title":"What Images are More Memorable to Machines?","created":"2022-11-14","cited_by_count":5},{"id":"2204.00270","title":"Rethinking Position Bias Modeling with Knowledge Distillation for CTR Prediction","created":"2022-04-01","cited_by_count":2},{"id":"2306.06238","title":"Understanding the Effect of the Long Tail on Neural Network Compression","created":"2023-06-09","cited_by_count":2}],"next_cursor":null}