{"list":"other","total":71,"rows":[{"id":"2103.00020","title":"Learning Transferable Visual Models From Natural Language Supervision","created":"2021-02-26","cited_by_count":33744},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"1710.09412","title":"mixup: Beyond Empirical Risk Minimization","created":"2017-10-25","cited_by_count":5183},{"id":"1608.03983","title":"SGDR: Stochastic Gradient Descent with Warm Restarts","created":"2016-08-13","cited_by_count":5045},{"id":"1606.08415","title":"Gaussian Error Linear Units (GELUs)","created":"2016-06-27","cited_by_count":3502},{"id":"1505.07818","title":"Domain-Adversarial Training of Neural Networks","created":"2015-05-28","cited_by_count":3044},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"2004.07780","title":"Shortcut Learning in Deep Neural Networks","created":"2020-04-16","cited_by_count":1969},{"id":"1907.02893","title":"Invariant Risk Minimization","created":"2019-07-05","cited_by_count":1854},{"id":"2006.16241","title":"The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization","created":"2020-06-29","cited_by_count":1850},{"id":"1606.06565","title":"Concrete Problems in AI Safety","created":"2016-06-21","cited_by_count":1642},{"id":"1902.10811","title":"Do ImageNet Classifiers Generalize to ImageNet?","created":"2019-02-13","cited_by_count":1515},{"id":"1907.07174","title":"Natural Adversarial Examples","created":"2019-07-16","cited_by_count":1408},{"id":"1812.01754","title":"Moment Matching for Multi-Source Domain Adaptation","created":"2018-12-04","cited_by_count":1331},{"id":"1911.08731","title":"Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization","created":"2019-11-20","cited_by_count":1247},{"id":"1607.01719","title":"Deep CORAL: Correlation Alignment for Deep Domain Adaptation","created":"2016-07-06","cited_by_count":1200},{"id":"2007.01434","title":"In Search of Lost Domain Generalization","created":"2020-07-02","cited_by_count":1054},{"id":"1905.13549","title":"Learning Robust Global Representations by Penalizing Local Predictive Power","created":"2019-05-29","cited_by_count":1013},{"id":"1710.03077","title":"Deeper, Broader and Artier Domain Generalization","created":"2017-10-09","cited_by_count":986},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"1710.11063","title":"Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks","created":"2017-10-30","cited_by_count":939},{"id":"2109.01903","title":"Robust fine-tuning of zero-shot models","created":"2021-09-04","cited_by_count":797},{"id":"1710.03463","title":"Learning to Generalize: Meta-Learning for Domain Generalization","created":"2017-10-10","cited_by_count":763},{"id":"1910.10699","title":"Contrastive Representation Distillation","created":"2019-10-23","cited_by_count":748},{"id":"2003.00688","title":"Out-of-Distribution Generalization via Risk Extrapolation (REx)","created":"2020-03-02","cited_by_count":742},{"id":"2202.10054","title":"Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution","created":"2022-02-21","cited_by_count":739},{"id":"2311.03658","title":"The Linear Representation Hypothesis and the Geometry of Large Language Models","created":"2023-11-07","cited_by_count":716},{"id":"2310.06824","title":"The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets","created":"2023-10-10","cited_by_count":712},{"id":"2007.00644","title":"Measuring Robustness to Natural Distribution Shifts in Image Classification","created":"2020-07-01","cited_by_count":454},{"id":"2007.02454","title":"Self-Challenging Improves Cross-Domain Generalization","created":"2020-07-05","cited_by_count":426},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"1906.04584","title":"Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers","created":"2019-06-09","cited_by_count":330},{"id":"2310.02207","title":"Language Models Represent Space and Time","created":"2023-10-03","cited_by_count":316},{"id":"2005.04345","title":"An Investigation of Why Overparameterization Exacerbates Spurious Correlations","created":"2020-05-09","cited_by_count":310},{"id":"2012.09816","title":"Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning","created":"2020-12-17","cited_by_count":297},{"id":"2309.14316","title":"Physics of Language Models: Part 3.1, Knowledge Storage and Extraction","created":"2023-09-25","cited_by_count":270},{"id":"2011.09468","title":"Gradient Starvation: A Learning Proclivity in Neural Networks","created":"2020-11-18","cited_by_count":267},{"id":"2010.05761","title":"The Risks of Invariant Risk Minimization","created":"2020-10-12","cited_by_count":262},{"id":"2104.09937","title":"Gradient Matching for Domain Generalization","created":"2021-04-20","cited_by_count":258},{"id":"2107.04649","title":"Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization","created":"2021-07-09","cited_by_count":249},{"id":"1808.08750","title":"Generalisation in humans and deep neural networks","created":"2018-08-27","cited_by_count":237},{"id":"2009.11848","title":"How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks","created":"2020-09-24","cited_by_count":222},{"id":"2106.06607","title":"Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization","created":"2021-06-11","cited_by_count":220},{"id":"2210.11466","title":"Surgical Fine-Tuning Improves Adaptation to Distribution Shifts","created":"2022-10-20","cited_by_count":205},{"id":"2304.03439","title":"Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4","created":"2023-04-07","cited_by_count":202},{"id":"2010.07922","title":"Representation Learning via Invariant Causal Mechanisms","created":"2020-10-15","cited_by_count":199},{"id":"2310.05916","title":"Interpreting CLIP's Image Representation via Text-Based Decomposition","created":"2023-10-09","cited_by_count":196},{"id":"2104.09841","title":"SelfReg: Self-supervised Contrastive Regularization for Domain Generalization","created":"2021-04-20","cited_by_count":189},{"id":"2006.11650","title":"On the Theory of Transfer Learning: The Importance of Task Diversity","created":"2020-06-20","cited_by_count":186},{"id":"2007.02931","title":"Adaptive Risk Minimization: Learning to Adapt to Domain Shift","created":"2020-07-06","cited_by_count":183},{"id":"2110.11328","title":"A Fine-Grained Analysis on Distribution Shift","created":"2021-10-21","cited_by_count":171},{"id":"2010.15775","title":"Understanding the Failure Modes of Out-of-Distribution Generalization","created":"2020-10-29","cited_by_count":146},{"id":"2101.01134","title":"Does Invariant Risk Minimization Capture Invariance?","created":"2021-01-04","cited_by_count":116},{"id":"2201.08371","title":"Revisiting Weakly Supervised Pre-Training of Visual Perception Models","created":"2022-01-20","cited_by_count":116},{"id":"2005.10190","title":"Feature Purification: How Adversarial Training Performs Robust Deep Learning","created":"2020-05-20","cited_by_count":107},{"id":"1803.06959","title":"On the importance of single directions for generalization","created":"2018-03-19","cited_by_count":99},{"id":"2312.16337","title":"Task Contamination: Language Models May Not Be Few-Shot Anymore","created":"2023-12-26","cited_by_count":99},{"id":"2106.04496","title":"Towards a Theoretical Framework of Out-of-Distribution Generalization","created":"2021-06-08","cited_by_count":94},{"id":"2312.09230","title":"Successor Heads: Recurring, Interpretable Attention Heads In The Wild","created":"2023-12-14","cited_by_count":77},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73},{"id":"2202.06856","title":"Domain-Adjusted Regression or: ERM May Already Learn Features Sufficient for Out-of-Distribution Generalization","created":"2022-02-14","cited_by_count":69},{"id":"2204.00570","title":"Connect, Not Collapse: Explaining Contrastive Learning for Unsupervised Domain Adaptation","created":"2022-04-01","cited_by_count":67},{"id":"2010.16412","title":"Empirical or Invariant Risk Minimization? A Sample Complexity Perspective","created":"2020-10-30","cited_by_count":62},{"id":"2204.02683","title":"Beyond Separability: Analyzing the Linear Transferability of Contrastive Representations to Related Subpopulations","created":"2022-04-06","cited_by_count":44},{"id":"2304.11327","title":"Understanding and Improving Feature Learning for Out-of-Distribution Generalization","created":"2023-04-22","cited_by_count":35},{"id":"2310.09562","title":"Does CLIP's Generalization Performance Mainly Stem from High Train-Test Similarity?","created":"2023-10-14","cited_by_count":35},{"id":"2201.12919","title":"Provable Domain Generalization via Invariant-Feature Subspace Recovery","created":"2022-01-30","cited_by_count":32},{"id":"2106.09913","title":"Iterative Feature Matching: Toward Provable Domain Generalization with Logarithmic Environments","created":"2021-06-18","cited_by_count":30},{"id":"2403.10381","title":"Monotonic Representation of Numeric Properties in Language Models","created":"2024-03-15","cited_by_count":15},{"id":"2212.07346","title":"Learning useful representations for shifting tasks and distributions","created":"2022-12-14","cited_by_count":14}],"next_cursor":null}