{"total":323,"rows":[{"id":"2108.13624","title":"Towards Out-Of-Distribution Generalization: A Survey","created":"2021-08-31","cited_by_count":436,"area":null},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381,"area":null},{"id":"2109.02934","title":"Fishr: Invariant Gradient Variances for Out-of-Distribution Generalization","created":"2021-09-07","cited_by_count":186,"area":null},{"id":"2110.14503","title":"Simple data balancing achieves competitive worst-group-accuracy","created":"2021-10-27","cited_by_count":178,"area":null},{"id":"2403.06963","title":"The pitfalls of next-token prediction","created":"2024-03-11","cited_by_count":160,"area":null},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154,"area":null},{"id":"2205.09739","title":"Diverse Weight Averaging for Out-of-Distribution Generalization","created":"2022-05-19","cited_by_count":148,"area":null},{"id":"2210.11369","title":"On Feature Learning in the Presence of Spurious Correlations","created":"2022-10-20","cited_by_count":145,"area":null},{"id":"2202.02794","title":"Active Learning on a Budget: Opposite Strategies Suit High and Low Budgets","created":"2022-02-06","cited_by_count":133,"area":null},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124,"area":null},{"id":"2402.11004","title":"The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains","created":"2024-02-16","cited_by_count":118,"area":null},{"id":"2311.12786","title":"Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks","created":"2023-11-21","cited_by_count":115,"area":null},{"id":"2212.10445","title":"Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization","created":"2022-12-20","cited_by_count":97,"area":null},{"id":"2104.08646","title":"Competency Problems: On Finding and Removing Artifacts in Language Data","created":"2021-04-17","cited_by_count":91,"area":null},{"id":"2304.09218","title":"Generative models improve fairness of medical classifiers under distribution shifts","created":"2023-04-18","cited_by_count":90,"area":null},{"id":"2208.11857","title":"Shortcut Learning of Large Language Models in Natural Language Understanding","created":"2022-08-25","cited_by_count":85,"area":null},{"id":"2105.05612","title":"Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization","created":"2021-05-12","cited_by_count":83,"area":null},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83,"area":null},{"id":"2103.06922","title":"Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models","created":"2021-03-11","cited_by_count":78,"area":null},{"id":"2106.02890","title":"Can Subnetwork Structure be the Key to Out-of-Distribution Generalization?","created":"2021-06-05","cited_by_count":75,"area":null},{"id":"2202.04414","title":"Agree to Disagree: Diversity through Disagreement for Better Transferability","created":"2022-02-09","cited_by_count":70,"area":null},{"id":"2307.09542","title":"Can Neural Network Memorization Be Localized?","created":"2023-07-18","cited_by_count":69,"area":null},{"id":"2210.00055","title":"MaskTune: Mitigating Spurious Correlations by Forcing to Explore","created":"2022-09-30","cited_by_count":66,"area":null},{"id":"2310.16228","title":"On the Foundations of Shortcut Learning","created":"2023-10-24","cited_by_count":65,"area":null},{"id":"2209.07399","title":"A Light Recipe to Train Robust Vision Transformers","created":"2022-09-15","cited_by_count":64,"area":null},{"id":"2111.00898","title":"Availability Attacks Create Shortcuts","created":"2021-11-01","cited_by_count":62,"area":null},{"id":"2102.04716","title":"Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Training","created":"2021-02-09","cited_by_count":59,"area":null},{"id":"2110.03095","title":"Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective","created":"2021-10-06","cited_by_count":57,"area":null},{"id":"2202.03418","title":"Diversify and Disambiguate: Learning From Underspecified Data","created":"2022-02-07","cited_by_count":56,"area":null},{"id":"2205.12411","title":"Linear Connectivity Reveals Generalization Strategies","created":"2022-05-24","cited_by_count":56,"area":null},{"id":"2309.08534","title":"Towards Last-layer Retraining for Group Robustness with Fewer Annotations","created":"2023-09-15","cited_by_count":54,"area":null},{"id":"2305.01233","title":"On Uni-Modal Feature Learning in Supervised Multi-Modal Learning","created":"2023-05-02","cited_by_count":53,"area":null},{"id":"2102.12781","title":"Do Input Gradients Highlight Discriminative Features?","created":"2021-02-25","cited_by_count":52,"area":null},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50,"area":null},{"id":"2211.11567","title":"Neural networks trained with SGD learn distributions of increasing complexity","created":"2022-11-21","cited_by_count":50,"area":null},{"id":"2209.00613","title":"ID and OOD Performance Are Sometimes Inversely Correlated on Real-world Datasets","created":"2022-09-01","cited_by_count":44,"area":null},{"id":"2301.09819","title":"Model Agnostic Sample Reweighting for Out-of-Distribution Learning","created":"2023-01-24","cited_by_count":44,"area":null},{"id":"2305.18761","title":"Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias","created":"2023-05-30","cited_by_count":44,"area":null},{"id":"2502.00379","title":"Latent Action Learning Requires Supervision in the Presence of Distractors","created":"2025-02-01","cited_by_count":44,"area":null},{"id":"2307.03132","title":"T-MARS: Improving Visual Representations by Circumventing Text Feature Learning","created":"2023-07-06","cited_by_count":43,"area":null},{"id":"2403.02241","title":"Neural Redshift: Random Networks are not Random Functions","created":"2024-03-04","cited_by_count":43,"area":null},{"id":"2212.04871","title":"Spurious Features Everywhere -- Large-Scale Detection of Harmful Spurious Features in ImageNet","created":"2022-12-09","cited_by_count":41,"area":null},{"id":"2402.12715","title":"The Clever Hans Mirage: A Comprehensive Survey on Spurious Correlations in Machine Learning","created":"2024-02-20","cited_by_count":41,"area":null},{"id":"2107.06219","title":"Towards Unsupervised Domain Generalization","created":"2021-07-13","cited_by_count":40,"area":null},{"id":"2301.13838","title":"Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compression","created":"2023-01-31","cited_by_count":39,"area":null},{"id":"2106.02112","title":"Finding and Fixing Spurious Patterns with Explanations","created":"2021-06-03","cited_by_count":38,"area":null},{"id":"2110.02424","title":"Spectral Bias in Practice: The Role of Function Frequency in Generalization","created":"2021-10-06","cited_by_count":37,"area":null},{"id":"2210.15031","title":"Characterizing Datapoints via Second-Split Forgetting","created":"2022-10-26","cited_by_count":37,"area":null},{"id":"2110.05922","title":"Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)","created":"2021-10-12","cited_by_count":35,"area":null},{"id":"2304.11327","title":"Understanding and Improving Feature Learning for Out-of-Distribution Generalization","created":"2023-04-22","cited_by_count":35,"area":null},{"id":"2106.02105","title":"A Little Robustness Goes a Long Way: Leveraging Robust Features for Targeted Transfer Attacks","created":"2021-06-03","cited_by_count":34,"area":null},{"id":"2206.07837","title":"Modeling the Data-Generating Process is Necessary for Out-of-Distribution Generalization","created":"2022-06-15","cited_by_count":34,"area":null},{"id":"2207.11347","title":"An Impartial Take to the CNN vs Transformer Robustness Contest","created":"2022-07-22","cited_by_count":34,"area":null},{"id":"2201.10055","title":"Identifying a Training-Set Attack's Target Using Renormalized Influence Estimation","created":"2022-01-25","cited_by_count":32,"area":null},{"id":"2303.06167","title":"Overwriting Pretrained Bias with Finetuning Data","created":"2023-03-10","cited_by_count":32,"area":null},{"id":"2110.04655","title":"Disentangled Sequence to Sequence Learning for Compositional Generalization","created":"2021-10-09","cited_by_count":30,"area":null},{"id":"2308.12553","title":"Don't blame Dataset Shift! Shortcut Learning due to Gradients and Cross Entropy","created":"2023-08-24","cited_by_count":30,"area":null},{"id":"2211.02291","title":"SelecMix: Debiased Learning by Contradicting-pair Sampling","created":"2022-11-04","cited_by_count":29,"area":null},{"id":"2301.13293","title":"Overcoming Simplicity Bias in Deep Networks using a Feature Sieve","created":"2023-01-30","cited_by_count":29,"area":null},{"id":"2504.15266","title":"Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction","created":"2025-04-21","cited_by_count":29,"area":null},{"id":"2304.06670","title":"Deep neural networks have an inbuilt Occam's razor","created":"2023-04-13","cited_by_count":28,"area":null},{"id":"2307.03217","title":"Quantification of Uncertainty with Adversarial Models","created":"2023-07-06","cited_by_count":28,"area":null},{"id":"2307.09829","title":"What do neural networks learn in image classification? A frequency shortcut perspective","created":"2023-07-19","cited_by_count":28,"area":null},{"id":"2202.04347","title":"Gradient Methods Provably Converge to Non-Robust Networks","created":"2022-02-09","cited_by_count":27,"area":null},{"id":"2202.05189","title":"Understanding Rare Spurious Correlations in Neural Networks","created":"2022-02-10","cited_by_count":27,"area":null},{"id":"2211.12883","title":"Mitigating and Evaluating Static Bias of Action Representations in the Background and the Foreground","created":"2022-11-23","cited_by_count":27,"area":null},{"id":"2105.04459","title":"ICON: Learning Regular Maps Through Inverse Consistency","created":"2021-05-10","cited_by_count":26,"area":null},{"id":"2207.02598","title":"Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning","created":"2022-07-06","cited_by_count":26,"area":null},{"id":"2302.00457","title":"Simplicity Bias in 1-Hidden Layer Neural Networks","created":"2023-02-01","cited_by_count":26,"area":null},{"id":"2309.16748","title":"Discovering environments with XRM","created":"2023-09-28","cited_by_count":26,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2206.08871","title":"How Robust is Unsupervised Representation Learning to Distribution Shift?","created":"2022-06-17","cited_by_count":24,"area":null},{"id":"2303.01456","title":"The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks","created":"2023-03-02","cited_by_count":23,"area":null},{"id":"2405.05847","title":"Learned feature representations are biased by complexity, learning order, position, and more","created":"2024-05-09","cited_by_count":23,"area":null},{"id":"2205.15704","title":"Mitigating Dataset Bias by Using Per-sample Gradient","created":"2022-05-31","cited_by_count":22,"area":null},{"id":"2210.11075","title":"Freeze then Train: Towards Provable Representation Learning under Spurious Correlations and Feature Noise","created":"2022-10-20","cited_by_count":22,"area":null},{"id":"2305.06024","title":"A Survey on the Robustness of Computer Vision Models against Common Corruptions","created":"2023-05-10","cited_by_count":21,"area":null},{"id":"2209.07592","title":"Explicit Tradeoffs between Adversarial and Natural Distributional Robustness","created":"2022-09-15","cited_by_count":20,"area":null},{"id":"2302.14685","title":"DART: Diversify-Aggregate-Repeat Training Improves Generalization of Neural Networks","created":"2023-02-28","cited_by_count":20,"area":null},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2405.16391","title":"When does compositional structure yield compositional generalization? A kernel theory","created":"2024-05-26","cited_by_count":20,"area":null},{"id":"2206.04672","title":"Overcoming the Spectral Bias of Neural Value Approximation","created":"2022-06-09","cited_by_count":19,"area":null},{"id":"2404.11534","title":"Decomposing and Editing Predictions by Modeling Model Computation","created":"2024-04-17","cited_by_count":19,"area":null},{"id":"2412.07684","title":"The Pitfalls of Memorization: When Memorization Hurts Generalization","created":"2024-12-10","cited_by_count":19,"area":null},{"id":"2510.22980","title":"How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data","created":"2025-10-27","cited_by_count":19,"area":null},{"id":"2402.18919","title":"Decompose-and-Compose: A Compositional Approach to Mitigating Spurious Correlation","created":"2024-02-29","cited_by_count":18,"area":null},{"id":"2101.01152","title":"Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise","created":"2021-01-04","cited_by_count":17,"area":null},{"id":"2203.06498","title":"The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learning","created":"2022-03-12","cited_by_count":17,"area":null},{"id":"2310.06982","title":"Data Distillation Can Be Like Vodka: Distilling More Times For Better Quality","created":"2023-10-10","cited_by_count":17,"area":null},{"id":"2103.02695","title":"Shift Invariance Can Reduce Adversarial Robustness","created":"2021-03-03","cited_by_count":16,"area":null},{"id":"2206.10816","title":"Fighting Fire with Fire: Avoiding DNN Shortcuts through Priming","created":"2022-06-22","cited_by_count":15,"area":null},{"id":"2407.06076","title":"Understanding Visual Feature Reliance through the Lens of Complexity","created":"2024-07-08","cited_by_count":15,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2104.00170","title":"Are Bias Mitigation Techniques for Deep Learning Effective?","created":"2021-04-01","cited_by_count":14,"area":null},{"id":"2210.12030","title":"Evolution of Neural Tangent Kernels under Benign and Adversarial Training","created":"2022-10-21","cited_by_count":14,"area":null},{"id":"2303.07123","title":"Modality-Agnostic Debiasing for Single Domain Generalization","created":"2023-03-13","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2201.11259","title":"Controlling Directions Orthogonal to a Classifier","created":"2022-01-27","cited_by_count":13,"area":null},{"id":"2311.04163","title":"Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization","created":"2023-11-07","cited_by_count":13,"area":null}],"next_cursor":"100"}