{"total":173,"rows":[{"id":"2108.13264","title":"Deep Reinforcement Learning at the Edge of the Statistical Precipice","created":"2021-08-30","cited_by_count":807,"area":null},{"id":"2207.08815","title":"Why do tree-based models still outperform deep learning on tabular data?","created":"2022-07-18","cited_by_count":199,"area":null},{"id":"2107.07002","title":"The Benchmark Lottery","created":"2021-07-14","cited_by_count":136,"area":null},{"id":"2305.03403","title":"Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering","created":"2023-05-05","cited_by_count":127,"area":null},{"id":"2109.06716","title":"HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO","created":"2021-09-14","cited_by_count":112,"area":null},{"id":"2109.08203","title":"Torch.manual_seed(3407) is all you need: On the influence of random seeds in deep learning architectures for computer vision","created":"2021-09-16","cited_by_count":81,"area":null},{"id":"2311.17295","title":"Elo Uncovered: Robustness and Best Practices in Language Model Evaluation","created":"2023-11-29","cited_by_count":61,"area":null},{"id":"2106.11872","title":"Randomness In Neural Network Training: Characterizing The Impact of Tooling","created":"2021-06-22","cited_by_count":59,"area":null},{"id":"2306.12251","title":"GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection","created":"2023-06-21","cited_by_count":58,"area":null},{"id":"2103.10292","title":"How I failed machine learning in medical imaging -- shortcomings and recommendations","created":"2021-03-18","cited_by_count":37,"area":null},{"id":"2204.07610","title":"Sources of Irreproducibility in Machine Learning: A Review","created":"2022-04-15","cited_by_count":32,"area":null},{"id":"2204.06815","title":"deep-significance - Easy and Meaningful Statistical Significance Testing in the Age of Neural Networks","created":"2022-04-14","cited_by_count":28,"area":null},{"id":"2109.02157","title":"Learning with Holographic Reduced Representations","created":"2021-09-05","cited_by_count":25,"area":null},{"id":"2109.01433","title":"Relating the Partial Dependence Plot and Permutation Feature Importance to the Data Generating Process","created":"2021-09-03","cited_by_count":24,"area":null},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23,"area":null},{"id":"2304.01910","title":"On the Variance of Neural Network Training with respect to Test Sets and Distributions","created":"2023-04-04","cited_by_count":22,"area":null},{"id":"2310.17653","title":"Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model","created":"2023-10-26","cited_by_count":19,"area":null},{"id":"2405.02200","title":"Position: Why We Must Rethink Empirical Research in Machine Learning","created":"2024-05-03","cited_by_count":19,"area":null},{"id":"2110.03375","title":"Learning Pessimism for Robust and Efficient Off-Policy Reinforcement Learning","created":"2021-10-07","cited_by_count":18,"area":null},{"id":"2504.17119","title":"The Rise of Small Language Models in Healthcare: A Comprehensive Survey","created":"2025-04-23","cited_by_count":18,"area":null},{"id":"2203.06498","title":"The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learning","created":"2022-03-12","cited_by_count":17,"area":null},{"id":"2304.10655","title":"The Dataset Multiplicity Problem: How Unreliable Data Impacts Predictions","created":"2023-04-20","cited_by_count":17,"area":null},{"id":"2501.14959","title":"Systemizing Multiplicity: The Curious Case of Arbitrariness in Machine Learning","created":"2025-01-24","cited_by_count":17,"area":null},{"id":"2109.11126","title":"A Framework for Cluster and Classifier Evaluation in the Absence of Reference Labels","created":"2021-09-23","cited_by_count":16,"area":null},{"id":"2303.08485","title":"Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML","created":"2023-03-15","cited_by_count":16,"area":null},{"id":"2410.23144","title":"Public Domain 12M: A Highly Aesthetic Image-Text Dataset with Novel Governance Mechanisms","created":"2024-10-30","cited_by_count":15,"area":null},{"id":"2605.25492","title":"SafetyRepro: Configuration-Conditional Rank Instability on Alignment Benchmarks","created":"2026-05-25","cited_by_count":15,"area":null},{"id":"2312.01082","title":"A Survey on Stability of Learning with Limited Labelled Data and its Sensitivity to the Effects of Randomness","created":"2023-12-02","cited_by_count":14,"area":null},{"id":"2308.07832","title":"REFORMS: Reporting Standards for Machine Learning Based Science","created":"2023-08-15","cited_by_count":13,"area":null},{"id":"2409.17763","title":"Confidence intervals uncovered: Are we ready for real-world medical imaging AI?","created":"2024-09-26","cited_by_count":12,"area":null},{"id":"2605.12678","title":"No One Knows the State of the Art in Geospatial Foundation Models","created":"2026-05-12","cited_by_count":12,"area":null},{"id":"2204.09825","title":"A Revealing Large-Scale Evaluation of Unsupervised Anomaly Detection Algorithms","created":"2022-04-21","cited_by_count":11,"area":null},{"id":"2310.17867","title":"Reproducibility in Multiple Instance Learning: A Case For Algorithmic Unit Tests","created":"2023-10-27","cited_by_count":11,"area":null},{"id":"2204.06251","title":"Experimental Standards for Deep Learning in Natural Language Processing Research","created":"2022-04-13","cited_by_count":10,"area":null},{"id":"2401.16363","title":"Evaluation of pseudo-healthy image reconstruction for anomaly detection with deep generative models: Application to brain FDG PET","created":"2024-01-29","cited_by_count":10,"area":null},{"id":"2410.24100","title":"Benchmark Data Repositories for Better Benchmarking","created":"2024-10-31","cited_by_count":10,"area":null},{"id":"2501.04234","title":"Statistical Uncertainty Quantification for Aggregate Performance Metrics in Machine Learning Benchmarks","created":"2025-01-08","cited_by_count":10,"area":null},{"id":"2412.03854","title":"What Do Machine Learning Researchers Mean by \"Reproducible\"?","created":"2024-12-05","cited_by_count":9,"area":null},{"id":"2204.03829","title":"Does the Market of Citations Reward Reproducible Work?","created":"2022-04-08","cited_by_count":8,"area":null},{"id":"2204.04372","title":"A Siren Song of Open Source Reproducibility","created":"2022-04-09","cited_by_count":8,"area":null},{"id":"2405.15393","title":"Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization","created":"2024-05-24","cited_by_count":7,"area":null},{"id":"2511.19794","title":"When +1% Is Not Enough: A Paired Bootstrap Protocol for Evaluating Small Improvements","created":"2025-11-24","cited_by_count":7,"area":null},{"id":"2108.13637","title":"When are Deep Networks really better than Decision Forests at small sample sizes, and how?","created":"2021-08-31","cited_by_count":6,"area":null},{"id":"2112.15072","title":"Empirical Evaluation of Deep Learning Models for Knowledge Tracing: Of Hyperparameters and Metrics on Performance and Replicability","created":"2021-12-30","cited_by_count":6,"area":null},{"id":"2307.09191","title":"A benchmark of categorical encoders for binary classification","created":"2023-07-17","cited_by_count":6,"area":null},{"id":"2307.11525","title":"Model Reporting for Certifiable AI: A Proposal from Merging EU Regulation into AI Development","created":"2023-07-21","cited_by_count":6,"area":null},{"id":"2410.22677","title":"Is Function Similarity Over-Engineered? Building a Benchmark","created":"2024-10-30","cited_by_count":6,"area":null},{"id":"2112.07922","title":"Ten years of image analysis and machine learning competitions in dementia","created":"2021-12-15","cited_by_count":5,"area":null},{"id":"2204.11910","title":"Integrating Reward Maximization and Population Estimation: Sequential Decision-Making for Internal Revenue Service Audit Selection","created":"2022-04-25","cited_by_count":5,"area":null},{"id":"2209.05097","title":"Reproducibility in machine learning for medical imaging","created":"2022-09-12","cited_by_count":5,"area":null},{"id":"2209.05559","title":"Deep Reinforcement Learning for Cryptocurrency Trading: Practical Approach to Address Backtest Overfitting","created":"2022-09-12","cited_by_count":5,"area":null},{"id":"2301.06163","title":"A Coreset Learning Reality Check","created":"2023-01-15","cited_by_count":5,"area":null},{"id":"2402.07963","title":"SPO: Sequential Monte Carlo Policy Optimisation","created":"2024-02-12","cited_by_count":5,"area":null},{"id":"2408.15409","title":"Awes, Laws, and Flaws From Today's LLM Research","created":"2024-08-27","cited_by_count":5,"area":null},{"id":"2607.26587","title":"The Implementation Lottery: Auditing Idea Reliability in Automated Research","created":"2026-07-29","cited_by_count":5,"area":null},{"id":"2302.04054","title":"Towards Inferential Reproducibility of Machine Learning Research","created":"2023-02-08","cited_by_count":4,"area":null},{"id":"2312.15813","title":"Small Effect Sizes in Malware Detection? Make Harder Train/Test Splits!","created":"2023-12-25","cited_by_count":4,"area":null},{"id":"2407.08838","title":"Deep Learning for Network Anomaly Detection under Data Contamination: Evaluating Robustness and Mitigating Performance Degradation","created":"2024-07-11","cited_by_count":4,"area":null},{"id":"2409.04665","title":"IIFE: Interaction Information Based Automated Feature Engineering","created":"2024-09-07","cited_by_count":4,"area":null},{"id":"2104.06357","title":"GPU Semiring Primitives for Sparse Neighborhood Methods","created":"2021-04-13","cited_by_count":3,"area":null},{"id":"2108.06896","title":"Challenges for cognitive decoding using deep learning methods","created":"2021-08-16","cited_by_count":3,"area":null},{"id":"2111.01562","title":"Evaluating deep transfer learning for whole-brain cognitive decoding","created":"2021-11-01","cited_by_count":3,"area":null},{"id":"2201.06401","title":"Spatial State-Action Features for General Games","created":"2022-01-17","cited_by_count":3,"area":null},{"id":"2211.13250","title":"Lempel-Ziv Networks","created":"2022-11-23","cited_by_count":3,"area":null},{"id":"2305.10740","title":"A benchmark for computational analysis of animal behavior, using animal-borne tags","created":"2023-05-18","cited_by_count":3,"area":null},{"id":"2409.03887","title":"The Influence of Faulty Labels in Data Sets on Human Pose Estimation","created":"2024-09-05","cited_by_count":3,"area":null},{"id":"2501.14809","title":"Evaluation of Seismic Artificial Intelligence with Uncertainty","created":"2025-01-15","cited_by_count":3,"area":null},{"id":"2207.03576","title":"Robustness Evaluation of Deep Unsupervised Learning Algorithms for Intrusion Detection Systems","created":"2022-06-25","cited_by_count":2,"area":null},{"id":"2302.00370","title":"How to select predictive models for causal inference?","created":"2023-02-01","cited_by_count":2,"area":null},{"id":"2303.07272","title":"Inventing a coin-flip classifier: Accounting for multiplicity in machine learning benchmark performance","created":"2023-03-10","cited_by_count":2,"area":null},{"id":"2312.03886","title":"On The Fairness Impacts of Hardware Selection in Machine Learning","created":"2023-12-06","cited_by_count":2,"area":null},{"id":"2404.10433","title":"Explainable concept mappings of MRI: Revealing the mechanisms underlying deep learning-based brain disease classification","created":"2024-04-16","cited_by_count":2,"area":null},{"id":"2502.11362","title":"Teleportation With Null Space Gradient Projection for Optimization Acceleration","created":"2025-02-17","cited_by_count":2,"area":null},{"id":"2503.11003","title":"Crash Severity Analysis of Child Bicyclists using Arm-Net and MambaNet","created":"2025-03-14","cited_by_count":2,"area":null},{"id":"2606.03938","title":"q0: Primitives for Hyper-Epoch Pretraining","created":"2026-06-02","cited_by_count":2,"area":null},{"id":"2109.09649","title":"Data Augmentation Through Monte Carlo Arithmetic Leads to More Generalizable Classification in Connectomics","created":"2021-09-20","cited_by_count":1,"area":null},{"id":"2204.05173","title":"Machine Learning State-of-the-Art with Uncertainties","created":"2022-04-11","cited_by_count":1,"area":null},{"id":"2208.08902","title":"Autism spectrum disorder classification based on interpersonal neural synchrony: Can classification be improved by dyadic neural biomarkers using unsupervised graph representation learning?","created":"2022-08-17","cited_by_count":1,"area":null},{"id":"2211.13190","title":"BiasBed -- Rigorous Texture Bias Evaluation","created":"2022-11-23","cited_by_count":1,"area":null},{"id":"2211.14366","title":"Mixture Manifold Networks: A Computationally Efficient Baseline for Inverse Modeling","created":"2022-11-25","cited_by_count":1,"area":null},{"id":"2307.10926","title":"Confidence Intervals for Performance Estimates in Brain MRI Segmentation","created":"2023-07-20","cited_by_count":1,"area":null},{"id":"2310.00541","title":"Robust Nonparametric Hypothesis Testing to Understand Variability in Training Neural Networks","created":"2023-10-01","cited_by_count":1,"area":null},{"id":"2401.08409","title":"Faster ISNet for Background Bias Mitigation on Deep Neural Networks","created":"2024-01-16","cited_by_count":1,"area":null},{"id":"2402.12817","title":"On Sensitivity of Learning with Limited Labelled Data to the Effects of Randomness: Impact of Interactions and Systematic Choices","created":"2024-02-20","cited_by_count":1,"area":null},{"id":"2406.08307","title":"Measuring training variability from stochastic optimization using robust nonparametric testing","created":"2024-06-12","cited_by_count":1,"area":null},{"id":"2409.07397","title":"R+R: Revisiting Static Feature-Based Android Malware Detection using Machine Learning","created":"2024-09-11","cited_by_count":1,"area":null},{"id":"2505.21813","title":"Optimizing Data Augmentation through Bayesian Model Selection","created":"2025-05-27","cited_by_count":1,"area":null},{"id":"2507.07237","title":"Towards Robust Surrogate Models: Benchmarking Machine Learning Approaches to Expediting Phase Field Simulations of Brittle Fracture","created":"2025-07-09","cited_by_count":1,"area":null},{"id":"2509.12678","title":"Instance-level Randomization: Toward More Stable LLM Evaluations","created":"2025-09-16","cited_by_count":1,"area":null},{"id":"2510.09295","title":"MaP: A Unified Framework for Reliable Evaluation of Pre-training Dynamics","created":"2025-10-10","cited_by_count":1,"area":null},{"id":"2601.06730","title":"Why are there many equally good models? An Anatomy of the Rashomon Effect","created":"2026-01-11","cited_by_count":1,"area":null},{"id":"2604.17842","title":"QuickScope: Certifying Hard Questions in Dynamic LLM Benchmarks","created":"2026-04-20","cited_by_count":1,"area":null},{"id":"2604.23102","title":"Unstable Rankings in Bayesian Deep Learning Evaluation","created":"2026-04-25","cited_by_count":1,"area":null},{"id":"2604.23114","title":"A Tale of Two Variances: When Single-Seed Benchmarks Fail in Bayesian Deep Learning","created":"2026-04-25","cited_by_count":1,"area":null},{"id":"2605.11855","title":"Improving the Performance and Learning Stability of Parallelizable RNNs Designed for Ultra-Low Power Applications","created":"2026-05-12","cited_by_count":1,"area":null},{"id":"2605.27673","title":"When do complex-valued neural networks help? A study of representation, geometry, and optimization","created":"2026-05-26","cited_by_count":1,"area":null},{"id":"2606.27997","title":"Benchmarking on Tasks That Matter: Dataset Selection for Preserving Model Rankings","created":"2026-06-26","cited_by_count":1,"area":null},{"id":"2607.02134","title":"Coding-agents can replicate scientific machine learning papers","created":"2026-07-02","cited_by_count":1,"area":null},{"id":"2608.10670","title":"Seeds Before Objectives: Rethinking Evaluation for Low-Resource Garhwali ASR","created":"2026-08-11","cited_by_count":1,"area":null},{"id":"2608.20181","title":"A Standardized Framework for Machine Learning in Power System Protection","created":"2026-08-20","cited_by_count":1,"area":null}],"next_cursor":"100"}