{"total":149,"rows":[{"id":"2104.10350","title":"Carbon Emissions and Large Neural Network Training","created":"2021-04-21","cited_by_count":567,"area":null},{"id":"2111.15366","title":"AI and the Everything in the Whole Wide World Benchmark","created":"2021-11-26","cited_by_count":349,"area":null},{"id":"2105.11447","title":"True Few-Shot Learning with Language Models","created":"2021-05-24","cited_by_count":344,"area":null},{"id":"2110.08420","title":"Understanding Dataset Difficulty with $\\mathcal{V}$-Usable Information","created":"2021-10-16","cited_by_count":291,"area":null},{"id":"2104.02145","title":"What Will it Take to Fix Benchmarking in Natural Language Understanding?","created":"2021-04-05","cited_by_count":203,"area":null},{"id":"2202.06935","title":"Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text","created":"2022-02-14","cited_by_count":155,"area":null},{"id":"2107.07002","title":"The Benchmark Lottery","created":"2021-07-14","cited_by_count":136,"area":null},{"id":"2112.01716","title":"Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research","created":"2021-12-03","cited_by_count":102,"area":null},{"id":"2103.13009","title":"UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark","created":"2021-03-24","cited_by_count":98,"area":null},{"id":"2202.08450","title":"Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimization","created":"2022-02-17","cited_by_count":97,"area":null},{"id":"2403.07059","title":"Better than classical? The subtle art of benchmarking quantum machine learning models","created":"2024-03-11","cited_by_count":85,"area":null},{"id":"2107.03451","title":"Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling","created":"2021-07-07","cited_by_count":78,"area":null},{"id":"2209.00099","title":"Efficient Methods for Natural Language Processing: A Survey","created":"2022-08-31","cited_by_count":78,"area":null},{"id":"2107.02173","title":"Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherence","created":"2021-07-05","cited_by_count":74,"area":null},{"id":"2101.00403","title":"Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words","created":"2021-01-02","cited_by_count":63,"area":null},{"id":"2106.05469","title":"Variational Information Bottleneck for Effective Low-Resource Fine-Tuning","created":"2021-06-10","cited_by_count":51,"area":null},{"id":"2209.10485","title":"Towards a Standardised Performance Evaluation Protocol for Cooperative MARL","created":"2022-09-21","cited_by_count":49,"area":null},{"id":"2408.15204","title":"Can Unconfident LLM Annotations Be Used for Confident Conclusions?","created":"2024-08-27","cited_by_count":49,"area":null},{"id":"2109.06598","title":"Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLP","created":"2021-09-14","cited_by_count":47,"area":null},{"id":"2105.14462","title":"Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation","created":"2021-05-30","cited_by_count":44,"area":null},{"id":"2110.08300","title":"The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail","created":"2021-10-15","cited_by_count":38,"area":null},{"id":"2104.08524","title":"Multilingual and Cross-Lingual Intent Detection from Spoken Data","created":"2021-04-17","cited_by_count":35,"area":null},{"id":"2206.03216","title":"Data Governance in the Age of Large-Scale Data-Driven Language Technology","created":"2022-05-04","cited_by_count":33,"area":null},{"id":"2204.07610","title":"Sources of Irreproducibility in Machine Learning: A Review","created":"2022-04-15","cited_by_count":32,"area":null},{"id":"2104.01477","title":"Exploring the Role of BERT Token Representations to Explain Sentence Probing Results","created":"2021-04-03","cited_by_count":29,"area":null},{"id":"2109.04408","title":"Learning with Different Amounts of Annotation: From Zero to Many Labels","created":"2021-09-09","cited_by_count":28,"area":null},{"id":"2204.06815","title":"deep-significance - Easy and Meaningful Statistical Significance Testing in the Age of Neural Networks","created":"2022-04-14","cited_by_count":28,"area":null},{"id":"2402.02056","title":"AnthroScore: A Computational Linguistic Measure of Anthropomorphism","created":"2024-02-03","cited_by_count":27,"area":null},{"id":"2102.05486","title":"Towards More Fine-grained and Reliable NLP Performance Prediction","created":"2021-02-10","cited_by_count":26,"area":null},{"id":"2103.06944","title":"Preregistering NLP Research","created":"2021-03-11","cited_by_count":25,"area":null},{"id":"2209.07850","title":"FairGBM: Gradient Boosting with Fairness Constraints","created":"2022-09-16","cited_by_count":25,"area":null},{"id":"2405.06563","title":"What Can Natural Language Processing Do for Peer Review?","created":"2024-05-10","cited_by_count":25,"area":null},{"id":"2106.05532","title":"How Robust are Model Rankings: A Leaderboard Customization Approach for Equitable Evaluation","created":"2021-06-10","cited_by_count":24,"area":null},{"id":"2108.07374","title":"Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cards","created":"2021-08-16","cited_by_count":24,"area":null},{"id":"2401.10899","title":"Concrete Problems in AI Safety, Revisited","created":"2023-12-18","cited_by_count":22,"area":null},{"id":"2104.01371","title":"Convex Aggregation for Opinion Summarization","created":"2021-04-03","cited_by_count":21,"area":null},{"id":"2205.09646","title":"Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models","created":"2022-05-19","cited_by_count":21,"area":null},{"id":"2102.03034","title":"Hyperparameter Optimization Is Deceiving Us, and How to Stop It","created":"2021-02-05","cited_by_count":20,"area":null},{"id":"2308.07120","title":"Position: Key Claims in LLM Research Have a Long Tail of Footnotes","created":"2023-08-14","cited_by_count":20,"area":null},{"id":"2108.01182","title":"Underreporting of errors in NLG output, and what to do about it","created":"2021-08-02","cited_by_count":19,"area":null},{"id":"2505.18893","title":"Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects","created":"2025-05-24","cited_by_count":19,"area":null},{"id":"2110.07520","title":"Comparative Opinion Summarization via Collaborative Decoding","created":"2021-10-14","cited_by_count":18,"area":null},{"id":"2306.09562","title":"Reproducibility in NLP: What Have We Learned from the Checklist?","created":"2023-06-16","cited_by_count":18,"area":null},{"id":"2203.06498","title":"The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learning","created":"2022-03-12","cited_by_count":17,"area":null},{"id":"2106.03826","title":"Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study","created":"2021-06-07","cited_by_count":16,"area":null},{"id":"2605.25492","title":"SafetyRepro: Configuration-Conditional Rank Instability on Alignment Benchmarks","created":"2026-05-25","cited_by_count":15,"area":null},{"id":"2303.16166","title":"When Good and Reproducible Results are a Giant with Feet of Clay: The Importance of Software Quality in NLP","created":"2023-03-28","cited_by_count":14,"area":null},{"id":"2203.03691","title":"HyperMixer: An MLP-based Low Cost Alternative to Transformers","created":"2022-03-07","cited_by_count":13,"area":null},{"id":"2210.07352","title":"Predicting Fine-Tuning Performance with Probing","created":"2022-10-13","cited_by_count":13,"area":null},{"id":"2210.13393","title":"We need to talk about random seeds","created":"2022-10-24","cited_by_count":13,"area":null},{"id":"2308.07832","title":"REFORMS: Reporting Standards for Machine Learning Based Science","created":"2023-08-15","cited_by_count":13,"area":null},{"id":"2311.18807","title":"Pre-registration for Predictive Modeling","created":"2023-11-30","cited_by_count":13,"area":null},{"id":"2106.09204","title":"An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models","created":"2021-06-17","cited_by_count":12,"area":null},{"id":"2204.05151","title":"Metaethical Perspectives on 'Benchmarking' AI Ethics","created":"2022-04-11","cited_by_count":12,"area":null},{"id":"2210.07111","title":"A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models","created":"2022-10-13","cited_by_count":12,"area":null},{"id":"2310.06225","title":"GPT-4 as an Agronomist Assistant? Answering Agriculture Exams Using Large Language Models","created":"2023-10-10","cited_by_count":12,"area":null},{"id":"2302.05711","title":"Fair Enough: Standardizing Evaluation and Model Selection for Fairness Research in NLP","created":"2023-02-11","cited_by_count":11,"area":null},{"id":"2609.27678","title":"Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding","created":"2026-09-23","cited_by_count":11,"area":null},{"id":"2204.06251","title":"Experimental Standards for Deep Learning in Natural Language Processing Research","created":"2022-04-13","cited_by_count":10,"area":null},{"id":"2209.00692","title":"Making Intelligence: Ethical Values in IQ and ML Benchmarks","created":"2022-09-01","cited_by_count":10,"area":null},{"id":"2102.05331","title":"Language Models for Lexical Inference in Context","created":"2021-02-10","cited_by_count":9,"area":null},{"id":"2104.08878","title":"Perspectives on Machine Learning from Psychology's Reproducibility Crisis","created":"2021-04-18","cited_by_count":9,"area":null},{"id":"2112.01342","title":"How not to Lie with a Benchmark: Rearranging NLP Leaderboards","created":"2021-12-02","cited_by_count":9,"area":null},{"id":"2305.13342","title":"On the Limitations of Simulating Active Learning","created":"2023-05-21","cited_by_count":9,"area":null},{"id":"2412.03854","title":"What Do Machine Learning Researchers Mean by \"Reproducible\"?","created":"2024-12-05","cited_by_count":9,"area":null},{"id":"2512.04062","title":"Eval Factsheets: A Structured Framework for Documenting AI Evaluations","created":"2025-12-03","cited_by_count":9,"area":null},{"id":"2104.08763","title":"Making Attention Mechanisms More Robust and Interpretable with Virtual Adversarial Training","created":"2021-04-18","cited_by_count":8,"area":null},{"id":"2502.11910","title":"Adversarial Alignment for LLMs Requires Simpler, Reproducible, and More Measurable Objectives","created":"2025-02-17","cited_by_count":8,"area":null},{"id":"2510.07575","title":"Benchmarking is Broken -- Don't Let AI be its Own Judge","created":"2025-10-08","cited_by_count":8,"area":null},{"id":"2212.10313","title":"Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation","created":"2022-12-20","cited_by_count":7,"area":null},{"id":"2511.19794","title":"When +1% Is Not Enough: A Paired Bootstrap Protocol for Evaluating Small Improvements","created":"2025-11-24","cited_by_count":7,"area":null},{"id":"2102.06859","title":"Capturing Label Distribution: A Case Study in NLI","created":"2021-02-13","cited_by_count":6,"area":null},{"id":"2104.03577","title":"Stable deep neural network architectures for mitochondria segmentation on electron microscopy volumes","created":"2021-04-08","cited_by_count":6,"area":null},{"id":"2107.05132","title":"LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitution","created":"2021-07-11","cited_by_count":6,"area":null},{"id":"2110.00613","title":"Expected Validation Performance and Estimation of a Random Variable's Maximum","created":"2021-10-01","cited_by_count":6,"area":null},{"id":"2204.04735","title":"Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environments","created":"2022-04-10","cited_by_count":6,"area":null},{"id":"2205.09067","title":"Automatic Rule Induction for Interpretable Semi-Supervised Learning","created":"2022-05-18","cited_by_count":6,"area":null},{"id":"2311.09480","title":"Show Your Work with Confidence: Confidence Bands for Tuning Curves","created":"2023-11-16","cited_by_count":6,"area":null},{"id":"2312.01792","title":"Wild-Tab: A Benchmark For Out-Of-Distribution Generalization In Tabular Regression","created":"2023-12-04","cited_by_count":6,"area":null},{"id":"2108.10808","title":"Greenformers: Improving Computation and Memory Efficiency in Transformer Models via Low-Rank Approximation","created":"2021-08-24","cited_by_count":5,"area":null},{"id":"2411.06710","title":"Model Fusion through Bayesian Optimization in Language Model Fine-Tuning","created":"2024-11-11","cited_by_count":5,"area":null},{"id":"2505.19800","title":"MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs","created":"2025-05-26","cited_by_count":5,"area":null},{"id":"2302.04054","title":"Towards Inferential Reproducibility of Machine Learning Research","created":"2023-02-08","cited_by_count":4,"area":null},{"id":"2305.16579","title":"NLP Reproducibility For All: Understanding Experiences of Beginners","created":"2023-05-26","cited_by_count":4,"area":null},{"id":"2404.13020","title":"Stronger Random Baselines for In-Context Learning","created":"2024-04-19","cited_by_count":4,"area":null},{"id":"2407.12220","title":"Questionable practices in machine learning","created":"2024-07-17","cited_by_count":4,"area":null},{"id":"2408.06062","title":"On Tables with Numbers, with Numbers","created":"2024-08-12","cited_by_count":4,"area":null},{"id":"2511.21695","title":"EvalCards: A Framework for Standardized Evaluation Reporting","created":"2025-11-05","cited_by_count":4,"area":null},{"id":"2108.06896","title":"Challenges for cognitive decoding using deep learning methods","created":"2021-08-16","cited_by_count":3,"area":null},{"id":"2111.01562","title":"Evaluating deep transfer learning for whole-brain cognitive decoding","created":"2021-11-01","cited_by_count":3,"area":null},{"id":"2202.02617","title":"Adaptive Fine-Tuning of Transformer-Based Language Models for Named Entity Recognition","created":"2022-02-05","cited_by_count":3,"area":null},{"id":"2205.11134","title":"Please, Don't Forget the Difference and the Confidence Interval when Seeking for the State-of-the-Art Status","created":"2022-05-23","cited_by_count":3,"area":null},{"id":"2211.08723","title":"Noisy Pairing and Partial Supervision for Stylized Opinion Summarization","created":"2022-11-16","cited_by_count":3,"area":null},{"id":"2309.11691","title":"RAI4IoE: Responsible AI for Enabling the Internet of Energy","created":"2023-09-20","cited_by_count":3,"area":null},{"id":"2104.09947","title":"Measuring Shifts in Attitudes Towards COVID-19 Measures in Belgium Using Multilingual BERT","created":"2021-04-20","cited_by_count":2,"area":null},{"id":"2104.11761","title":"Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languages","created":"2021-04-23","cited_by_count":2,"area":null},{"id":"2201.01845","title":"Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation","created":"2022-01-05","cited_by_count":2,"area":null},{"id":"2205.11443","title":"Unsupervised Tokenization Learning","created":"2022-05-23","cited_by_count":2,"area":null},{"id":"2306.13686","title":"Broadening the perspective for sustainable AI: Comprehensive sustainability criteria and indicators for AI systems","created":"2023-06-22","cited_by_count":2,"area":null},{"id":"2312.03912","title":"Collaboration or Corporate Capture? Quantifying NLP's Reliance on Industry Artifacts and Contributions","created":"2023-12-06","cited_by_count":2,"area":null}],"next_cursor":"100"}