{"total":754,"rows":[{"id":"2305.17926","title":"Large Language Models are not Fair Evaluators","created":"2023-05-29","cited_by_count":1085,"area":null},{"id":"2103.07191","title":"Are NLP Models really able to Solve Simple Math Word Problems?","created":"2021-03-12","cited_by_count":878,"area":null},{"id":"2306.08302","title":"Unifying Large Language Models and Knowledge Graphs: A Roadmap","created":"2023-06-14","cited_by_count":668,"area":null},{"id":"2307.06435","title":"A Comprehensive Overview of Large Language Models","created":"2023-07-12","cited_by_count":648,"area":null},{"id":"2201.11990","title":"Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model","created":"2022-01-28","cited_by_count":559,"area":null},{"id":"2107.09044","title":"Just Train Twice: Improving Group Robustness without Training Group Information","created":"2021-07-19","cited_by_count":523,"area":null},{"id":"2104.14337","title":"Dynabench: Rethinking Benchmarking in NLP","created":"2021-04-07","cited_by_count":459,"area":null},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381,"area":null},{"id":"2108.11896","title":"A Survey on Automated Fact-Checking","created":"2021-08-26","cited_by_count":378,"area":null},{"id":"2102.01017","title":"Measuring and Improving Consistency in Pretrained Language Models","created":"2021-02-01","cited_by_count":364,"area":null},{"id":"2109.01247","title":"Do Prompt-Based Models Really Understand the Meaning of their Prompts?","created":"2021-09-02","cited_by_count":326,"area":null},{"id":"2104.05240","title":"Factual Probing Is [MASK]: Learning vs. Learning to Recall","created":"2021-04-12","cited_by_count":291,"area":null},{"id":"2210.09150","title":"Prompting GPT-3 To Be Reliable","created":"2022-10-17","cited_by_count":260,"area":null},{"id":"2103.08541","title":"Get Your Vitamin C! Robust Fact Verification with Contrastive Evidence","created":"2021-03-15","cited_by_count":225,"area":null},{"id":"2101.00288","title":"Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models","created":"2021-01-01","cited_by_count":222,"area":null},{"id":"2207.04901","title":"Exploring Length Generalization in Large Language Models","created":"2022-07-11","cited_by_count":206,"area":null},{"id":"2104.02145","title":"What Will it Take to Fix Benchmarking in Natural Language Understanding?","created":"2021-04-05","cited_by_count":203,"area":null},{"id":"2201.05955","title":"WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation","created":"2022-01-16","cited_by_count":202,"area":null},{"id":"2101.11038","title":"Muppet: Massive Multi-task Representations with Pre-Finetuning","created":"2021-01-26","cited_by_count":192,"area":null},{"id":"2109.00725","title":"Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond","created":"2021-09-02","cited_by_count":178,"area":null},{"id":"2104.06644","title":"Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little","created":"2021-04-14","cited_by_count":177,"area":null},{"id":"2108.04840","title":"Post-hoc Interpretability for Neural NLP: A Survey","created":"2021-08-10","cited_by_count":156,"area":null},{"id":"2202.06935","title":"Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text","created":"2022-02-14","cited_by_count":155,"area":null},{"id":"2205.10782","title":"Instruction Induction: From Few Examples to Natural Language Task Descriptions","created":"2022-05-22","cited_by_count":152,"area":null},{"id":"2304.03738","title":"Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models","created":"2023-04-07","cited_by_count":148,"area":null},{"id":"2210.11369","title":"On Feature Learning in the Presence of Spurious Correlations","created":"2022-10-20","cited_by_count":145,"area":null},{"id":"2210.13966","title":"The Debate Over Understanding in AI's Large Language Models","created":"2022-10-14","cited_by_count":142,"area":null},{"id":"2305.16938","title":"Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation","created":"2023-05-26","cited_by_count":136,"area":null},{"id":"2305.06329","title":"Similarity of Neural Network Models: A Survey of Functional and Representational Measures","created":"2023-05-10","cited_by_count":131,"area":null},{"id":"2209.11326","title":"Towards Faithful Model Explanation in NLP: A Survey","created":"2022-09-22","cited_by_count":130,"area":null},{"id":"2303.01432","title":"WiCE: Real-World Entailment for Claims in Wikipedia","created":"2023-03-02","cited_by_count":120,"area":null},{"id":"2511.04703","title":"Measuring what Matters: Construct Validity in Large Language Model Benchmarks","created":"2025-11-03","cited_by_count":119,"area":null},{"id":"2104.06001","title":"Gender Bias in Machine Translation","created":"2021-04-13","cited_by_count":117,"area":null},{"id":"2107.03158","title":"A Survey on Data Augmentation for Text Classification","created":"2021-07-07","cited_by_count":111,"area":null},{"id":"2101.04840","title":"Robustness Gym: Unifying the NLP Evaluation Landscape","created":"2021-01-13","cited_by_count":108,"area":null},{"id":"2106.09231","title":"Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases","created":"2021-06-17","cited_by_count":107,"area":null},{"id":"2112.08313","title":"Measure and Improve Robustness in NLP Models: A Survey","created":"2021-12-15","cited_by_count":107,"area":null},{"id":"2206.04301","title":"Unveiling Transformers with LEGO: a synthetic reasoning task","created":"2022-06-09","cited_by_count":106,"area":null},{"id":"2102.10717","title":"Abstraction and Analogy-Making in Artificial Intelligence","created":"2021-02-22","cited_by_count":103,"area":null},{"id":"2207.07411","title":"Plex: Towards Reliability using Pretrained Large Model Extensions","created":"2022-07-15","cited_by_count":102,"area":null},{"id":"2106.07499","title":"An Empirical Survey of Data Augmentation for Limited Data Learning in NLP","created":"2021-06-14","cited_by_count":101,"area":null},{"id":"2210.03050","title":"State-of-the-art generalisation research in NLP: A taxonomy and review","created":"2022-10-06","cited_by_count":98,"area":null},{"id":"2306.04618","title":"Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations","created":"2023-06-07","cited_by_count":97,"area":null},{"id":"2106.16163","title":"The MultiBERTs: BERT Reproductions for Robustness Analysis","created":"2021-06-30","cited_by_count":92,"area":null},{"id":"2302.07011","title":"A Modern Look at the Relationship between Sharpness and Generalization","created":"2023-02-14","cited_by_count":92,"area":null},{"id":"2303.11504","title":"Language Model Behavior: A Comprehensive Survey","created":"2023-03-20","cited_by_count":92,"area":null},{"id":"2107.12708","title":"QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension","created":"2021-07-27","cited_by_count":91,"area":null},{"id":"2208.11857","title":"Shortcut Learning of Large Language Models in Natural Language Understanding","created":"2022-08-25","cited_by_count":85,"area":null},{"id":"2109.06827","title":"Types of Out-of-Distribution Texts and How to Detect Them","created":"2021-09-14","cited_by_count":80,"area":null},{"id":"2210.07700","title":"Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey","created":"2022-10-14","cited_by_count":80,"area":null},{"id":"2104.08678","title":"Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation","created":"2021-04-18","cited_by_count":79,"area":null},{"id":"2205.12404","title":"FLUTE: Figurative Language Understanding through Textual Explanations","created":"2022-05-24","cited_by_count":79,"area":null},{"id":"2103.06922","title":"Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models","created":"2021-03-11","cited_by_count":78,"area":null},{"id":"2105.00071","title":"Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark","created":"2021-04-30","cited_by_count":77,"area":null},{"id":"2110.07736","title":"Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Models","created":"2021-10-14","cited_by_count":76,"area":null},{"id":"2103.01378","title":"Contrastive Explanations for Model Interpretability","created":"2021-03-02","cited_by_count":75,"area":null},{"id":"2105.03519","title":"Understanding by Understanding Not: Modeling Negation in Language Models","created":"2021-05-07","cited_by_count":73,"area":null},{"id":"2112.02721","title":"NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation","created":"2021-12-06","cited_by_count":73,"area":null},{"id":"2304.00612","title":"Eight Things to Know about Large Language Models","created":"2023-04-02","cited_by_count":73,"area":null},{"id":"2211.08073","title":"GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspective","created":"2022-11-15","cited_by_count":72,"area":null},{"id":"2306.00186","title":"Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback","created":"2023-05-31","cited_by_count":72,"area":null},{"id":"2104.03149","title":"Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering","created":"2021-04-07","cited_by_count":71,"area":null},{"id":"2402.12483","title":"Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?","created":"2024-02-19","cited_by_count":71,"area":null},{"id":"2202.04414","title":"Agree to Disagree: Diversity through Disagreement for Better Transferability","created":"2022-02-09","cited_by_count":70,"area":null},{"id":"2212.06801","title":"A fine-grained comparison of pragmatic language understanding in humans and language models","created":"2022-12-13","cited_by_count":70,"area":null},{"id":"2305.17256","title":"Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learning","created":"2023-05-26","cited_by_count":69,"area":null},{"id":"2107.07150","title":"Tailor: Generating and Perturbing Text with Semantic Controls","created":"2021-07-15","cited_by_count":68,"area":null},{"id":"2110.01518","title":"Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics","created":"2021-10-04","cited_by_count":67,"area":null},{"id":"2204.11788","title":"Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation","created":"2022-04-25","cited_by_count":67,"area":null},{"id":"2111.07367","title":"\"Will You Find These Shortcuts?\" A Protocol for Evaluating the Faithfulness of Input Salience Methods for Text Classification","created":"2021-11-14","cited_by_count":66,"area":null},{"id":"2203.00211","title":"Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settings","created":"2022-03-01","cited_by_count":66,"area":null},{"id":"2106.07171","title":"Examining and Combating Spurious Features under Distribution Shift","created":"2021-06-14","cited_by_count":65,"area":null},{"id":"2310.16228","title":"On the Foundations of Shortcut Learning","created":"2023-10-24","cited_by_count":65,"area":null},{"id":"2105.06965","title":"Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction","created":"2021-05-14","cited_by_count":59,"area":null},{"id":"2108.05885","title":"The paradox of the compositionality of natural language: a neural machine translation case study","created":"2021-08-12","cited_by_count":59,"area":null},{"id":"2101.05303","title":"Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Making","created":"2021-01-13","cited_by_count":58,"area":null},{"id":"2104.07644","title":"ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoning","created":"2021-04-15","cited_by_count":58,"area":null},{"id":"2211.00151","title":"A Close Look into the Calibration of Pre-trained Language Models","created":"2022-10-31","cited_by_count":57,"area":null},{"id":"2205.12411","title":"Linear Connectivity Reveals Generalization Strategies","created":"2022-05-24","cited_by_count":56,"area":null},{"id":"2107.00643","title":"Mandoline: Model Evaluation under Distribution Shift","created":"2021-07-01","cited_by_count":55,"area":null},{"id":"2212.02199","title":"Legal Prompt Engineering for Multilingual Legal Judgement Prediction","created":"2022-12-05","cited_by_count":55,"area":null},{"id":"2203.12942","title":"Generating Data to Mitigate Spurious Correlations in Natural Language Inference Datasets","created":"2022-03-24","cited_by_count":54,"area":null},{"id":"2309.08534","title":"Towards Last-layer Retraining for Group Robustness with Fewer Annotations","created":"2023-09-15","cited_by_count":54,"area":null},{"id":"2104.15135","title":"Explanation-Based Human Debugging of NLP Models: A Survey","created":"2021-04-30","cited_by_count":53,"area":null},{"id":"2106.06052","title":"Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking","created":"2021-05-21","cited_by_count":53,"area":null},{"id":"2105.13947","title":"Changing the World by Changing the Data","created":"2021-05-28","cited_by_count":51,"area":null},{"id":"2202.05834","title":"Predicting Out-of-Distribution Error with the Projection Norm","created":"2022-02-11","cited_by_count":50,"area":null},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50,"area":null},{"id":"2212.10020","title":"On the Blind Spots of Model-Based Evaluation Metrics for Text Generation","created":"2022-12-20","cited_by_count":49,"area":null},{"id":"2305.13299","title":"Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations","created":"2023-05-22","cited_by_count":49,"area":null},{"id":"2311.08648","title":"Explore Spurious Correlations at the Concept Level in Language Models for Text Classification","created":"2023-11-15","cited_by_count":48,"area":null},{"id":"2204.03031","title":"VALUE: Understanding Dialect Disparity in NLU","created":"2022-04-06","cited_by_count":47,"area":null},{"id":"2212.01488","title":"Event knowledge in large language models: the gap between the impossible and the unlikely","created":"2022-12-02","cited_by_count":45,"area":null},{"id":"2101.03453","title":"BERT & Family Eat Word Salad: Experiments with Text Understanding","created":"2021-01-10","cited_by_count":44,"area":null},{"id":"2103.12279","title":"SelfExplain: A Self-Explaining Architecture for Neural Text Classifiers","created":"2021-03-23","cited_by_count":44,"area":null},{"id":"2109.14989","title":"Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations","created":"2021-09-30","cited_by_count":44,"area":null},{"id":"2204.07447","title":"Stretching Sentence-pair NLI Models to Reason over Long Documents and Clusters","created":"2022-04-15","cited_by_count":44,"area":null},{"id":"2211.00768","title":"Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality","created":"2022-11-01","cited_by_count":44,"area":null},{"id":"2110.14189","title":"Robust Contrastive Learning Using Negative Samples with Diminished Semantics","created":"2021-10-27","cited_by_count":43,"area":null},{"id":"2107.00753","title":"An Investigation of the (In)effectiveness of Counterfactually Augmented Data","created":"2021-07-01","cited_by_count":42,"area":null}],"next_cursor":"100"}