{"total":114,"rows":[{"id":"2103.00020","title":"Learning Transferable Visual Models From Natural Language Supervision","created":"2021-02-26","cited_by_count":33744,"area":"wm"},{"id":"2103.07191","title":"Are NLP Models really able to Solve Simple Math Word Problems?","created":"2021-03-12","cited_by_count":878,"area":null},{"id":"2111.01243","title":"Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey","created":"2021-11-01","cited_by_count":463,"area":null},{"id":"2104.14337","title":"Dynabench: Rethinking Benchmarking in NLP","created":"2021-04-07","cited_by_count":459,"area":null},{"id":"2102.01017","title":"Measuring and Improving Consistency in Pretrained Language Models","created":"2021-02-01","cited_by_count":364,"area":null},{"id":"2102.01672","title":"The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics","created":"2021-02-02","cited_by_count":239,"area":null},{"id":"2104.07412","title":"XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation","created":"2021-04-15","cited_by_count":168,"area":null},{"id":"2104.08835","title":"CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP","created":"2021-04-18","cited_by_count":142,"area":null},{"id":"2210.13966","title":"The Debate Over Understanding in AI's Large Language Models","created":"2022-10-14","cited_by_count":142,"area":null},{"id":"2405.06823","title":"PLeak: Prompt Leaking Attacks against Large Language Model Applications","created":"2024-05-10","cited_by_count":127,"area":null},{"id":"2306.12672","title":"From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought","created":"2023-06-22","cited_by_count":119,"area":"wm"},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116,"area":null},{"id":"2112.08313","title":"Measure and Improve Robustness in NLP Models: A Survey","created":"2021-12-15","cited_by_count":107,"area":null},{"id":"2102.10717","title":"Abstraction and Analogy-Making in Artificial Intelligence","created":"2021-02-22","cited_by_count":103,"area":null},{"id":"2210.03050","title":"State-of-the-art generalisation research in NLP: A taxonomy and review","created":"2022-10-06","cited_by_count":98,"area":null},{"id":"2107.12708","title":"QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension","created":"2021-07-27","cited_by_count":91,"area":null},{"id":"2504.08165","title":"Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora","created":"2025-04-10","cited_by_count":88,"area":null},{"id":"2403.19827","title":"Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs","created":"2024-03-28","cited_by_count":65,"area":null},{"id":"2105.04949","title":"BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?","created":"2021-05-11","cited_by_count":56,"area":null},{"id":"2505.16834","title":"SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis","created":"2025-05-22","cited_by_count":55,"area":"lr"},{"id":"2404.02418","title":"Auxiliary task demands mask the capabilities of smaller language models","created":"2024-04-03","cited_by_count":54,"area":null},{"id":"2106.06052","title":"Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking","created":"2021-05-21","cited_by_count":53,"area":null},{"id":"2105.13947","title":"Changing the World by Changing the Data","created":"2021-05-28","cited_by_count":51,"area":null},{"id":"2106.03634","title":"PROST: Physical Reasoning of Objects through Space and Time","created":"2021-06-07","cited_by_count":48,"area":null},{"id":"2305.02363","title":"Entity Tracking in Language Models","created":"2023-05-03","cited_by_count":44,"area":null},{"id":"2305.14701","title":"Modeling rapid language learning by distilling Bayesian priors into artificial neural networks","created":"2023-05-24","cited_by_count":42,"area":null},{"id":"2104.12871","title":"Why AI is Harder Than We Think","created":"2021-04-26","cited_by_count":41,"area":null},{"id":"2210.15303","title":"Can language models handle recursively nested grammatical structures? A case study on comparing models and humans","created":"2022-10-27","cited_by_count":41,"area":null},{"id":"2302.04752","title":"Benchmarks for Automated Commonsense Reasoning: A Survey","created":"2023-02-09","cited_by_count":40,"area":"lr"},{"id":"2303.09859","title":"Trained on 100 million words and still in shape: BERT meets British National Corpus","created":"2023-03-17","cited_by_count":39,"area":null},{"id":"2110.08300","title":"The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail","created":"2021-10-15","cited_by_count":38,"area":null},{"id":"2108.06084","title":"The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models","created":"2021-08-13","cited_by_count":36,"area":null},{"id":"2205.11463","title":"Context Limitations Make Neural Language Models More Human-Like","created":"2022-05-23","cited_by_count":34,"area":null},{"id":"2203.09397","title":"Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models","created":"2022-03-17","cited_by_count":28,"area":null},{"id":"2212.10898","title":"Training language models to summarize narratives improves brain alignment","created":"2022-12-21","cited_by_count":26,"area":null},{"id":"2201.02387","title":"The Defeat of the Winograd Schema Challenge","created":"2022-01-07","cited_by_count":25,"area":null},{"id":"2110.14566","title":"IndoNLI: A Natural Language Inference Dataset for Indonesian","created":"2021-10-27","cited_by_count":24,"area":null},{"id":"2305.19905","title":"How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases","created":"2023-05-31","cited_by_count":23,"area":null},{"id":"2301.11462","title":"How poor is the stimulus? Evaluating hierarchical generalization in neural networks trained on child-directed speech","created":"2023-01-26","cited_by_count":22,"area":null},{"id":"2311.07811","title":"In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax","created":"2023-11-13","cited_by_count":22,"area":null},{"id":"2109.04947","title":"Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding","created":"2021-09-10","cited_by_count":19,"area":null},{"id":"2410.12656","title":"Evaluating Morphological Compositional Generalization in Large Language Models","created":"2024-10-16","cited_by_count":19,"area":null},{"id":"2106.09069","title":"Automatic Construction of Evaluation Suites for Natural Language Generation Datasets","created":"2021-06-16","cited_by_count":18,"area":null},{"id":"2108.06743","title":"Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning","created":"2021-08-15","cited_by_count":17,"area":null},{"id":"2305.04572","title":"Putting Natural in Natural Language Processing","created":"2023-05-08","cited_by_count":17,"area":null},{"id":"2403.17368","title":"ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales?","created":"2024-03-26","cited_by_count":17,"area":null},{"id":"2208.04826","title":"Compositional Evaluation on Japanese Textual Entailment and Similarity","created":"2022-08-09","cited_by_count":14,"area":null},{"id":"2102.08655","title":"Decoding EEG Brain Activity for Multi-Modal Natural Language Processing","created":"2021-02-17","cited_by_count":13,"area":null},{"id":"2209.07430","title":"Machine Reading, Fast and Slow: When Do Models \"Understand\" Language?","created":"2022-09-15","cited_by_count":13,"area":null},{"id":"2308.02541","title":"Towards More Human-like AI Communication: A Review of Emergent Communication Research","created":"2023-08-01","cited_by_count":13,"area":null},{"id":"2105.14822","title":"Effective Batching for Recurrent Neural Network Grammars","created":"2021-05-31","cited_by_count":12,"area":null},{"id":"2302.08143","title":"Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning?","created":"2023-02-16","cited_by_count":11,"area":null},{"id":"2111.01322","title":"Diverse Distributions of Self-Supervised Tasks for Meta-Learning in NLP","created":"2021-11-02","cited_by_count":10,"area":null},{"id":"2109.08207","title":"Numerical reasoning in machine reading comprehension tasks: are we there yet?","created":"2021-09-16","cited_by_count":9,"area":null},{"id":"2203.01215","title":"Mukayese: Turkish NLP Strikes Back","created":"2022-03-02","cited_by_count":9,"area":null},{"id":"2210.06799","title":"Benchmarking Long-tail Generalization with Likelihood Splits","created":"2022-10-13","cited_by_count":9,"area":null},{"id":"2203.08445","title":"Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation","created":"2022-03-16","cited_by_count":8,"area":null},{"id":"2105.02486","title":"Towards General Natural Language Understanding with Probabilistic Worldbuilding","created":"2021-05-06","cited_by_count":7,"area":null},{"id":"2305.12544","title":"Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models","created":"2023-05-21","cited_by_count":7,"area":null},{"id":"2306.02870","title":"On \"Scientific Debt\" in NLP: A Case for More Rigour in Language Model Pre-Training Research","created":"2023-06-05","cited_by_count":7,"area":null},{"id":"2508.05776","title":"Whither symbols in the era of advanced neural networks?","created":"2025-08-07","cited_by_count":7,"area":null},{"id":"2111.04260","title":"Personalized Benchmarking with the Ludwig Benchmarking Toolkit","created":"2021-11-08","cited_by_count":6,"area":null},{"id":"2411.02398","title":"Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languages","created":"2024-11-04","cited_by_count":6,"area":null},{"id":"2210.12499","title":"Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLU","created":"2022-10-22","cited_by_count":5,"area":null},{"id":"2301.01269","title":"Average Is Not Enough: Caveats of Multilingual Evaluation","created":"2023-01-03","cited_by_count":5,"area":null},{"id":"2305.18917","title":"Fighting Bias with Bias: Promoting Model Robustness by Amplifying Dataset Biases","created":"2023-05-30","cited_by_count":5,"area":null},{"id":"2306.04610","title":"The Two Word Test: A Semantic Benchmark for Large Language Models","created":"2023-06-07","cited_by_count":5,"area":null},{"id":"2311.18761","title":"Can training neural language models on a curriculum with developmentally plausible data improve alignment with human reading behavior?","created":"2023-11-30","cited_by_count":5,"area":null},{"id":"2112.08609","title":"DuQM: A Chinese Dataset of Linguistically Perturbed Natural Questions for Evaluating the Robustness of Question Matching Models","created":"2021-12-16","cited_by_count":4,"area":null},{"id":"2207.07025","title":"Learning to translate by learning to communicate","created":"2022-07-14","cited_by_count":4,"area":null},{"id":"2311.02777","title":"Robust Generalization Strategies for Morpheme Glossing in an Endangered Language Documentation Context","created":"2023-11-05","cited_by_count":4,"area":null},{"id":"2502.14791","title":"Rapid Word Learning Through Meta In-Context Learning","created":"2025-02-20","cited_by_count":4,"area":null},{"id":"2109.09191","title":"Training Dynamic based data filtering may not work for NLP datasets","created":"2021-09-19","cited_by_count":3,"area":null},{"id":"2210.10684","title":"Language Models Understand Us, Poorly","created":"2022-10-19","cited_by_count":3,"area":null},{"id":"2310.11282","title":"ChapGTP, ILLC's Attempt at Raising a BabyLM: Improving Data Efficiency by Automatic Task Formation","created":"2023-10-17","cited_by_count":3,"area":null},{"id":"2311.06647","title":"Robust Text Classification: Analyzing Prototype-Based Networks","created":"2023-11-11","cited_by_count":3,"area":null},{"id":"2402.08382","title":"Punctuation Restoration Improves Structure Understanding Without Supervision","created":"2024-02-13","cited_by_count":3,"area":null},{"id":"2504.17311","title":"FLUKE: A Linguistically-Driven and Task-Agnostic Framework for Robustness Evaluation","created":"2025-04-24","cited_by_count":3,"area":null},{"id":"2101.07632","title":"Situation and Behavior Understanding by Trope Detection on Films","created":"2021-01-19","cited_by_count":2,"area":null},{"id":"2107.00368","title":"Ensemble Learning-Based Approach for Improving Generalization Capability of Machine Reading Comprehension Systems","created":"2021-07-01","cited_by_count":2,"area":null},{"id":"2201.01845","title":"Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation","created":"2022-01-05","cited_by_count":2,"area":null},{"id":"2204.04042","title":"Checking HateCheck: a cross-functional analysis of behaviour-aware learning for hate speech detection","created":"2022-04-08","cited_by_count":2,"area":null},{"id":"2211.05452","title":"Towards Human-Centred Explainability Benchmarks For Text Classification","created":"2022-11-10","cited_by_count":2,"area":null},{"id":"2305.12951","title":"Cross-functional Analysis of Generalisation in Behavioural Learning","created":"2023-05-22","cited_by_count":2,"area":null},{"id":"2309.00857","title":"Evaluating Transformer's Ability to Learn Mildly Context-Sensitive Languages","created":"2023-09-02","cited_by_count":2,"area":null},{"id":"2406.03666","title":"What Makes Language Models Good-enough?","created":"2024-06-06","cited_by_count":2,"area":null},{"id":"2411.05224","title":"Beyond the Numbers: Transparency in Relation Extraction Benchmark Creation and Leaderboards","created":"2024-11-07","cited_by_count":2,"area":null},{"id":"2504.08590","title":"Playpen: An Environment for Exploring Learning Through Conversational Interaction","created":"2025-04-11","cited_by_count":2,"area":"alignment"},{"id":"2605.27734","title":"Learn from your own latents and not from tokens: A sample-complexity theory","created":"2026-05-26","cited_by_count":2,"area":"diffusion"},{"id":"2103.00854","title":"Vy\\=akarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages","created":"2021-03-01","cited_by_count":1,"area":null},{"id":"2105.01192","title":"Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks","created":"2021-05-03","cited_by_count":1,"area":null},{"id":"2105.05999","title":"Designing Multimodal Datasets for NLP Challenges","created":"2021-05-12","cited_by_count":1,"area":null},{"id":"2210.05038","title":"Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks","created":"2022-10-10","cited_by_count":1,"area":null},{"id":"2210.12958","title":"Composition, Attention, or Both?","created":"2022-10-24","cited_by_count":1,"area":null},{"id":"2305.15130","title":"On Degrees of Freedom in Defining and Testing Natural Language Understanding","created":"2023-05-24","cited_by_count":1,"area":null},{"id":"2407.18738","title":"Towards Generalized Offensive Language Identification","created":"2024-07-26","cited_by_count":1,"area":null},{"id":"2411.05200","title":"Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)","created":"2024-11-07","cited_by_count":1,"area":null},{"id":"2505.12533","title":"Relation Extraction or Pattern Matching? Unravelling the Generalisation Limits of Language Models for Biographical RE","created":"2025-05-18","cited_by_count":1,"area":null},{"id":"2602.04127","title":"From Lemmas to Dependencies: What Signals Drive Light Verbs Classification?","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2105.05091","title":"Towards Using Diachronic Distributed Word Representations as Models of Lexical Development","created":"2021-05-11","cited_by_count":0,"area":null}],"next_cursor":"100"}