{"total":320,"rows":[{"id":"2107.13586","title":"Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing","created":"2021-07-28","cited_by_count":2234,"area":null},{"id":"2210.01936","title":"When and why vision-language models behave like bags-of-words, and what to do about it?","created":"2022-10-04","cited_by_count":610,"area":"mllm"},{"id":"2111.01243","title":"Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey","created":"2021-11-01","cited_by_count":463,"area":null},{"id":"2104.14337","title":"Dynabench: Rethinking Benchmarking in NLP","created":"2021-04-07","cited_by_count":459,"area":null},{"id":"2206.14576","title":"Using cognitive psychology to understand GPT-3","created":"2022-06-21","cited_by_count":398,"area":null},{"id":"2102.01017","title":"Measuring and Improving Consistency in Pretrained Language Models","created":"2021-02-01","cited_by_count":364,"area":null},{"id":"2111.15366","title":"AI and the Everything in the Whole Wide World Benchmark","created":"2021-11-26","cited_by_count":349,"area":null},{"id":"2105.11447","title":"True Few-Shot Learning with Language Models","created":"2021-05-24","cited_by_count":344,"area":null},{"id":"2109.01247","title":"Do Prompt-Based Models Really Understand the Meaning of their Prompts?","created":"2021-09-02","cited_by_count":326,"area":null},{"id":"2106.07139","title":"Pre-Trained Models: Past, Present and Future","created":"2021-06-14","cited_by_count":319,"area":null},{"id":"2307.02477","title":"Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks","created":"2023-07-05","cited_by_count":246,"area":"lr"},{"id":"2104.06644","title":"Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little","created":"2021-04-14","cited_by_count":177,"area":null},{"id":"2204.06031","title":"A Review on Language Models as Knowledge Bases","created":"2022-04-12","cited_by_count":157,"area":null},{"id":"2403.17806","title":"Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms","created":"2024-03-26","cited_by_count":149,"area":null},{"id":"2306.01941","title":"AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap","created":"2023-06-02","cited_by_count":123,"area":null},{"id":"2309.01809","title":"Are Emergent Abilities in Large Language Models just In-Context Learning?","created":"2023-09-04","cited_by_count":109,"area":null},{"id":"2106.09231","title":"Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases","created":"2021-06-17","cited_by_count":107,"area":null},{"id":"2311.00059","title":"The Generative AI Paradox: \"What It Can Create, It May Not Understand\"","created":"2023-10-31","cited_by_count":98,"area":null},{"id":"2303.11504","title":"Language Model Behavior: A Comprehensive Survey","created":"2023-03-20","cited_by_count":92,"area":null},{"id":"2107.12708","title":"QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension","created":"2021-07-27","cited_by_count":91,"area":null},{"id":"2206.09511","title":"The Fallacy of AI Functionality","created":"2022-06-20","cited_by_count":88,"area":null},{"id":"2208.12415","title":"MuLan: A Joint Embedding of Music Audio and Natural Language","created":"2022-08-26","cited_by_count":87,"area":null},{"id":"2204.13807","title":"A very preliminary analysis of DALL-E 2","created":"2022-04-25","cited_by_count":82,"area":null},{"id":"2310.05338","title":"Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Models","created":"2023-10-09","cited_by_count":80,"area":"mllm"},{"id":"2306.08189","title":"Language models are not naysayers: An analysis of language models on negation benchmarks","created":"2023-06-14","cited_by_count":74,"area":null},{"id":"2102.13249","title":"Chess as a Testbed for Language Model State Tracking","created":"2021-02-26","cited_by_count":72,"area":null},{"id":"2101.00403","title":"Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words","created":"2021-01-02","cited_by_count":63,"area":null},{"id":"2204.08831","title":"Probing for the Usage of Grammatical Number","created":"2022-04-19","cited_by_count":59,"area":null},{"id":"2209.12711","title":"Can Large Language Models Truly Understand Prompts? A Case Study with Negated Prompts","created":"2022-09-26","cited_by_count":59,"area":null},{"id":"2203.13112","title":"minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models","created":"2022-03-24","cited_by_count":58,"area":null},{"id":"2109.14723","title":"BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief","created":"2021-09-29","cited_by_count":57,"area":null},{"id":"2207.14251","title":"Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions","created":"2022-07-28","cited_by_count":57,"area":null},{"id":"2105.04949","title":"BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?","created":"2021-05-11","cited_by_count":56,"area":null},{"id":"2105.13947","title":"Changing the World by Changing the Data","created":"2021-05-28","cited_by_count":51,"area":null},{"id":"2304.02711","title":"Structured prompt interrogation and recursive extraction of semantics (SPIRES): A method for populating knowledge bases using zero-shot learning","created":"2023-04-05","cited_by_count":50,"area":null},{"id":"2212.10020","title":"On the Blind Spots of Model-Based Evaluation Metrics for Text Generation","created":"2022-12-20","cited_by_count":49,"area":null},{"id":"2106.03634","title":"PROST: Physical Reasoning of Objects through Space and Time","created":"2021-06-07","cited_by_count":48,"area":null},{"id":"2108.04657","title":"Differentiable Subset Pruning of Transformer Heads","created":"2021-08-10","cited_by_count":47,"area":null},{"id":"2110.06696","title":"Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese","created":"2021-10-13","cited_by_count":45,"area":null},{"id":"2212.01488","title":"Event knowledge in large language models: the gap between the impossible and the unlikely","created":"2022-12-02","cited_by_count":45,"area":null},{"id":"2302.12313","title":"Testing AI on language comprehension tasks reveals insensitivity to underlying meaning","created":"2023-02-23","cited_by_count":45,"area":null},{"id":"2109.14989","title":"Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations","created":"2021-09-30","cited_by_count":44,"area":null},{"id":"2403.01509","title":"Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semantics","created":"2024-03-03","cited_by_count":44,"area":null},{"id":"2110.02406","title":"Word Acquisition in Neural Language Models","created":"2021-10-05","cited_by_count":41,"area":null},{"id":"2203.00633","title":"Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale","created":"2022-03-01","cited_by_count":41,"area":null},{"id":"2212.10785","title":"SERENGETI: Massively Multilingual Language Models for Africa","created":"2022-12-21","cited_by_count":40,"area":null},{"id":"2203.08929","title":"An Analysis of Negation in Natural Language Understanding Corpora","created":"2022-03-16","cited_by_count":39,"area":null},{"id":"2211.00295","title":"CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negation","created":"2022-11-01","cited_by_count":39,"area":null},{"id":"2201.12438","title":"Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey","created":"2022-01-28","cited_by_count":38,"area":null},{"id":"2311.16093","title":"Visual cognition in multimodal large language models","created":"2023-11-27","cited_by_count":38,"area":"mllm"},{"id":"2204.04541","title":"KOBEST: Korean Balanced Evaluation of Significant Tasks","created":"2022-04-09","cited_by_count":37,"area":null},{"id":"2303.06273","title":"Consistency Analysis of ChatGPT","created":"2023-03-11","cited_by_count":37,"area":null},{"id":"2306.12105","title":"Mass-Producing Failures of Multimodal Systems with Language Models","created":"2023-06-21","cited_by_count":36,"area":null},{"id":"2405.15750","title":"Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence","created":"2024-05-24","cited_by_count":35,"area":null},{"id":"2104.08161","title":"Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema","created":"2021-04-16","cited_by_count":32,"area":null},{"id":"2105.02987","title":"Do language models learn typicality judgments from text?","created":"2021-05-06","cited_by_count":32,"area":null},{"id":"2110.08182","title":"The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color","created":"2021-10-15","cited_by_count":32,"area":null},{"id":"2305.05976","title":"Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge","created":"2023-05-10","cited_by_count":32,"area":null},{"id":"2105.13818","title":"Language Models Use Monotonicity to Assess NPI Licensing","created":"2021-05-28","cited_by_count":31,"area":null},{"id":"2203.12258","title":"Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View","created":"2022-03-23","cited_by_count":31,"area":null},{"id":"2210.12889","title":"DALL-E 2 Fails to Reliably Capture Common Syntactic Processes","created":"2022-10-23","cited_by_count":31,"area":null},{"id":"2101.04640","title":"Dimensions of Commonsense Knowledge","created":"2021-01-12","cited_by_count":29,"area":null},{"id":"2104.05433","title":"Multilingual Language Models Predict Human Reading Behavior","created":"2021-04-12","cited_by_count":29,"area":null},{"id":"2301.06627","title":"Dissociating language and thought in large language models","created":"2023-01-16","cited_by_count":29,"area":"lr"},{"id":"2305.07614","title":"NevIR: Negation in Neural Information Retrieval","created":"2023-05-12","cited_by_count":29,"area":null},{"id":"2109.10540","title":"Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing","created":"2021-09-22","cited_by_count":28,"area":null},{"id":"2104.12874","title":"Accounting for Agreement Phenomena in Sentence Comprehension with Transformer Language Models: Effects of Similarity-based Interference on Surprisal and Attention","created":"2021-04-26","cited_by_count":27,"area":null},{"id":"2109.12393","title":"Sorting through the noise: Testing robustness of information processing in pre-trained language models","created":"2021-09-25","cited_by_count":27,"area":null},{"id":"2109.10246","title":"Does Vision-and-Language Pretraining Improve Lexical Grounding?","created":"2021-09-21","cited_by_count":25,"area":null},{"id":"2202.12246","title":"Neural reality of argument structure constructions","created":"2022-02-24","cited_by_count":25,"area":null},{"id":"2210.03256","title":"Not another Negation Benchmark: The NaN-NLI Test Suite for Sub-clausal Negation","created":"2022-10-06","cited_by_count":25,"area":null},{"id":"2105.07452","title":"How is BERT surprised? Layerwise detection of linguistic anomalies","created":"2021-05-16","cited_by_count":24,"area":null},{"id":"2109.06987","title":"NOPE: A Corpus of Naturally-Occurring Presuppositions in English","created":"2021-09-14","cited_by_count":23,"area":null},{"id":"2205.03472","title":"When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it","created":"2022-05-06","cited_by_count":23,"area":null},{"id":"2303.07616","title":"The Life Cycle of Knowledge in Big Language Models: A Survey","created":"2023-03-14","cited_by_count":23,"area":null},{"id":"2102.10934","title":"Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks","created":"2021-02-22","cited_by_count":22,"area":null},{"id":"2301.12564","title":"A Discerning Several Thousand Judgments: GPT-3 Rates the Article + Adjective + Numeral + Noun Construction","created":"2023-01-29","cited_by_count":22,"area":null},{"id":"2308.12898","title":"Can Linguistic Knowledge Improve Multimodal Alignment in Vision-Language Pretraining?","created":"2023-08-24","cited_by_count":21,"area":"mllm"},{"id":"2106.07935","title":"BERT Embeddings for Automatic Readability Assessment","created":"2021-06-15","cited_by_count":19,"area":null},{"id":"2310.08256","title":"Impact of Co-occurrence on Factual Knowledge of Large Language Models","created":"2023-10-12","cited_by_count":19,"area":null},{"id":"2106.09069","title":"Automatic Construction of Evaluation Suites for Natural Language Generation Datasets","created":"2021-06-16","cited_by_count":18,"area":null},{"id":"2209.15093","title":"Unpacking Large Language Models with Conceptual Consistency","created":"2022-09-29","cited_by_count":18,"area":null},{"id":"2305.09144","title":"Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models","created":"2023-05-16","cited_by_count":18,"area":null},{"id":"2206.01532","title":"Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization","created":"2022-06-03","cited_by_count":17,"area":"lr"},{"id":"2305.16784","title":"Incorporating Distributions of Discourse Structure for Long Document Abstractive Summarization","created":"2023-05-26","cited_by_count":17,"area":null},{"id":"2306.13651","title":"Bring Your Own Data! Self-Supervised Evaluation for Large Language Models","created":"2023-06-23","cited_by_count":17,"area":null},{"id":"2307.13989","title":"This is not correct! Negation-aware Evaluation of Language Generation Systems","created":"2023-07-26","cited_by_count":17,"area":null},{"id":"2203.10415","title":"How does the pre-training objective affect what large language models learn about linguistic properties?","created":"2022-03-20","cited_by_count":16,"area":null},{"id":"2205.00132","title":"Learn to Understand Negation in Video Retrieval","created":"2022-04-30","cited_by_count":16,"area":null},{"id":"2101.09115","title":"The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT","created":"2021-01-22","cited_by_count":15,"area":null},{"id":"2105.13471","title":"Inspecting the concept knowledge graph encoded by modern language models","created":"2021-05-27","cited_by_count":15,"area":null},{"id":"2210.15221","title":"TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack","created":"2022-10-27","cited_by_count":15,"area":null},{"id":"2305.14250","title":"Language Models with Rationality","created":"2023-05-23","cited_by_count":15,"area":null},{"id":"2305.19589","title":"SLABERT Talk Pretty One Day: Modeling Second Language Acquisition with BERT","created":"2023-05-31","cited_by_count":15,"area":null},{"id":"2404.14883","title":"Language in Vivo vs. in Silico: Size Matters but Larger Language Models Still Do Not Comprehend Language on a Par with Humans Due to Impenetrable Semantic Reference","created":"2024-04-23","cited_by_count":15,"area":null},{"id":"2406.05494","title":"Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negation","created":"2024-06-08","cited_by_count":15,"area":null},{"id":"2412.16100","title":"Logical Consistency of Large Language Models in Fact-checking","created":"2024-12-20","cited_by_count":15,"area":null},{"id":"2104.07578","title":"Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models","created":"2021-04-15","cited_by_count":14,"area":null},{"id":"2107.09648","title":"Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?","created":"2021-07-20","cited_by_count":14,"area":null},{"id":"2203.08565","title":"Geographic Adaptation of Pretrained Language Models","created":"2022-03-16","cited_by_count":14,"area":null}],"next_cursor":"100"}