{"total":314,"rows":[{"id":"2302.04023","title":"A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity","created":"2023-02-08","cited_by_count":894,"area":"lr"},{"id":"2302.00093","title":"Large Language Models Can Be Easily Distracted by Irrelevant Context","created":"2023-01-31","cited_by_count":841,"area":null},{"id":"2212.09251","title":"Discovering Language Model Behaviors with Model-Written Evaluations","created":"2022-12-19","cited_by_count":836,"area":"alignment"},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629,"area":null},{"id":"2210.13382","title":"Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task","created":"2022-10-24","cited_by_count":431,"area":null},{"id":"2305.16264","title":"Scaling Data-Constrained Language Models","created":"2023-05-25","cited_by_count":403,"area":null},{"id":"2210.01240","title":"Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought","created":"2022-10-03","cited_by_count":337,"area":"lr"},{"id":"2205.09712","title":"Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning","created":"2022-05-19","cited_by_count":334,"area":"lr"},{"id":"2308.16884","title":"The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants","created":"2023-08-31","cited_by_count":311,"area":null},{"id":"2406.10149","title":"BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack","created":"2024-06-14","cited_by_count":215,"area":"lr"},{"id":"2310.16049","title":"MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning","created":"2023-10-24","cited_by_count":201,"area":"lr"},{"id":"2203.14072","title":"Learning to Answer Questions in Dynamic Audio-Visual Scenarios","created":"2022-03-26","cited_by_count":191,"area":null},{"id":"2205.03401","title":"The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning","created":"2022-05-06","cited_by_count":169,"area":"lr"},{"id":"2107.05407","title":"PonderNet: Learning to Ponder","created":"2021-07-12","cited_by_count":168,"area":null},{"id":"2305.14763","title":"Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models","created":"2023-05-24","cited_by_count":163,"area":"lr"},{"id":"2402.14848","title":"Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models","created":"2024-02-19","cited_by_count":152,"area":"lr"},{"id":"2502.19187","title":"BIG-Bench Extra Hard","created":"2025-02-26","cited_by_count":125,"area":"lr"},{"id":"2305.10626","title":"Language Models Meet World Models: Embodied Experiences Enhance Language Models","created":"2023-05-18","cited_by_count":124,"area":"wm"},{"id":"2204.05660","title":"NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks","created":"2022-04-12","cited_by_count":112,"area":"lr"},{"id":"2401.07927","title":"Are self-explanations from Large Language Models faithful?","created":"2024-01-15","cited_by_count":101,"area":null},{"id":"2304.11062","title":"Scaling Transformer to 1M tokens and beyond with RMT","created":"2023-04-19","cited_by_count":98,"area":null},{"id":"2410.19258","title":"Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning","created":"2024-10-25","cited_by_count":97,"area":"lr"},{"id":"2107.12708","title":"QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension","created":"2021-07-27","cited_by_count":91,"area":null},{"id":"2107.02794","title":"Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning","created":"2021-07-06","cited_by_count":85,"area":null},{"id":"2104.05832","title":"SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning","created":"2021-04-12","cited_by_count":77,"area":null},{"id":"2104.00783","title":"Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems","created":"2021-04-01","cited_by_count":75,"area":null},{"id":"2310.16787","title":"The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI","created":"2023-10-25","cited_by_count":73,"area":null},{"id":"2102.13249","title":"Chess as a Testbed for Language Model State Tracking","created":"2021-02-26","cited_by_count":72,"area":null},{"id":"2307.08689","title":"COLLIE: Systematic Construction of Constrained Text Generation Tasks","created":"2023-07-17","cited_by_count":70,"area":null},{"id":"2310.07064","title":"Large Language Models can Learn Rules","created":"2023-10-10","cited_by_count":69,"area":null},{"id":"2204.08292","title":"StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts","created":"2022-04-18","cited_by_count":68,"area":"lr"},{"id":"2202.07654","title":"Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation","created":"2022-02-15","cited_by_count":67,"area":null},{"id":"2404.03622","title":"Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models","created":"2024-04-04","cited_by_count":66,"area":"lr"},{"id":"2306.09841","title":"Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond","created":"2023-06-16","cited_by_count":65,"area":"lr"},{"id":"2406.14491","title":"Instruction Pre-Training: Language Models are Supervised Multitask Learners","created":"2024-06-20","cited_by_count":63,"area":null},{"id":"2303.14725","title":"Natural Language Reasoning, A Survey","created":"2023-03-26","cited_by_count":61,"area":"lr"},{"id":"2307.07696","title":"Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text","created":"2023-07-15","cited_by_count":59,"area":"lr"},{"id":"2406.07230","title":"Needle In A Multimodal Haystack","created":"2024-06-11","cited_by_count":58,"area":"mllm"},{"id":"2405.09605","title":"Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models","created":"2024-05-15","cited_by_count":55,"area":"wm"},{"id":"2402.06044","title":"OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models","created":"2024-02-08","cited_by_count":54,"area":"lr"},{"id":"2406.02537","title":"TopViewRS: Vision-Language Models as Top-View Spatial Reasoners","created":"2024-06-04","cited_by_count":49,"area":"lr"},{"id":"2212.10758","title":"ORCA: A Challenging Benchmark for Arabic Language Understanding","created":"2022-12-21","cited_by_count":47,"area":null},{"id":"2205.01128","title":"Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems","created":"2022-05-02","cited_by_count":44,"area":null},{"id":"2305.02363","title":"Entity Tracking in Language Models","created":"2023-05-03","cited_by_count":44,"area":null},{"id":"2306.07934","title":"BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Information","created":"2023-06-13","cited_by_count":44,"area":"lr"},{"id":"2201.12114","title":"Rethinking Attention-Model Explainability through Faithfulness Violation Test","created":"2022-01-28","cited_by_count":43,"area":null},{"id":"2310.04444","title":"What's the Magic Word? A Control Theory of LLM Prompting","created":"2023-10-02","cited_by_count":41,"area":null},{"id":"2109.02593","title":"General-Purpose Question-Answering with Macaw","created":"2021-09-06","cited_by_count":40,"area":null},{"id":"2511.02817","title":"Oolong: Evaluating Long Context Reasoning and Aggregation Capabilities","created":"2025-11-04","cited_by_count":40,"area":null},{"id":"2201.12382","title":"Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matrices","created":"2022-01-28","cited_by_count":37,"area":"lr"},{"id":"2402.10790","title":"In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss","created":"2024-02-16","cited_by_count":36,"area":null},{"id":"2310.00836","title":"Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models","created":"2023-10-02","cited_by_count":35,"area":"lr"},{"id":"2210.16952","title":"Transfer Learning with Synthetic Corpora for Spatial Role Labeling and Reasoning","created":"2022-10-30","cited_by_count":34,"area":"lr"},{"id":"2305.12477","title":"GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Prompts","created":"2023-05-21","cited_by_count":34,"area":"lr"},{"id":"2405.02134","title":"Optimising Calls to Large Language Models with Uncertainty-Based Two-Tier Selection","created":"2024-05-03","cited_by_count":33,"area":null},{"id":"2512.17351","title":"Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers","created":"2025-12-19","cited_by_count":33,"area":null},{"id":"2107.03992","title":"A Long Short-Term Memory for AI Applications in Spike-based Neuromorphic Hardware","created":"2021-07-08","cited_by_count":32,"area":null},{"id":"2309.12444","title":"Foundation Metrics for Evaluating Effectiveness of Healthcare Conversations Powered by Generative AI","created":"2023-09-21","cited_by_count":32,"area":null},{"id":"2110.08412","title":"Evaluating the Faithfulness of Importance Measures in NLP by Recursively Masking Allegedly Important Tokens and Retraining","created":"2021-10-15","cited_by_count":31,"area":null},{"id":"2405.20535","title":"Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoning","created":"2024-05-30","cited_by_count":31,"area":"lr"},{"id":"2405.21068","title":"Code Pretraining Improves Entity Tracking Abilities of Language Models","created":"2024-05-31","cited_by_count":31,"area":null},{"id":"2305.00833","title":"Learning to Reason and Memorize with Self-Notes","created":"2023-05-01","cited_by_count":30,"area":"lr"},{"id":"2203.10261","title":"FaiRR: Faithful and Robust Deductive Reasoning over Natural Language","created":"2022-03-19","cited_by_count":29,"area":"lr"},{"id":"2406.00936","title":"A Survey of Useful LLM Evaluation","created":"2024-06-03","cited_by_count":29,"area":null},{"id":"2411.12498","title":"Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus","created":"2024-11-19","cited_by_count":29,"area":"lr"},{"id":"2305.15068","title":"ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind","created":"2023-05-24","cited_by_count":28,"area":null},{"id":"2508.17298","title":"Explain Before You Answer: A Survey on Compositional Visual Reasoning","created":"2025-08-24","cited_by_count":28,"area":"lr"},{"id":"2109.12393","title":"Sorting through the noise: Testing robustness of information processing in pre-trained language models","created":"2021-09-25","cited_by_count":27,"area":null},{"id":"2401.03991","title":"Advancing Spatial Reasoning in Large Language Models: An In-Depth Evaluation and Enhancement Using the StepGame Benchmark","created":"2024-01-08","cited_by_count":27,"area":"lr"},{"id":"2101.10421","title":"English Machine Reading Comprehension Datasets: A Survey","created":"2021-01-25","cited_by_count":26,"area":null},{"id":"2109.13006","title":"RuleBert: Teaching Soft Rules to Pre-trained Language Models","created":"2021-09-24","cited_by_count":25,"area":null},{"id":"2505.00026","title":"Theory of Mind in Large Language Models: Assessment and Enhancement","created":"2025-04-26","cited_by_count":25,"area":null},{"id":"2107.09106","title":"Separating Skills and Concepts for Novel Visual Question Answering","created":"2021-07-19","cited_by_count":24,"area":null},{"id":"2206.15030","title":"Modern Question Answering Datasets and Benchmarks: A Survey","created":"2022-06-30","cited_by_count":23,"area":null},{"id":"2301.10896","title":"Causal Reasoning of Entities and Events in Procedural Texts","created":"2023-01-26","cited_by_count":23,"area":"lr"},{"id":"2406.12158","title":"LLMs Are Prone to Fallacies in Causal Inference","created":"2024-06-18","cited_by_count":23,"area":null},{"id":"2507.02782","title":"Understanding and Improving Length Generalization in Recurrent Models","created":"2025-07-03","cited_by_count":23,"area":null},{"id":"2511.15722","title":"Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods","created":"2025-11-14","cited_by_count":23,"area":"lr"},{"id":"2104.07635","title":"Time-Stamped Language Model: Teaching Language Models to Understand the Flow of Events","created":"2021-04-15","cited_by_count":22,"area":null},{"id":"2211.02069","title":"LMentry: A Language Model Benchmark of Elementary Language Tasks","created":"2022-11-03","cited_by_count":22,"area":null},{"id":"2309.03852","title":"FLM-101B: An Open LLM and How to Train It with $100K Budget","created":"2023-09-07","cited_by_count":22,"area":null},{"id":"2502.07827","title":"Implicit Language Models are RNNs: Balancing Parallelization and Expressivity","created":"2025-02-10","cited_by_count":22,"area":"lr"},{"id":"2102.01065","title":"Do Question Answering Modeling Improvements Hold Across Benchmarks?","created":"2021-02-01","cited_by_count":20,"area":null},{"id":"2106.01074","title":"Database Reasoning Over Text","created":"2021-06-02","cited_by_count":20,"area":null},{"id":"2311.15930","title":"WorldSense: A Synthetic Benchmark for Grounded Reasoning in Large Language Models","created":"2023-11-27","cited_by_count":20,"area":"wm"},{"id":"2505.15801","title":"VerifyBench: Benchmarking Reference-based Reward Systems for Large Language Models","created":"2025-05-21","cited_by_count":20,"area":"lr"},{"id":"2405.03146","title":"Quantifying the Capabilities of LLMs across Scale and Precision","created":"2024-05-06","cited_by_count":19,"area":null},{"id":"2407.16695","title":"Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack","created":"2024-07-23","cited_by_count":19,"area":null},{"id":"2602.07055","title":"Theory of Space: Can Foundation Models Construct Spatial Beliefs through Active Exploration?","created":"2026-02-04","cited_by_count":19,"area":null},{"id":"2110.02370","title":"Leveraging the Inductive Bias of Large Language Models for Abstract Textual Reasoning","created":"2021-10-05","cited_by_count":18,"area":null},{"id":"2112.09054","title":"Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability","created":"2021-12-16","cited_by_count":18,"area":null},{"id":"2305.03353","title":"MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic","created":"2023-05-05","cited_by_count":18,"area":null},{"id":"2308.07336","title":"Learning Deductive Reasoning from Synthetic Corpus based on Formal Logic","created":"2023-08-11","cited_by_count":18,"area":"lr"},{"id":"2212.08286","title":"ALERT: Adapting Language Models to Reasoning Tasks","created":"2022-12-16","cited_by_count":17,"area":"lr"},{"id":"2405.15064","title":"Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning","created":"2024-05-23","cited_by_count":17,"area":"lr"},{"id":"2203.09161","title":"How Many Data Samples is an Additional Instruction Worth?","created":"2022-03-17","cited_by_count":16,"area":null},{"id":"2401.03321","title":"PIXAR: Auto-Regressive Language Modeling in Pixel Space","created":"2024-01-06","cited_by_count":16,"area":null},{"id":"2406.00252","title":"Towards Rationality in Language and Multimodal Agents: A Survey","created":"2024-06-01","cited_by_count":16,"area":"agents"},{"id":"2106.01354","title":"multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning","created":"2021-06-02","cited_by_count":15,"area":null},{"id":"2207.14000","title":"Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisation","created":"2022-07-28","cited_by_count":15,"area":"lr"}],"next_cursor":"100"}