{"list":"other","total":162,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1301.3781","title":"Efficient Estimation of Word Representations in Vector Space","created":"2013-01-16","cited_by_count":4375},{"id":"2205.11916","title":"Large Language Models are Zero-Shot Reasoners","created":"2022-05-24","cited_by_count":4374},{"id":"2307.03172","title":"Lost in the Middle: How Language Models Use Long Contexts","created":"2023-07-06","cited_by_count":3455},{"id":"1906.08237","title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","created":"2019-06-19","cited_by_count":2811},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2004.07780","title":"Shortcut Learning in Deep Neural Networks","created":"2020-04-16","cited_by_count":1969},{"id":"2107.03006","title":"Structured Denoising Diffusion Models in Discrete State-Spaces","created":"2021-07-07","cited_by_count":1719},{"id":"2211.17192","title":"Fast Inference from Transformers via Speculative Decoding","created":"2022-11-30","cited_by_count":1653},{"id":"1904.01038","title":"fairseq: A Fast, Extensible Toolkit for Sequence Modeling","created":"2019-04-01","cited_by_count":1488},{"id":"2112.11446","title":"Scaling Language Models: Methods, Analysis & Insights from Training Gopher","created":"2021-12-08","cited_by_count":1202},{"id":"2210.03350","title":"Measuring and Narrowing the Compositionality Gap in Language Models","created":"2022-10-07","cited_by_count":1075},{"id":"2201.07207","title":"Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents","created":"2022-01-18","cited_by_count":1035},{"id":"2302.01318","title":"Accelerating Large Language Model Decoding with Speculative Sampling","created":"2023-02-02","cited_by_count":1006},{"id":"2112.00114","title":"Show Your Work: Scratchpads for Intermediate Computation with Language Models","created":"2021-11-30","cited_by_count":886},{"id":"2305.14992","title":"Reasoning with Language Model is Planning with World Model","created":"2023-05-24","cited_by_count":861},{"id":"2401.10774","title":"Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads","created":"2024-01-19","cited_by_count":843},{"id":"2302.00093","title":"Large Language Models Can Be Easily Distracted by Irrelevant Context","created":"2023-01-31","cited_by_count":841},{"id":"1907.10529","title":"SpanBERT: Improving Pre-training by Representing and Predicting Spans","created":"2019-07-24","cited_by_count":834},{"id":"1506.03099","title":"Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks","created":"2015-06-09","cited_by_count":803},{"id":"2101.02235","title":"Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies","created":"2021-01-06","cited_by_count":743},{"id":"2406.00515","title":"A Survey on Large Language Models for Code Generation","created":"2024-06-01","cited_by_count":658},{"id":"2403.14608","title":"Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey","created":"2024-03-21","cited_by_count":656},{"id":"2303.08112","title":"Eliciting Latent Predictions from Transformers with the Tuned Lens","created":"2023-03-14","cited_by_count":623},{"id":"2308.10792","title":"Instruction Tuning for Large Language Models: A Survey","created":"2023-08-21","cited_by_count":623},{"id":"1511.06349","title":"Generating Sentences from a Continuous Space","created":"2015-11-19","cited_by_count":612},{"id":"2410.05229","title":"GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models","created":"2024-10-07","cited_by_count":550},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"2305.18654","title":"Faith and Fate: Limits of Transformers on Compositionality","created":"2023-05-29","cited_by_count":503},{"id":"1711.02281","title":"Non-Autoregressive Neural Machine Translation","created":"2017-11-07","cited_by_count":463},{"id":"2309.12288","title":"The Reversal Curse: LLMs trained on \"A is B\" fail to learn \"B is A\"","created":"2023-09-21","cited_by_count":407},{"id":"1912.10077","title":"Are Transformers universal approximators of sequence-to-sequence functions?","created":"2019-12-20","cited_by_count":406},{"id":"2206.10498","title":"PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change","created":"2022-06-21","cited_by_count":382},{"id":"2404.19737","title":"Better & Faster Large Language Models via Multi-token Prediction","created":"2024-04-30","cited_by_count":360},{"id":"2205.09712","title":"Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning","created":"2022-05-19","cited_by_count":334},{"id":"2305.19466","title":"The Impact of Positional Encoding on Length Generalization in Transformers","created":"2023-05-31","cited_by_count":327},{"id":"2305.15771","title":"On the Planning Abilities of Large Language Models : A Critical Investigation","created":"2023-05-25","cited_by_count":312},{"id":"2305.15408","title":"Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective","created":"2023-05-24","cited_by_count":294},{"id":"2309.14316","title":"Physics of Language Models: Part 3.1, Knowledge Storage and Extraction","created":"2023-09-25","cited_by_count":270},{"id":"2310.02226","title":"Think before you speak: Training Language Models With Pause Tokens","created":"2023-10-03","cited_by_count":264},{"id":"2409.12183","title":"To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning","created":"2024-09-18","cited_by_count":263},{"id":"2402.12875","title":"Chain of Thought Empowers Transformers to Solve Inherently Serial Problems","created":"2024-02-20","cited_by_count":260},{"id":"2212.09597","title":"Reasoning with Language Model Prompting: A Survey","created":"2022-12-19","cited_by_count":252},{"id":"2305.10037","title":"Can Language Models Solve Graph Problems in Natural Language?","created":"2023-05-17","cited_by_count":252},{"id":"2305.14078","title":"Large Language Models as Commonsense Knowledge for Large-Scale Task Planning","created":"2023-05-23","cited_by_count":231},{"id":"2001.04063","title":"ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training","created":"2020-01-13","cited_by_count":222},{"id":"2212.10001","title":"Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters","created":"2022-12-20","cited_by_count":222},{"id":"2207.02098","title":"Neural Networks and the Chomsky Hierarchy","created":"2022-07-05","cited_by_count":217},{"id":"2402.01032","title":"Repeat After Me: Transformers are Better than State Space Models at Copying","created":"2024-02-01","cited_by_count":216},{"id":"1908.11775","title":"Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernel","created":"2019-08-30","cited_by_count":213},{"id":"2305.15066","title":"GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarking","created":"2023-05-24","cited_by_count":210},{"id":"2402.10200","title":"Chain-of-Thought Reasoning Without Prompting","created":"2024-02-15","cited_by_count":210},{"id":"2310.16028","title":"What Algorithms can Transformers Learn? A Study in Length Generalization","created":"2023-10-24","cited_by_count":199},{"id":"2312.02783","title":"Large Language Models on Graphs: A Comprehensive Survey","created":"2023-12-05","cited_by_count":192},{"id":"2404.15758","title":"Let's Think Dot by Dot: Hidden Computation in Transformer Language Models","created":"2024-04-24","cited_by_count":191},{"id":"2106.06981","title":"Thinking Like Transformers","created":"2021-06-13","cited_by_count":184},{"id":"2309.15402","title":"Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future","created":"2023-09-27","cited_by_count":184},{"id":"1512.05287","title":"A Theoretically Grounded Application of Dropout in Recurrent Neural Networks","created":"2015-12-16","cited_by_count":161},{"id":"2210.07128","title":"Language Models of Code are Few-Shot Commonsense Learners","created":"2022-10-13","cited_by_count":160},{"id":"2403.06963","title":"The pitfalls of next-token prediction","created":"2024-03-11","cited_by_count":160},{"id":"2203.16634","title":"Transformer Language Models without Positional Encodings Still Learn Positional Information","created":"2022-03-30","cited_by_count":150},{"id":"2411.14405","title":"Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions","created":"2024-11-21","cited_by_count":144},{"id":"2407.11511","title":"Multi-Step Reasoning with Large Language Models, a Survey","created":"2024-07-16","cited_by_count":143},{"id":"2402.08115","title":"On the Self-Verification Limitations of Large Language Models on Reasoning and Planning Tasks","created":"2024-02-12","cited_by_count":142},{"id":"2212.09420","title":"Large Language Models Meet NL2Code: A Survey","created":"2022-12-19","cited_by_count":138},{"id":"2410.14157","title":"Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning","created":"2024-10-18","cited_by_count":135},{"id":"2007.06778","title":"An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models","created":"2020-07-14","cited_by_count":134},{"id":"2306.02896","title":"Representational Strengths and Limitations of Transformers","created":"2023-06-05","cited_by_count":133},{"id":"2311.00208","title":"What Formal Languages Can Transformers Express? A Survey","created":"2023-11-01","cited_by_count":124},{"id":"2311.04897","title":"Future Lens: Anticipating Subsequent Tokens from a Single Hidden State","created":"2023-11-08","cited_by_count":121},{"id":"2305.16843","title":"Randomized Positional Encodings Boost Length Generalization of Transformers","created":"2023-05-26","cited_by_count":117},{"id":"2202.12172","title":"Overcoming a Theoretical Limitation of Self-Attention","created":"2022-02-24","cited_by_count":113},{"id":"2301.05062","title":"Tracr: Compiled Transformers as a Laboratory for Interpretability","created":"2023-01-12","cited_by_count":104},{"id":"2309.17167","title":"DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks","created":"2023-09-29","cited_by_count":101},{"id":"2012.15833","title":"Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade","created":"2020-12-31","cited_by_count":99},{"id":"1905.04226","title":"Language Modeling with Deep Transformers","created":"2019-05-10","cited_by_count":96},{"id":"2409.13373","title":"LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench","created":"2024-09-20","cited_by_count":94},{"id":"2204.06618","title":"Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexity","created":"2022-04-13","cited_by_count":93},{"id":"2303.09435","title":"Jump to Conclusions: Short-Cutting Transformers With Linear Transformations","created":"2023-03-16","cited_by_count":90},{"id":"2312.14890","title":"NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes","created":"2023-12-22","cited_by_count":79},{"id":"2402.09963","title":"Why are Sensitive Functions Hard for Transformers?","created":"2024-02-15","cited_by_count":74},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73},{"id":"2406.11050","title":"A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners","created":"2024-06-16","cited_by_count":73},{"id":"2209.07661","title":"On the Relation between Sensitivity and Accuracy in In-context Learning","created":"2022-09-16","cited_by_count":72},{"id":"2405.08011","title":"A Survey of Large Language Models for Graphs","created":"2024-05-10","cited_by_count":72},{"id":"1909.04739","title":"WIQA: A dataset for \"What if...\" reasoning over procedural text","created":"2019-09-10","cited_by_count":71},{"id":"2211.12316","title":"Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions","created":"2022-11-22","cited_by_count":70},{"id":"2210.02671","title":"A Logic for Expressing Log-Precision Transformers","created":"2022-10-06","cited_by_count":67},{"id":"2405.18512","title":"Understanding Transformer Reasoning Capabilities via Graph Algorithms","created":"2024-05-28","cited_by_count":67},{"id":"2104.07644","title":"ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoning","created":"2021-04-15","cited_by_count":58},{"id":"2403.04483","title":"GraphInstruct: Empowering Large Language Models with Graph Understanding and Reasoning Capability","created":"2024-03-07","cited_by_count":58},{"id":"2402.08785","title":"InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignment","created":"2024-02-13","cited_by_count":56},{"id":"2410.08633","title":"Transformers Provably Solve Parity Efficiently with Chain of Thought","created":"2024-10-11","cited_by_count":50},{"id":"2311.13581","title":"PaSS: Parallel Speculative Sampling","created":"2023-11-22","cited_by_count":49},{"id":"2403.13799","title":"Reverse Training to Nurse the Reversal Curse","created":"2024-03-20","cited_by_count":49},{"id":"2404.00859","title":"Do language models plan ahead for future tokens?","created":"2024-04-01","cited_by_count":49},{"id":"2407.00379","title":"GraphArena: Evaluating and Exploring Large Language Models on Graph Computation","created":"2024-06-29","cited_by_count":49},{"id":"2404.12224","title":"Length Generalization of Causal Transformers without Position Encoding","created":"2024-04-18","cited_by_count":47},{"id":"2406.15992","title":"Can LLM Graph Reasoning Generalize beyond Pattern Memorization?","created":"2024-06-23","cited_by_count":47}],"next_cursor":"100"}