{"list":"other","total":117,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2307.03172","title":"Lost in the Middle: How Language Models Use Long Contexts","created":"2023-07-06","cited_by_count":3455},{"id":"2004.05150","title":"Longformer: The Long-Document Transformer","created":"2020-04-10","cited_by_count":3413},{"id":"2310.06770","title":"SWE-bench: Can Language Models Resolve Real-World GitHub Issues?","created":"2023-10-10","cited_by_count":3373},{"id":"2403.07974","title":"LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code","created":"2024-03-12","cited_by_count":2004},{"id":"2404.14219","title":"Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone","created":"2024-04-22","cited_by_count":1917},{"id":"2404.06654","title":"RULER: What's the Real Context Size of Your Long-Context Language Models?","created":"2024-04-09","cited_by_count":1346},{"id":"2405.21060","title":"Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality","created":"2024-05-31","cited_by_count":1336},{"id":"2401.14196","title":"DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence","created":"2024-01-25","cited_by_count":1181},{"id":"2406.17557","title":"The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale","created":"2024-06-25","cited_by_count":1160},{"id":"2411.15124","title":"Tulu 3: Pushing Frontiers in Open Language Model Post-Training","created":"2024-11-22","cited_by_count":1053},{"id":"2404.14469","title":"SnapKV: LLM Knows What You are Looking for Before Generation","created":"2024-04-22","cited_by_count":880},{"id":"2305.14233","title":"Enhancing Chat Language Models by Scaling High-quality Instructional Conversations","created":"2023-05-23","cited_by_count":839},{"id":"2410.10813","title":"LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory","created":"2024-10-14","cited_by_count":707},{"id":"2405.01470","title":"WildChat: 1M ChatGPT Interaction Logs in the Wild","created":"2024-05-02","cited_by_count":629},{"id":"2601.11868","title":"Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces","created":"2026-01-17","cited_by_count":585},{"id":"2506.01939","title":"Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning","created":"2025-06-02","cited_by_count":559},{"id":"1804.05685","title":"A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents","created":"2018-04-16","cited_by_count":478},{"id":"2310.01889","title":"Ring Attention with Blockwise Transformers for Near-Infinite Context","created":"2023-10-03","cited_by_count":457},{"id":"1906.01749","title":"Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model","created":"2019-06-04","cited_by_count":431},{"id":"2502.11089","title":"Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention","created":"2025-02-16","cited_by_count":407},{"id":"2310.06452","title":"Understanding the Effects of RLHF on LLM Generalisation and Diversity","created":"2023-10-10","cited_by_count":396},{"id":"2412.15204","title":"LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks","created":"2024-12-19","cited_by_count":379},{"id":"2303.12570","title":"RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation","created":"2023-03-22","cited_by_count":367},{"id":"2211.15533","title":"The Stack: 3 TB of permissively licensed source code","created":"2022-11-20","cited_by_count":359},{"id":"2408.05517","title":"SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuning","created":"2024-08-10","cited_by_count":355},{"id":"2406.08464","title":"Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing","created":"2024-06-12","cited_by_count":346},{"id":"2312.02120","title":"Magicoder: Empowering Code Generation with OSS-Instruct","created":"2023-12-04","cited_by_count":256},{"id":"2402.14658","title":"OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement","created":"2024-02-22","cited_by_count":247},{"id":"2309.14509","title":"DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models","created":"2023-09-25","cited_by_count":245},{"id":"2307.11088","title":"L-Eval: Instituting Standardized Evaluation for Long Context Language Models","created":"2023-07-20","cited_by_count":233},{"id":"2406.10149","title":"BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack","created":"2024-06-14","cited_by_count":215},{"id":"2203.15827","title":"LinkBERT: Pretraining Language Models with Document Links","created":"2022-03-29","cited_by_count":211},{"id":"2402.10171","title":"Data Engineering for Scaling Language Models to 128K Context","created":"2024-02-15","cited_by_count":186},{"id":"2105.08209","title":"BookSum: A Collection of Datasets for Long-form Narrative Summarization","created":"2021-05-18","cited_by_count":184},{"id":"2405.18392","title":"Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations","created":"2024-05-28","cited_by_count":170},{"id":"2504.03601","title":"APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay","created":"2025-04-04","cited_by_count":167},{"id":"2508.03613","title":"Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correction","created":"2025-08-05","cited_by_count":154},{"id":"2410.02660","title":"How to Train Long-Context Language Models (Effectively)","created":"2024-10-03","cited_by_count":146},{"id":"2408.07055","title":"LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs","created":"2024-08-13","cited_by_count":144},{"id":"2308.04014","title":"Continual Pre-Training of Large Language Models: How to (re)warm your model?","created":"2023-08-08","cited_by_count":137},{"id":"2510.07743","title":"OpenRubrics: Towards Scalable Synthetic Rubric Generation for Reward Modeling and LLM Alignment","created":"2025-10-09","cited_by_count":132},{"id":"2310.20707","title":"What's In My Big Data?","created":"2023-10-31","cited_by_count":129},{"id":"2405.00200","title":"In-Context Learning with Long-Context Models: An In-Depth Exploration","created":"2024-04-30","cited_by_count":128},{"id":"2510.05381","title":"Context Length Alone Hurts LLM Performance Despite Perfect Retrieval","created":"2025-10-06","cited_by_count":127},{"id":"2502.05167","title":"NoLiMa: Long-Context Evaluation Beyond Literal Matching","created":"2025-02-07","cited_by_count":126},{"id":"2310.05209","title":"Scaling Laws of RoPE-based Extrapolation","created":"2023-10-08","cited_by_count":125},{"id":"2409.05591","title":"MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentation","created":"2024-09-09","cited_by_count":119},{"id":"2407.11005","title":"RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems","created":"2024-06-25","cited_by_count":117},{"id":"2506.20512","title":"OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling","created":"2025-06-25","cited_by_count":113},{"id":"2503.02240","title":"OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale","created":"2025-03-04","cited_by_count":91},{"id":"2510.01179","title":"TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environments","created":"2025-10-01","cited_by_count":69},{"id":"2406.03949","title":"UltraMedical: Building Specialized Generalists in Biomedicine","created":"2024-06-06","cited_by_count":67},{"id":"2212.10007","title":"CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context","created":"2022-12-20","cited_by_count":65},{"id":"2603.08640","title":"PostTrainBench: Can LLM Agents Automate LLM Post-Training?","created":"2026-03-09","cited_by_count":64},{"id":"2501.17703","title":"Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate","created":"2025-01-29","cited_by_count":63},{"id":"2512.23675","title":"End-to-End Test-Time Training for Long Context","created":"2025-12-29","cited_by_count":62},{"id":"2507.16812","title":"MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning","created":"2025-07-22","cited_by_count":59},{"id":"2502.05352","title":"ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks","created":"2025-02-07","cited_by_count":51},{"id":"2505.21297","title":"rStar-Coder: Scaling Competitive Code Reasoning with a Large-Scale Verified Dataset","created":"2025-05-27","cited_by_count":51},{"id":"2501.15089","title":"LongReason: A Synthetic Long-Context Reasoning Benchmark via Context Expansion","created":"2025-01-25","cited_by_count":50},{"id":"2505.17667","title":"QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement Learning","created":"2025-05-23","cited_by_count":50},{"id":"2512.13607","title":"Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models","created":"2025-12-15","cited_by_count":48},{"id":"2602.03587","title":"CL-bench: A Benchmark for Context Learning","created":"2026-02-03","cited_by_count":47},{"id":"2602.21193","title":"On Data Engineering for Scaling LLM Terminal Capabilities","created":"2026-02-24","cited_by_count":43},{"id":"2504.18851","title":"When2Call: When (not) to Call Tools","created":"2025-04-26","cited_by_count":42},{"id":"2508.15096","title":"Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset","created":"2025-08-20","cited_by_count":38},{"id":"2505.07897","title":"LongCodeBench: Evaluating Coding LLMs at 1M Context Windows","created":"2025-05-12","cited_by_count":37},{"id":"2406.06025","title":"RepoQA: Evaluating Long Context Code Understanding","created":"2024-06-10","cited_by_count":35},{"id":"2411.07037","title":"LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context Scenarios","created":"2024-11-11","cited_by_count":33},{"id":"2605.22791","title":"Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention","created":"2026-05-21","cited_by_count":33},{"id":"2109.14394","title":"EDGAR-CORPUS: Billions of Tokens Make The World Go Round","created":"2021-09-29","cited_by_count":32},{"id":"2511.15718","title":"ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset","created":"2025-11-12","cited_by_count":30},{"id":"2411.08147","title":"Large Language Models Can Self-Improve in Long-context Reasoning","created":"2024-11-12","cited_by_count":29},{"id":"2512.23707","title":"Training AI Co-Scientists Using Rubric Rewards","created":"2025-12-29","cited_by_count":29},{"id":"2408.03246","title":"Making Long-Context Language Models Better Multi-Hop Reasoners","created":"2024-08-06","cited_by_count":26},{"id":"2409.12181","title":"A Controlled Study on Long Context Extension and Generalization in LLMs","created":"2024-09-18","cited_by_count":26},{"id":"2512.15489","title":"Nemotron-Math: Efficient Long-Context Distillation of Mathematical Reasoning from Multi-Mode Supervision","created":"2025-12-17","cited_by_count":26},{"id":"2501.12766","title":"NExtLong: Toward Effective Long-Context Training without Long Documents","created":"2025-01-22","cited_by_count":20},{"id":"2503.01996","title":"One ruler to measure them all: Benchmarking multilingual long-context language models","created":"2025-03-03","cited_by_count":19},{"id":"2312.17296","title":"Structured Packing in LLM Training Improves Long Context Utilization","created":"2023-12-28","cited_by_count":17},{"id":"2410.14641","title":"Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs","created":"2024-10-18","cited_by_count":16},{"id":"2502.12583","title":"LongFaith: Enhancing Long-Context Reasoning in LLMs with Faithful Synthetic Data","created":"2025-02-18","cited_by_count":16},{"id":"2410.12881","title":"MIND: Math Informed syNthetic Dialogues for Pretraining LLMs","created":"2024-10-15","cited_by_count":14},{"id":"2502.07365","title":"LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation","created":"2025-02-11","cited_by_count":14},{"id":"2504.06214","title":"From 128K to 4M: Efficient Training of Ultra-Long Context Large Language Models","created":"2025-04-08","cited_by_count":14},{"id":"2601.21571","title":"Shaping capabilities with token-level data filtering","created":"2026-01-29","cited_by_count":13},{"id":"2510.14865","title":"Midtraining Bridges Pretraining and Posttraining Distributions","created":"2025-10-16","cited_by_count":12},{"id":"2407.08112","title":"How Well Can a Long Sequence Model Model Long Sequences? Comparing Architechtural Inductive Biases on Long-Context Abilities","created":"2024-07-11","cited_by_count":9},{"id":"2502.16684","title":"WildLong: Synthesizing Realistic Long-Context Instruction Data at Scale","created":"2025-02-23","cited_by_count":9},{"id":"2502.16860","title":"LongAttn: Selecting Long-context Training Data via Token-level Attention","created":"2025-02-24","cited_by_count":9},{"id":"2510.10276","title":"Lost in the Middle: An Emergent Property from Information Retrieval Demands in LLMs","created":"2025-10-11","cited_by_count":9},{"id":"2409.03810","title":"How Do Your Code LLMs Perform? Empowering Code Instruction Tuning with High-Quality Data","created":"2024-09-05","cited_by_count":8},{"id":"2510.22548","title":"LooGLE v2: Are LLMs Ready for Real World Long Dependency Challenges?","created":"2025-10-26","cited_by_count":8},{"id":"2601.01498","title":"From Failure to Mastery: Generating Hard Samples for Tool-use Agents","created":"2026-01-04","cited_by_count":8},{"id":"2605.29559","title":"LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents","created":"2026-05-28","cited_by_count":8},{"id":"2602.07824","title":"Data Darwinism Part I: Unlocking the Value of Scientific Data for Pre-training","created":"2026-02-08","cited_by_count":7},{"id":"2503.15450","title":"SkyLadder: Better and Faster Pretraining via Context Window Scheduling","created":"2025-03-19","cited_by_count":6},{"id":"2505.17134","title":"LongMagpie: A Self-synthesis Method for Generating Large-scale Long-context Instructions","created":"2025-05-22","cited_by_count":6}],"next_cursor":"100"}