{"list":"other","total":57,"rows":[{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"1803.05457","title":"Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge","created":"2018-03-14","cited_by_count":4886},{"id":"1606.05250","title":"SQuAD: 100,000+ Questions for Machine Comprehension of Text","created":"2016-06-16","cited_by_count":4148},{"id":"2205.01068","title":"OPT: Open Pre-trained Transformer Language Models","created":"2022-05-02","cited_by_count":3512},{"id":"1905.10044","title":"BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions","created":"2019-05-24","cited_by_count":2183},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"1906.02243","title":"Energy and Policy Considerations for Deep Learning in NLP","created":"2019-06-05","cited_by_count":1254},{"id":"1506.03340","title":"Teaching Machines to Read and Comprehend","created":"2015-06-10","cited_by_count":1049},{"id":"2208.07339","title":"LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale","created":"2022-08-15","cited_by_count":906},{"id":"2103.07191","title":"Are NLP Models really able to Solve Simple Math Word Problems?","created":"2021-03-12","cited_by_count":878},{"id":"2101.02235","title":"Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies","created":"2021-01-06","cited_by_count":743},{"id":"2301.13688","title":"The Flan Collection: Designing Data and Methods for Effective Instruction Tuning","created":"2023-01-31","cited_by_count":739},{"id":"2107.06499","title":"Deduplicating Training Data Makes Language Models Better","created":"2021-07-14","cited_by_count":714},{"id":"1812.05159","title":"An Empirical Study of Example Forgetting during Deep Neural Network Learning","created":"2018-12-12","cited_by_count":678},{"id":"1911.00359","title":"CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data","created":"2019-11-01","cited_by_count":548},{"id":"2107.07075","title":"Deep Learning on a Data Diet: Finding Important Examples Early in Training","created":"2021-07-15","cited_by_count":533},{"id":"2206.14486","title":"Beyond neural scaling laws: beating power law scaling via data pruning","created":"2022-06-29","cited_by_count":528},{"id":"2008.03703","title":"What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation","created":"2020-08-09","cited_by_count":497},{"id":"2005.00700","title":"UnifiedQA: Crossing Format Boundaries With a Single QA System","created":"2020-05-02","cited_by_count":476},{"id":"2108.08877","title":"Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models","created":"2021-08-19","cited_by_count":463},{"id":"2305.16264","title":"Scaling Data-Constrained Language Models","created":"2023-05-25","cited_by_count":403},{"id":"2305.17493","title":"The Curse of Recursion: Training on Generated Data Makes Models Forget","created":"2023-05-27","cited_by_count":356},{"id":"1906.11829","title":"Selection via Proxy: Efficient Data Selection for Deep Learning","created":"2019-06-26","cited_by_count":339},{"id":"2302.03169","title":"Data Selection for Language Models via Importance Resampling","created":"2023-02-06","cited_by_count":329},{"id":"1803.00942","title":"Not All Samples Are Created Equal: Deep Learning with Importance Sampling","created":"2018-03-02","cited_by_count":328},{"id":"2106.15772","title":"A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers","created":"2021-06-30","cited_by_count":318},{"id":"1312.3005","title":"One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling","created":"2013-12-11","cited_by_count":308},{"id":"2303.09540","title":"SemDeDup: Data-efficient learning at web-scale through semantic deduplication","created":"2023-03-16","cited_by_count":303},{"id":"2211.02001","title":"Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model","created":"2022-11-03","cited_by_count":265},{"id":"2307.01850","title":"Self-Consuming Generative Models Go MAD","created":"2023-07-04","cited_by_count":250},{"id":"2206.07137","title":"Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt","created":"2022-06-14","cited_by_count":236},{"id":"2006.03875","title":"Coresets via Bilevel Optimization for Continual Learning and Streaming","created":"2020-06-06","cited_by_count":192},{"id":"2305.13169","title":"A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity","created":"2023-05-22","cited_by_count":182},{"id":"2401.16380","title":"Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling","created":"2024-01-29","cited_by_count":161},{"id":"2308.12284","title":"D4: Improving LLM Pretraining via Document De-Duplication and Diversification","created":"2023-08-23","cited_by_count":150},{"id":"2204.08499","title":"DeepCore: A Comprehensive Library for Coreset Selection in Deep Learning","created":"2022-04-18","cited_by_count":147},{"id":"1807.04518","title":"Turning Big data into tiny data: Constant-size coresets for k-means, PCA and projective clustering","created":"2018-07-12","cited_by_count":94},{"id":"1910.00762","title":"Accelerating Deep Learning by Focusing on the Biggest Losers","created":"2019-10-02","cited_by_count":94},{"id":"2301.04272","title":"Data Distillation: A Survey","created":"2023-01-11","cited_by_count":87},{"id":"2311.16822","title":"Large Language Models Suffer From Their Own Output: An Analysis of the Self-Consuming Training Loop","created":"2023-11-28","cited_by_count":79},{"id":"2305.14705","title":"Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models","created":"2023-05-24","cited_by_count":65},{"id":"1601.00617","title":"Coresets and Sketches","created":"2016-01-04","cited_by_count":63},{"id":"2303.08114","title":"Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs","created":"2023-03-14","cited_by_count":53},{"id":"2110.05922","title":"Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)","created":"2021-10-12","cited_by_count":35},{"id":"1906.04845","title":"Discrepancy, Coresets, and Sketches in Machine Learning","created":"2019-06-11","cited_by_count":30},{"id":"2106.04254","title":"Coresets for Classification -- Simplified and Strengthened","created":"2021-06-08","cited_by_count":28},{"id":"1912.02283","title":"Sub-linear RACE Sketches for Approximate Kernel Density Estimation on Streaming Data","created":"2019-12-04","cited_by_count":14},{"id":"2107.04984","title":"SVP-CF: Selection via Proxy for Collaborative Filtering Data","created":"2021-07-11","cited_by_count":14},{"id":"2302.06960","title":"Data pruning and neural scaling laws: fundamental limitations of score-based algorithms","created":"2023-02-14","cited_by_count":11},{"id":"2310.09983","title":"Farzi Data: Autoregressive Data Distillation","created":"2023-10-15","cited_by_count":3}],"next_cursor":null}