{"list":"other","total":53,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2210.08402","title":"LAION-5B: An open large-scale dataset for training next generation image-text models","created":"2022-10-16","cited_by_count":4152},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"1508.07909","title":"Neural Machine Translation of Rare Words with Subword Units","created":"2015-08-31","cited_by_count":2918},{"id":"2101.00027","title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling","created":"2020-12-31","cited_by_count":2411},{"id":"2112.11446","title":"Scaling Language Models: Methods, Analysis & Insights from Training Gopher","created":"2021-12-08","cited_by_count":1202},{"id":"2406.17557","title":"The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale","created":"2024-06-25","cited_by_count":1160},{"id":"1703.00564","title":"MoleculeNet: A Benchmark for Molecular Machine Learning","created":"2017-03-02","cited_by_count":1051},{"id":"2305.06161","title":"StarCoder: may the source be with you!","created":"2023-05-09","cited_by_count":799},{"id":"2304.14108","title":"DataComp: In search of the next generation of multimodal datasets","created":"2023-04-27","cited_by_count":644},{"id":"1804.10959","title":"Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates","created":"2018-04-29","cited_by_count":639},{"id":"2304.05376","title":"ChemCrow: Augmenting large-language models with chemistry tools","created":"2023-04-11","cited_by_count":631},{"id":"2306.11644","title":"Textbooks Are All You Need","created":"2023-06-20","cited_by_count":569},{"id":"2210.10341","title":"BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining","created":"2022-10-19","cited_by_count":538},{"id":"2402.00159","title":"Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research","created":"2024-01-31","cited_by_count":483},{"id":"2211.15533","title":"The Stack: 3 TB of permissively licensed source code","created":"2022-11-20","cited_by_count":359},{"id":"2010.09885","title":"ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction","created":"2020-10-19","cited_by_count":337},{"id":"2502.02737","title":"SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model","created":"2025-02-04","cited_by_count":335},{"id":"2102.09548","title":"Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Development","created":"2021-02-18","cited_by_count":264},{"id":"2308.13418","title":"Nougat: Neural Optical Understanding for Academic Documents","created":"2023-08-25","cited_by_count":245},{"id":"2402.16827","title":"A Survey on Data Selection for Language Models","created":"2024-02-26","cited_by_count":236},{"id":"2403.16952","title":"Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance","created":"2024-03-25","cited_by_count":184},{"id":"2212.10789","title":"Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editing","created":"2022-12-21","cited_by_count":166},{"id":"2206.06565","title":"LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks","created":"2022-06-14","cited_by_count":148},{"id":"2409.13740","title":"Language agents achieve superhuman synthesis of scientific knowledge","created":"2024-09-10","cited_by_count":137},{"id":"2306.08018","title":"Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models","created":"2023-06-13","cited_by_count":133},{"id":"2209.05481","title":"A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language","created":"2022-09-12","cited_by_count":131},{"id":"2211.13308","title":"SciRepEval: A Multi-Format Benchmark for Scientific Document Representations","created":"2022-11-23","cited_by_count":129},{"id":"2402.09391","title":"LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset","created":"2024-02-14","cited_by_count":128},{"id":"2407.01603","title":"A Review of Large Language Models and Autonomous Agents in Chemistry","created":"2024-06-26","cited_by_count":99},{"id":"2402.04379","title":"Fine-Tuned Language Models Generate Stable Inorganic Materials as Text","created":"2024-02-06","cited_by_count":93},{"id":"2306.06283","title":"14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon","created":"2023-06-09","cited_by_count":86},{"id":"2309.16298","title":"At Which Training Stage Does Code Data Help LLMs Reasoning?","created":"2023-09-28","cited_by_count":82},{"id":"2204.00056","title":"SELFIES and the future of molecular string representations","created":"2022-03-31","cited_by_count":76},{"id":"2401.06949","title":"ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterization","created":"2024-01-13","cited_by_count":61},{"id":"2408.10914","title":"To Code, or Not To Code? Exploring Impact of Code in Pre-training","created":"2024-08-20","cited_by_count":47},{"id":"2307.07443","title":"Can Large Language Models Empower Molecular Property Prediction?","created":"2023-07-14","cited_by_count":44},{"id":"2310.10445","title":"MechGPT, a language-based strategy for mechanics and materials modeling that connects knowledge across scales, disciplines and modalities","created":"2023-10-16","cited_by_count":38},{"id":"2404.01475","title":"Are large language models superhuman chemists?","created":"2024-04-01","cited_by_count":34},{"id":"2411.16955","title":"Probing the limitations of multimodal language models for chemistry and materials research","created":"2024-11-25","cited_by_count":32},{"id":"2310.14029","title":"LLM-Prop: Predicting Physical And Electronic Properties Of Crystalline Solids From Their Text Descriptions","created":"2023-10-21","cited_by_count":29},{"id":"2410.04223","title":"Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic Planning","created":"2024-10-05","cited_by_count":29},{"id":"2412.15285","title":"Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase Pretraining","created":"2024-12-18","cited_by_count":26},{"id":"2406.12950","title":"MolecularGPT: Open Large Language Model (LLM) for Few-Shot Molecular Property Prediction","created":"2024-06-18","cited_by_count":24},{"id":"2403.05075","title":"Benchmarking Large Language Models for Molecule Prediction Tasks","created":"2024-03-08","cited_by_count":17},{"id":"2311.04929","title":"An Interdisciplinary Outlook on Large Language Models for Scientific Research","created":"2023-11-03","cited_by_count":15},{"id":"2210.10391","title":"Machine Learning for a Sustainable Energy Future","created":"2022-10-19","cited_by_count":14},{"id":"2408.10285","title":"BatGPT-Chem: A Foundation Large Model For Retrosynthesis Prediction","created":"2024-08-19","cited_by_count":9},{"id":"2412.11970","title":"DARWIN 1.5: Large Language Models as Materials Science Adapted Learners","created":"2024-12-16","cited_by_count":9},{"id":"2505.02639","title":"Enhancing Chemical Reaction and Retrosynthesis Prediction with Large Language Model and Dual-task Learning","created":"2025-05-05","cited_by_count":9},{"id":"2410.20796","title":"Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training","created":"2024-10-28","cited_by_count":8}],"next_cursor":null}