{"total":77,"rows":[{"id":"2408.00724","title":"Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models","created":"2024-08-01","cited_by_count":290,"area":"lr"},{"id":"2407.01492","title":"RegMix: Data Mixture as Regression for Language Model Pre-training","created":"2024-07-01","cited_by_count":177,"area":null},{"id":"2405.18392","title":"Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations","created":"2024-05-28","cited_by_count":170,"area":null},{"id":"2406.06046","title":"MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models","created":"2024-06-10","cited_by_count":100,"area":null},{"id":"2406.19146","title":"Resolving Discrepancies in Compute-Optimal Scaling of Language Models","created":"2024-06-27","cited_by_count":88,"area":null},{"id":"2405.20541","title":"Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models","created":"2024-05-30","cited_by_count":84,"area":null},{"id":"2504.13818","title":"Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learning","created":"2025-04-18","cited_by_count":84,"area":"lr"},{"id":"2405.16640","title":"A Survey of Multimodal Large Language Model from A Data-centric Perspective","created":"2024-05-26","cited_by_count":75,"area":"mllm"},{"id":"2504.13161","title":"Nemotron-CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training","created":"2025-04-17","cited_by_count":66,"area":null},{"id":"2507.09404","title":"Scaling Laws for Optimal Data Mixtures","created":"2025-07-12","cited_by_count":52,"area":null},{"id":"2410.08527","title":"Scaling Laws for Predicting Downstream Performance in LLMs","created":"2024-10-11","cited_by_count":48,"area":null},{"id":"2410.11820","title":"Adaptive Data Optimization: Dynamic Sample Selection with Scaling Laws","created":"2024-10-15","cited_by_count":47,"area":null},{"id":"2406.17711","title":"Data curation via joint example selection further accelerates multimodal learning","created":"2024-06-25","cited_by_count":33,"area":null},{"id":"2509.14786","title":"Pre-training under infinite compute","created":"2025-09-18","cited_by_count":29,"area":null},{"id":"2502.18969","title":"(Mis)Fitting: A Survey of Scaling Laws","created":"2025-02-26","cited_by_count":26,"area":null},{"id":"2411.03312","title":"Inference Optimal VLMs Need Fewer Visual Tokens and More Parameters","created":"2024-11-05","cited_by_count":25,"area":"mllm"},{"id":"2501.01956","title":"Metadata Conditioning Accelerates Language Model Pre-training","created":"2025-01-03","cited_by_count":22,"area":null},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2510.22037","title":"ATLAS: Adaptive Transfer Scaling Laws for Multilingual Pretraining, Finetuning, and Decoding the Curse of Multilinguality","created":"2025-10-24","cited_by_count":22,"area":null},{"id":"2508.10975","title":"BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining","created":"2025-08-14","cited_by_count":21,"area":"synth"},{"id":"2508.20691","title":"MobileCLIP2: Improving Multi-Modal Reinforced Training","created":"2025-08-28","cited_by_count":21,"area":"distill"},{"id":"2405.19547","title":"CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning","created":"2024-05-29","cited_by_count":20,"area":"mllm"},{"id":"2411.18674","title":"Active Data Curation Effectively Distills Large-Scale Multimodal Models","created":"2024-11-27","cited_by_count":19,"area":"distill"},{"id":"2502.07617","title":"Scaling Pre-training to One Hundred Billion Data for Vision Language Models","created":"2025-02-11","cited_by_count":19,"area":"mllm"},{"id":"2507.12466","title":"Language Models Improve When Pretraining Data Matches Target Tasks","created":"2025-07-16","cited_by_count":19,"area":null},{"id":"2506.10038","title":"Ambient Diffusion Omni: Training Good Models with Bad Data","created":"2025-06-10","cited_by_count":18,"area":"diffusion"},{"id":"2511.19515","title":"Fewer Tokens, Greater Scaling: Self-Adaptive Visual Bases for Efficient and Expansive Representation Learning","created":"2025-11-24","cited_by_count":16,"area":null},{"id":"2405.08209","title":"Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp","created":"2024-05-13","cited_by_count":15,"area":null},{"id":"2407.08583","title":"The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspective","created":"2024-07-11","cited_by_count":15,"area":"mllm"},{"id":"2603.04964","title":"Replaying pre-training data improves fine-tuning","created":"2026-03-05","cited_by_count":13,"area":null},{"id":"2410.16208","title":"Compute-Constrained Data Selection","created":"2024-10-21","cited_by_count":12,"area":null},{"id":"2503.03862","title":"Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisions","created":"2025-03-05","cited_by_count":12,"area":null},{"id":"2508.04379","title":"VisionTS++: Cross-Modal Time Series Foundation Model with Continual Pre-trained Vision Backbones","created":"2025-08-06","cited_by_count":12,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2503.21023","title":"Data Mixture Optimization: A Multi-fidelity Multi-scale Bayesian Framework","created":"2025-03-26","cited_by_count":9,"area":null},{"id":"2603.16177","title":"The Finetuner's Fallacy: When to Pretrain with Your Finetuning Data","created":"2026-03-17","cited_by_count":9,"area":"wm"},{"id":"2503.07879","title":"Datasets, Documents, and Repetitions: The Practicalities of Unequal Data Quality","created":"2025-03-10","cited_by_count":8,"area":null},{"id":"2506.04598","title":"Scaling Laws for Robust Comparison of Open Foundation Language-Vision Models and Datasets","created":"2025-06-05","cited_by_count":8,"area":null},{"id":"2506.21545","title":"Data Efficacy for Language Model Training","created":"2025-06-26","cited_by_count":8,"area":null},{"id":"2605.19407","title":"A Bitter Lesson for Data Filtering","created":"2026-05-19","cited_by_count":8,"area":null},{"id":"2407.06723","title":"Graph-Based Captioning: Enhancing Visual Descriptions by Interconnecting Region Captions","created":"2024-07-09","cited_by_count":7,"area":null},{"id":"2409.13860","title":"SSE: Multimodal Semantic Data Selection and Enrichment for Industrial-scale Data Assimilation","created":"2024-09-20","cited_by_count":7,"area":null},{"id":"2411.09126","title":"SCAN: Bootstrapping Contrastive Pre-training for Data Efficiency","created":"2024-11-14","cited_by_count":6,"area":null},{"id":"2605.12715","title":"Scaling Laws for Mixture Pretraining Under Data Constraints","created":"2026-05-12","cited_by_count":6,"area":null},{"id":"2407.06120","title":"Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning","created":"2024-07-08","cited_by_count":5,"area":null},{"id":"2507.00004","title":"A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search","created":"2025-06-10","cited_by_count":5,"area":"lr"},{"id":"2510.03313","title":"Scaling Laws Revisited: Modeling the Role of Data Quality in Language Model Pretraining","created":"2025-09-30","cited_by_count":5,"area":null},{"id":"2409.03734","title":"Safety vs. Performance: How Multi-Objective Learning Reduces Barriers to Market Entry","created":"2024-09-05","cited_by_count":4,"area":null},{"id":"2502.02494","title":"Analyzing Similarity Metrics for Data Selection for Language Model Pretraining","created":"2025-02-04","cited_by_count":4,"area":null},{"id":"2503.12999","title":"Concept-as-Tree: A Controllable Synthetic Data Framework Makes Stronger Personalized VLMs","created":"2025-03-17","cited_by_count":4,"area":"mllm"},{"id":"2606.24998","title":"Internal Data Repetition Destroys Language Models","created":"2026-06-23","cited_by_count":4,"area":null},{"id":"2503.08805","title":"Filter Like You Test: Data-Driven Data Filtering for CLIP Pretraining","created":"2025-03-11","cited_by_count":3,"area":null},{"id":"2510.20860","title":"Data-Centric Lessons To Improve Speech-Language Pretraining","created":"2025-10-22","cited_by_count":3,"area":null},{"id":"2502.20034","title":"Do Vision Encoders Truly Explain Object Hallucination?: Mitigating Object Hallucination via Simple Fine-Grained CLIPScore","created":"2025-02-27","cited_by_count":2,"area":"mllm"},{"id":"2503.14559","title":"Squeeze Out Tokens from Sample for Finer-Grained Data Governance","created":"2025-03-18","cited_by_count":2,"area":null},{"id":"2601.15417","title":"Ambient Dataloops: Generative Models for Dataset Refinement","created":"2026-01-21","cited_by_count":2,"area":"diffusion"},{"id":"2602.22843","title":"A data- and compute-efficient chest X-ray foundation model beyond aggressive scaling","created":"2026-02-26","cited_by_count":2,"area":null},{"id":"2405.00892","title":"Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applications","created":"2024-05-01","cited_by_count":1,"area":null},{"id":"2410.07880","title":"Unsupervised Data Validation Methods for Efficient Model Training","created":"2024-10-10","cited_by_count":1,"area":null},{"id":"2503.13383","title":"Cream of the Crop: Harvesting Rich, Scalable and Transferable Multi-Modal Data for Instruction Fine-Tuning","created":"2025-03-17","cited_by_count":1,"area":null},{"id":"2509.15267","title":"Autoguided Online Data Curation for Diffusion Model Training","created":"2025-09-18","cited_by_count":1,"area":"diffusion"},{"id":"2602.14536","title":"Explainable Token-level Noise Filtering for LLM Fine-tuning Datasets","created":"2026-02-16","cited_by_count":1,"area":null},{"id":"2603.19149","title":"Optimal Splitting of Language Models from Mixtures to Specialized Domains","created":"2026-03-19","cited_by_count":1,"area":null},{"id":"2604.18811","title":"Rethinking Dataset Distillation: Hard Truths about Soft Labels","created":"2026-04-20","cited_by_count":1,"area":null},{"id":"2504.05250","title":"PEAKS: Selecting Key Training Examples Incrementally via Prediction Error Anchored by Kernel Similarity","created":"2025-04-07","cited_by_count":0,"area":null},{"id":"2507.22250","title":"Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training","created":"2025-07-29","cited_by_count":0,"area":null},{"id":"2601.14042","title":"Federated Balanced Learning","created":"2026-01-20","cited_by_count":0,"area":null},{"id":"2603.00031","title":"GRIP: Geometric Refinement and Adaptive Information Potential for Data Efficiency","created":"2026-02-04","cited_by_count":0,"area":"moe"},{"id":"2603.22339","title":"Problems with Chinchilla Approach 2: Systematic Biases in IsoFLOP Parabola Fits","created":"2026-03-21","cited_by_count":0,"area":null},{"id":"2605.07546","title":"On the Invariance and Generality of Neural Scaling Laws","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2605.17610","title":"SafeLens: Deliberate and Efficient Video Guardrails with Fast-and-Slow Screening","created":"2026-05-17","cited_by_count":0,"area":"safety"},{"id":"2606.05029","title":"Validity Threats for Foundation Model Research","created":"2026-06-03","cited_by_count":0,"area":null},{"id":"2606.23611","title":"Data Selection Through Iterative Self-Filtering for Vision-Language Settings","created":"2026-06-22","cited_by_count":0,"area":null},{"id":"2607.22697","title":"Test-Time Coverage: Test-Conditioned Data Curation for Deployment-Aware Learning","created":"2026-07-18","cited_by_count":0,"area":null},{"id":"2610.05591","title":"What Is a Repeated Token Worth? The Scaling Geometry of Multi-Epoch Pretraining","created":"2026-10-04","cited_by_count":0,"area":null},{"id":"2610.07008","title":"Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning","created":"2026-10-04","cited_by_count":0,"area":null},{"id":"2610.19013","title":"Data Density Scaling Laws for Image Self-Distillation","created":"2026-10-13","cited_by_count":0,"area":"distill"}],"next_cursor":null}