{"total":151,"rows":[{"id":"2410.18982","title":"O1 Replication Journey: A Strategic Progress Report -- Part 1","created":"2024-10-08","cited_by_count":143,"area":"lr"},{"id":"2406.14532","title":"RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold","created":"2024-06-20","cited_by_count":99,"area":"lr"},{"id":"2406.09358","title":"Understanding Hallucinations in Diffusion Models through Mode Interpolation","created":"2024-06-13","cited_by_count":91,"area":"diffusion"},{"id":"2503.14023","title":"Synthetic Data Generation Using Large Language Models: Advances in Text and Code","created":"2025-03-18","cited_by_count":61,"area":"synth"},{"id":"2504.12501","title":"Reinforcement Learning from Human Feedback","created":"2025-04-16","cited_by_count":58,"area":"alignment"},{"id":"2410.16713","title":"Collapse or Thrive? Perils and Promises of Synthetic Data in a Self-Generating World","created":"2024-10-22","cited_by_count":52,"area":null},{"id":"2502.04194","title":"The Best Instruction-Tuning Data are Those That Fit","created":"2025-02-06","cited_by_count":52,"area":null},{"id":"2502.17578","title":"How Do Large Language Monkeys Get Their Power (Laws)?","created":"2025-02-24","cited_by_count":43,"area":"safety"},{"id":"2505.00661","title":"On the generalization of language models from in-context learning and finetuning: a controlled study","created":"2025-05-01","cited_by_count":40,"area":"lr"},{"id":"2407.09499","title":"Self-Consuming Generative Models with Curated Data Provably Optimize Human Preferences","created":"2024-06-12","cited_by_count":39,"area":"alignment"},{"id":"2405.17767","title":"Linguistic Collapse: Neural Collapse in (Large) Language Models","created":"2024-05-28","cited_by_count":38,"area":null},{"id":"2408.16333","title":"Self-Improving Diffusion Models with Synthetic Data","created":"2024-08-29","cited_by_count":35,"area":"diffusion"},{"id":"2503.03150","title":"Position: Model Collapse Does Not Mean What You Think","created":"2025-03-05","cited_by_count":33,"area":"synth"},{"id":"2502.01612","title":"Self-Improving Transformers Overcome Easy-to-Hard and Length Generalization Challenges","created":"2025-02-03","cited_by_count":31,"area":"synth"},{"id":"2506.04689","title":"Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Models","created":"2025-06-05","cited_by_count":31,"area":null},{"id":"2509.14786","title":"Pre-training under infinite compute","created":"2025-09-18","cited_by_count":29,"area":null},{"id":"2504.13143","title":"$\\texttt{Complex-Edit}$: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmark","created":"2025-04-17","cited_by_count":27,"area":null},{"id":"2410.22812","title":"Universality of the $\\pi^2/6$ Pathway in Avoiding Model Collapse","created":"2024-10-30","cited_by_count":26,"area":null},{"id":"2412.14689","title":"How to Synthesize Text Data without Model Collapse?","created":"2024-12-19","cited_by_count":25,"area":"synth"},{"id":"2412.17646","title":"Rate of Model Collapse in Recursive Training","created":"2024-12-23","cited_by_count":25,"area":"synth"},{"id":"2410.07672","title":"MACPO: Weak-to-Strong Alignment via Multi-Agent Contrastive Preference Optimization","created":"2024-10-10","cited_by_count":22,"area":"agents"},{"id":"2604.06268","title":"RAGEN-2: Reasoning Collapse in Agentic RL","created":"2026-04-07","cited_by_count":20,"area":"lr"},{"id":"2412.02674","title":"Mind the Gap: Examining the Self-Improvement Capabilities of Large Language Models","created":"2024-12-03","cited_by_count":18,"area":"synth"},{"id":"2509.16499","title":"A Closer Look at Model Collapse: From a Generalization-to-Memorization Perspective","created":"2025-09-20","cited_by_count":18,"area":"diffusion"},{"id":"2407.04503","title":"When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settings","created":"2024-07-05","cited_by_count":17,"area":null},{"id":"2502.18865","title":"A Theoretical Perspective: How to Prevent Model Collapse in Self-consuming Training Loops","created":"2025-02-26","cited_by_count":16,"area":"synth"},{"id":"2510.05197","title":"Efficient Prediction of Pass@k Scaling in Large Language Models","created":"2025-10-06","cited_by_count":16,"area":null},{"id":"2407.12835","title":"Regurgitative Training: The Value of Real Data in Training Large Language Models","created":"2024-07-03","cited_by_count":15,"area":"synth"},{"id":"2502.15654","title":"Machine-generated text detection prevents language model collapse","created":"2025-02-21","cited_by_count":14,"area":"synth"},{"id":"2505.19046","title":"When Models Don't Collapse: On the Consistency of Iterative MLE","created":"2025-05-25","cited_by_count":13,"area":"synth"},{"id":"2406.19593","title":"SK-VQA: Synthetic Knowledge Generation at Scale for Training Context-Augmented Multimodal LLMs","created":"2024-06-28","cited_by_count":12,"area":"mllm"},{"id":"2407.17493","title":"Model Collapse in the Self-Consuming Chain of Diffusion Finetuning: A Novel Perspective from Quantitative Trait Modeling","created":"2024-07-04","cited_by_count":12,"area":"synth"},{"id":"2412.08175","title":"Analyzing and Mitigating Model Collapse in Rectified Flow Models","created":"2024-12-11","cited_by_count":11,"area":"diffusion"},{"id":"2502.08924","title":"Escaping Collapse: The Strength of Weak Data for Large Language Model Training","created":"2025-02-13","cited_by_count":11,"area":null},{"id":"2502.18049","title":"Recursive Learning Without Collapse: A Weighting-Based Stabilization Framework","created":"2025-02-25","cited_by_count":10,"area":"synth"},{"id":"2505.09768","title":"Self-Consuming Generative Models with Adversarially Curated Data","created":"2025-05-14","cited_by_count":10,"area":null},{"id":"2510.26707","title":"Value Drifts: Tracing Value Alignment During LLM Post-Training","created":"2025-10-30","cited_by_count":10,"area":"alignment"},{"id":"2504.18116","title":"Think, Prune, Train, Improve: Scaling Reasoning without Scaling Models","created":"2025-04-25","cited_by_count":9,"area":"lr"},{"id":"2509.22341","title":"Preventing Model Collapse Under Overparametrization: Optimal Mixing Ratios for Interpolation Learning and Ridge Regression","created":"2025-09-26","cited_by_count":9,"area":"synth"},{"id":"2407.09502","title":"From Text to Life: On the Reciprocal Relationship between Artificial Life and Large Language Models","created":"2024-06-14","cited_by_count":8,"area":null},{"id":"2410.20796","title":"Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training","created":"2024-10-28","cited_by_count":8,"area":null},{"id":"2511.03492","title":"Why Less is More (Sometimes): A Theory of Data Curation","created":"2025-11-05","cited_by_count":8,"area":null},{"id":"2407.18421","title":"Self-Directed Synthetic Dialogues and Revisions Technical Report","created":"2024-07-25","cited_by_count":7,"area":null},{"id":"2408.14960","title":"Multilingual Arbitrage: Optimizing Data Pools to Accelerate Multilingual Progress","created":"2024-08-27","cited_by_count":7,"area":null},{"id":"2410.08942","title":"Maximizing the Potential of Synthetic Data: Insights from Random Matrix Theory","created":"2024-10-11","cited_by_count":7,"area":"synth"},{"id":"2506.19882","title":"Position: Machine Learning Conferences Should Establish a \"Refutations and Critiques\" Track","created":"2025-06-24","cited_by_count":7,"area":null},{"id":"2505.00022","title":"Aleph-Alpha-GermanWeb: Improving German-language LLM pre-training with model-based data curation and synthetic data generation","created":"2025-04-24","cited_by_count":6,"area":"synth"},{"id":"2505.21677","title":"What happens when generative AI models train recursively on each others' outputs?","created":"2025-05-27","cited_by_count":6,"area":null},{"id":"2507.00075","title":"Theoretical Modeling of Large Language Model Self-Improvement Training Dynamics Through Solver-Verifier Gap","created":"2025-06-29","cited_by_count":6,"area":"synth"},{"id":"2510.10681","title":"RePro: Training Language Models to Faithfully Recycle the Web for Pretraining","created":"2025-10-12","cited_by_count":6,"area":null},{"id":"2510.16657","title":"Escaping Model Collapse via Synthetic Data Verification: Near-term Improvements and Long-term Convergence","created":"2025-10-18","cited_by_count":6,"area":"synth"},{"id":"2604.26965","title":"The Impact of AI-Generated Text on the Internet","created":"2026-04-14","cited_by_count":6,"area":null},{"id":"2607.00871","title":"Self-Evolving Agents with Anytime-Valid Certificates","created":"2026-07-01","cited_by_count":6,"area":null},{"id":"2405.14061","title":"Meanings and Feelings of Large Language Models: Observability of Latent States in Generative AI","created":"2024-05-22","cited_by_count":5,"area":null},{"id":"2501.07886","title":"Iterative Label Refinement Matters More than Preference Optimization under Weak Supervision","created":"2025-01-14","cited_by_count":5,"area":"alignment"},{"id":"2505.19145","title":"Do Large Language Models (Really) Need Statistical Foundations?","created":"2025-05-25","cited_by_count":5,"area":null},{"id":"2510.03597","title":"Neon: Negative Extrapolation From Self-Training Improves Image Generation","created":"2025-10-04","cited_by_count":5,"area":null},{"id":"2510.03777","title":"GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-Time","created":"2025-10-04","cited_by_count":5,"area":null},{"id":"2603.11784","title":"Language Generation with Replay: A Learning-Theoretic View of Model Collapse","created":"2026-03-12","cited_by_count":5,"area":"synth"},{"id":"2406.03356","title":"Cooperative learning of Pl@ntNet's Artificial Intelligence algorithm: how does it work and how can we improve it?","created":"2024-06-05","cited_by_count":4,"area":null},{"id":"2409.03734","title":"Safety vs. Performance: How Multi-Objective Learning Reduces Barriers to Market Entry","created":"2024-09-05","cited_by_count":4,"area":null},{"id":"2412.14872","title":"Theoretical Proof that Auto-regressive Language Models Collapse when Real-world Data is a Finite Set","created":"2024-12-19","cited_by_count":4,"area":null},{"id":"2602.16601","title":"Quantifying Error Propagation and Model Collapse in Diffusion Models","created":"2026-02-18","cited_by_count":4,"area":"diffusion"},{"id":"2606.12683","title":"From AGI to ASI","created":"2026-06-10","cited_by_count":4,"area":null},{"id":"2411.06624","title":"A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning","created":"2024-11-10","cited_by_count":3,"area":null},{"id":"2501.00747","title":"DIVE: Diversified Iterative Self-Improvement","created":"2025-01-01","cited_by_count":3,"area":"synth"},{"id":"2502.04774","title":"SeDi-Instruct: Enhancing Alignment of Language Models through Self-Directed Instruction Generation","created":"2025-02-07","cited_by_count":3,"area":"alignment"},{"id":"2509.06770","title":"Another Turn, Better Output? A Turn-Wise Analysis of Iterative LLM Prompting","created":"2025-09-08","cited_by_count":3,"area":null},{"id":"2601.09966","title":"A Sustainable AI Economy Needs Data Deals That Work for Generators","created":"2026-01-15","cited_by_count":3,"area":null},{"id":"2601.15468","title":"Learning from Synthetic Data: Limitations of ERM","created":"2026-01-21","cited_by_count":3,"area":"synth"},{"id":"2602.12172","title":"Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation","created":"2026-02-12","cited_by_count":3,"area":"synth"},{"id":"2603.11228","title":"Markovian Generation Chains in Large Language Models","created":"2026-03-11","cited_by_count":3,"area":null},{"id":"2410.12341","title":"Learning by Surprise: Adaptive Mitigation of Model Collapse in Large Language Models","created":"2024-10-16","cited_by_count":2,"area":"synth"},{"id":"2503.08117","title":"Convergence Dynamics and Stabilization Strategies of Co-Evolving Generative Models","created":"2025-03-11","cited_by_count":2,"area":"synth"},{"id":"2506.05101","title":"Privacy Amplification Through Synthetic Data: Insights from Linear Regression","created":"2025-06-05","cited_by_count":2,"area":null},{"id":"2509.23963","title":"Evaluating the Robustness of Chinchilla Compute-Optimal Scaling","created":"2025-09-28","cited_by_count":2,"area":null},{"id":"2510.08095","title":"Beyond Real Data: Synthetic Data through the Lens of Regularization","created":"2025-10-09","cited_by_count":2,"area":null},{"id":"2510.22107","title":"Discovering Latent Graphs with GFlowNets for Diverse Conditional Image Generation","created":"2025-10-25","cited_by_count":2,"area":null},{"id":"2512.12381","title":"Entropy Collapse: A Universal Failure Mode of Intelligent Systems","created":"2025-12-13","cited_by_count":2,"area":null},{"id":"2512.15011","title":"Epistemic diversity across language models mitigates knowledge collapse","created":"2025-12-17","cited_by_count":2,"area":null},{"id":"2512.19691","title":"Scalable Stewardship of an LLM-Assisted Clinical Benchmark with Physician Oversight","created":"2025-12-22","cited_by_count":2,"area":null},{"id":"2605.29267","title":"When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop","created":"2026-05-28","cited_by_count":2,"area":null},{"id":"2608.20290","title":"Phantom Gains: Auditing Self-Improvement Against a Measured Null","created":"2026-08-20","cited_by_count":2,"area":"synth"},{"id":"2503.07660","title":"Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimization","created":"2025-03-08","cited_by_count":1,"area":"alignment"},{"id":"2505.19550","title":"Turing Test 2.0: The General Intelligence Threshold","created":"2025-05-26","cited_by_count":1,"area":null},{"id":"2506.09401","title":"A theoretical basis for model collapse in recursive training","created":"2025-06-11","cited_by_count":1,"area":null},{"id":"2506.19262","title":"What Matters in LLM-generated Data: Diversity and Its Effect on Model Fine-Tuning","created":"2025-06-24","cited_by_count":1,"area":"synth"},{"id":"2509.04796","title":"Knowledge Collapse in LLMs: When Fluency Survives but Facts Fail under Recursive Synthetic Training","created":"2025-09-05","cited_by_count":1,"area":"synth"},{"id":"2509.08972","title":"ForTIFAI: Fending Off Recursive Training Induced Failure for AI Model Collapse","created":"2025-09-10","cited_by_count":1,"area":"synth"},{"id":"2509.13047","title":"Multi-Model Synthetic Training for Mission-Critical Small Language Models","created":"2025-09-16","cited_by_count":1,"area":null},{"id":"2509.20101","title":"First-Extinction Law for Resampling Processes","created":"2025-09-24","cited_by_count":1,"area":null},{"id":"2601.05280","title":"Large Language Models are Shannon Lossy Compressors Not Solomonoff Induction Estimators: Self-improvement and Singularity Are Not Near Without Symbolic Model Synthesis","created":"2026-01-05","cited_by_count":1,"area":null},{"id":"2602.10531","title":"From Collapse to Improvement: Statistical Perspectives on the Evolutionary Dynamics of Iterative Training on Contaminated Sources","created":"2026-02-11","cited_by_count":1,"area":"synth"},{"id":"2602.14029","title":"Why Self-Training Helps and Hurts: Denoising vs. Signal Forgetting","created":"2026-02-15","cited_by_count":1,"area":"distill"},{"id":"2604.08554","title":"Drift and selection in LLM text ecosystems","created":"2026-03-15","cited_by_count":1,"area":null},{"id":"2604.25110","title":"Knowledge Distillation Must Account for What It Loses","created":"2026-04-28","cited_by_count":1,"area":"distill"},{"id":"2605.04127","title":"Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communities","created":"2026-05-05","cited_by_count":1,"area":"synth"},{"id":"2605.16245","title":"AI-Mediated Communication Can Steer Collective Opinion","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2606.13732","title":"When Sample Selection Bias Precipitates Model Collapse","created":"2026-06-11","cited_by_count":1,"area":"synth"},{"id":"2607.15623","title":"Retraining Seeks Stable Signals","created":"2026-07-17","cited_by_count":1,"area":null}],"next_cursor":"100"}