mlsanityData to 14 Oct 2026

Screening Collapse under Recursive Synthetic Data

arXiv 2610.15617 ↗First posted 11 Oct 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recursive synthetic-data training can degrade a fitted model, but its effects on the variable-screening stage that precedes model fitting are less understood. When each generation labels data for the next, a marginal screener ranks variables against the current pseudo-label target rather than the original response. Across generations, this target drift can erode or reverse the active--inactive score margin and cause screening to discard variables that clean-label screening would retain. We call this process screening collapse. In a Gaussian linear model with minimum-norm recursive generators, we establish finite-sample screening bounds, characterize a late-generation information-loss limit, and derive a minimax impossibility result. Screening collapse can precede and compound ordinary model collapse: omitted variables incur a covariance-weighted loss that no refit restricted to the selected variables can eliminate, while recursive labels further degrade estimation on the retained variables. We also examine two approaches to mitigating screening collapse. Fixed-fraction real-label retention preserves a clean-label component but leaves resolution fixed, whereas data accumulation can avoid screening collapse if the pooled target preserves a positive margin and the growing sample resolves it. Numerical experiments on gene-expression data support the theoretical findings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 37 references that are in the map. First posted on arXiv 11 Oct 2026.

Builds on

15 of 37 references.

References · 15

  1. 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
  2. 2019Benign Overfitting in Linear Regressioncited by 549
  3. 2019Surprises in High-Dimensional Ridgeless Least Squares Interpolationcited by 513
  4. 2023Self-Consuming Generative Models Go MADcited by 250
  5. 2024Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Datacited by 151
  6. 2024A Tale of Tails: Model Collapse as a Change of Scaling Lawscited by 130
  7. 2023On the Stability of Iterative Retraining of Generative Models on their own Datacited by 100
  8. 2024Model Collapse Demystified: The Case of Regressioncited by 82
  9. 2024How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapsecited by 79
  10. 2022Data Feedback Loops: Model-driven Amplification of Dataset Biasescited by 60
  11. 2024Collapse or Thrive? Perils and Promises of Synthetic Data in a Self-Generating Worldcited by 52
  12. 2024Towards Theoretical Understandings of Self-Consuming Generative Modelscited by 29
3 more
  1. 2021Splitting strategies for post-selection inferencecited by 16
  2. 2025When Models Don't Collapse: On the Consistency of Iterative MLEcited by 13
  3. 2026When Sample Selection Bias Precipitates Model Collapsecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Rate of Model Collapse in Recursive Training
  2. 2025Recursive Learning Without Collapse: A Weighting-Based Stabilization Framework
  3. 2025A Probabilistic Perspective on Model Collapse
  4. 2025Preventing Model Collapse Under Overparametrization: Optimal Mixing Ratios for Interpolation Learning and Ridge Regression
  5. 2026Learning with Synthetic Data via SGD in High-Dimensional Linear Regression
  6. 2026Quantifying Error Propagation and Model Collapse in Diffusion Models
  7. 2025Escaping Model Collapse via Synthetic Data Verification: Near-term Improvements and Long-term Convergence
  8. 2025A Closer Look at Model Collapse: From a Generalization-to-Memorization Perspective