mlsanityData to 14 Oct 2026

Repurposing Image Diffusion Models for Adversarial Synthetic Structured Data: A Case Study of Ground Truth Drift

arXiv 2605.00788 ↗First posted 1 May 2026cs.CRcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Public image diffusion models are now powerful enough that an attacker without the resources to train a tabular-specific generator may repurpose one off the shelf. This study tests that possibility directly. An unmodified Stable Diffusion U-Net is applied to the UCI Adult Income dataset by reshaping each row into a small single-channel pseudo-image. The architecture's inductive bias toward spatial locality makes feature placement a design variable, and several layouts are tested. However, this is only the beginning of the story, as this paper also draws two philosophical distinctions. One separates statistical from perceptual realism: whether synthetic content holds up to a machine's correlation audits or a human's sensory inspection. The other introduces synthetic evidence as a category alongside synthetic media: AI-generated material whose consumer is a machine in a closed evidentiary pipeline rather than a person in an open information system. An attacker succeeds with synthetic evidence by thinking like the machine that will receive it. And the more the attacker succeeds, the more they can induce ground truth drift: the silent reclassification of AI-generated outputs as authentic when reused in pipelines that do not interrogate their provenance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 11 of its 20 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

11 of 20 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2019Modeling Tabular data using Conditional GANcited by 699
  4. 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
  5. 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 333
  6. 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 147
  7. 2022Synthetic Data -- what, why and how?cited by 67
  8. 2020Evaluating the Clinical Realism of Synthetic Chest X-Rays Generated Using Progressively Growing GANscited by 17
  9. 2024Diffusion Models for Tabular Data Imputation and Synthetic Data Generationcited by 15
  10. 2022medigan: a Python library of pretrained generative models for medical image synthesiscited by 14
  11. 2024CTSyn: A Foundation Model for Cross Tabular Data Generationcited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Detecting AI-Generated Images via Diffusion Snap-Back Reconstruction: A Forensic Approach
  2. 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion models
  3. 2022On the detection of synthetic images generated by diffusion models
  4. 2024Deceptive Diffusion: Generating Synthetic Adversarial Examples
  5. 2024Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AI
  6. 2025Beyond Known Fakes: Generalized Detection of AI-Generated Images via Post-hoc Distribution Alignment
  7. 2025Who Made This? Fake Detection and Source Attribution with Diffusion Features
  8. 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methods