Inference-Time Refinement Closes the Synthetic-Real Gap in Tabular Diffusion
Not on the map. Why?
Abstract (arXiv)
Diffusion-based generators set the current state of the art for synthetic tabular data. These methods approach but rarely exceed real-data utility, and closing this synthetic-real gap has so far been pursued exclusively at training time, via architectural advances, scaling, and retraining of monolithic generators. The inference-time alternative, i.e., refining the outputs of a pre-trained backbone with parameters left untouched, has remained largely unexplored for tabular synthesis. We introduce TARDIS (Tabular generation through Refinement, Distillation, and Inference-time Sampling), an inference-time refinement framework that operates on a frozen pre-trained backbone, configured per dataset by a Tree-structured Parzen Estimator search over score-level guidance during reverse diffusion, with each trial's objective set by an inner grid search over post-hoc sample selectors and an optional soft-label distillation step. The search space encodes a single mathematical pattern we name Bidirectional Chamfer Refinement (BCR): the symmetric Chamfer functional between synthetic and real samples is minimized both continuously, via a score-level gradient, and discretely, via batch-ranking post-generation. The per-dataset search recovers BCR-aligned configurations on most datasets, evidence for BCR as the dominant refinement pattern. Across 15 binary, multiclass, and regression benchmarks TARDIS achieves a median +8.6% downstream-task improvement over models trained on real data (95% CI [+3.3, +16.4], Wilcoxon p=0.016, 11/15 strict wins) and improves over the TabDiff backbone on all 15 datasets (mean +12.9%, p<10^-4), matching the backbone on manifold fidelity, diversity, and sample-level privacy. Inference-time refinement of a pre-trained tabular diffusion backbone reaches and exceeds real-data utility in 1 to 80 minutes on a single consumer-grade GPU.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
17 of 24 references.
References · 17
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2019Modeling Tabular data using Conditional GANcited by 695
- 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 373
- 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Spacecited by 183
- 2022STaSy: Score-based Tabular data Synthesiscited by 85
- 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesiscited by 78
- 2022CTAB-GAN+: Enhancing Tabular Data Synthesiscited by 70
- 2024TabDiff: a Mixed-type Diffusion Model for Tabular Data Generationcited by 60
5 more
- 2017Information-Based Optimal Subdata Selection for Big Data Linear Regressioncited by 10
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilitiescited by 8
- 2024Federated Knowledge Recycling: Privacy-Preserving Synthetic Data Sharingcited by 7
- 2025Increasing the Utility of Synthetic Images through Chamfer Guidancecited by 6
- 2024Synthetic Image Learning: Preserving Performance and Preventing Membership Inference Attackscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.