Synthetic Tabular Generators Fail to Preserve Behavioral Fraud Patterns: A Benchmark on Temporal, Velocity, and Multi-Account Signals
Not on the map. Why?
Abstract (arXiv)
We introduce behavioral fidelity -- a third evaluation dimension for synthetic tabular data that measures whether generated data preserves the temporal, sequential, and structural behavioral patterns that distinguish real-world entity activity. Existing frameworks evaluate statistical fidelity (marginal distributions and correlations) and downstream utility (classifier AUROC on synthetic-trained models), but neither tests for the behavioral signals that operational detection and analysis systems actually rely on. We formalize a taxonomy of four behavioral fraud patterns (P1-P4) covering inter-event timing, burst structure, multi-account graph motifs, and velocity-rule trigger rates; define a degradation ratio metric calibrated to a real-data noise floor (1.0 = matches real variability, k = k-times worse); and prove that row-independent generators -- the dominant paradigm -- are structurally incapable of reproducing P3 graph motifs (Proposition 1) and produce non-positive within-entity IET autocorrelation (Proposition 2), making the positive burst fingerprint of fraud sequences unachievable regardless of architecture or training data size. We benchmark CTGAN, TVAE, GaussianCopula, and TabularARGN on IEEE-CIS Fraud Detection and the Amazon Fraud Dataset. All four fail severely: on IEEE-CIS composite degradation ratios range from 24.4x (TVAE) to 39.0x (GaussianCopula); on Amazon FDB, row-independent generators score 81.6-99.7x, while TabularARGN achieves 17.2x. We document generator-specific failure modes and their resolutions. The P1-P4 framework extends to any domain with entity-level sequential tabular data, including healthcare and network security. We release our evaluation framework as open source.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 22 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
11 of 22 references.
References · 11
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2019Modeling Tabular data using Conditional GANcited by 699
- 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
- 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 333
- 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Spacecited by 186
- 2023REaLTabFormer: Generating Realistic Relational and Tabular Data using Transformerscited by 94
- 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Textcited by 76
- 2020xFraud: Explainable Fraud Transaction Detectioncited by 28
- 2024SynthEval: A Framework for Detailed Utility and Privacy Evaluation of Tabular Synthetic Datacited by 27
- 2024Improve Fidelity and Utility of Synthetic Credit Card Transaction Time Series from Data-centric Perspectivecited by 5
- 2025New Money: A Systematic Review of Synthetic Data Generation for Financecited by 5
Built on by
Not cited yet.