Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flow
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Rapidly evolving Generative AI enables sophisticated visual text manipulations that increasingly evade current forensic detectors. Existing discriminative models often overfit specific forgery patterns, limiting their generalization to unseen, open-set attacks. To address this challenge, we propose a generative detector that localizes tampering by estimating the local restoration cost required to align a query image with authentic visual-text statistics, rather than by learning forgery-specific decision boundaries. Specifically, we introduce Sparse-Constraint Rectified Flow (SC-RF), a detector-oriented adaptation of Flow Matching for spatially sparse anomaly localization. We further mitigate data scarcity via self-supervised Artifact Injection and preserve high-frequency forensic traces using a pixel-space Forensic-DiT. Extensive experiments on three benchmarks show that our method achieves state-of-the-art performance, surpassing the runner-up by 3.2 and 4.8 percentage points in F1 and IoU, respectively. In particular, the proposed detector demonstrates strong zero-shot performance on challenging unseen text editing patterns. We further provide an auxiliary stress-test analysis showing that local harmonization produced by our model can weaken the statistical cues relied upon by existing detectors, offering a complementary vulnerability-analysis perspective.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 23 of its 49 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
23 of 49 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2015Towards Open Set Deep Networkscited by 533
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
11 more
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
- 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 212
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2018Learning Rich Features for Image Manipulation Detectioncited by 154
- 2019ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT)cited by 147
- 2019ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboardcited by 127
- 2019ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVTcited by 121
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2024Revisiting Tampered Scene Text Detection in the Era of Generative AIcited by 21
- 2023Toward Real Text Manipulation Detection: New Dataset and New Solutioncited by 20
- 2026Detecting AI-Generated Forgeries via Iterative Manifold Deviation Amplificationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CLUE: Leveraging Low-Rank Adaptation to Capture Latent Uncovered Evidence for Image Forgery Localization
- 2026SEED: Simple ViT and Evolving Harness for Explainable Text Forgery Detection
- 2026ForensicZip: More Tokens are Better but Not Necessary in Forensic Vision-Language Models
- 2026TextShield-R1: Reinforced Reasoning for Tampered Text Detection
- 2026Team MSU GenText-Forensics Challenge 2026 Technical Report
- 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
- 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline