Ctrl-GenAug: Controllable Generative Augmentation for Medical Sequence Classification
Not on the map. Why?
Abstract (arXiv)
In the medical field, the limited availability of large-scale datasets and labor-intensive annotation processes hinder the performance of deep models. Diffusion-based generative augmentation approaches present a promising solution to this issue, having been proven effective in advancing downstream medical recognition tasks. Nevertheless, existing works lack sufficient semantic and sequential steerability for challenging video/3D sequence generation, and neglect quality control of noisy synthesized samples, resulting in unreliable synthetic databases and severely limiting the performance of downstream tasks. In this work, we present Ctrl-GenAug, a novel and general generative augmentation framework that enables highly semantic- and sequential-customized sequence synthesis and suppresses incorrectly synthesized samples, to aid medical sequence classification. Specifically, we first design a multimodal conditions-guided sequence generator for controllably synthesizing diagnosis-promotive samples. A sequential augmentation module is integrated to enhance the temporal/stereoscopic coherence of generated samples. Then, we propose a noisy synthetic data filter to suppress unreliable cases at semantic and sequential levels. Extensive experiments on 3 medical datasets, using 11 networks trained on 3 paradigms, comprehensively analyze the effectiveness and generality of Ctrl-GenAug, particularly in underrepresented high-risk populations and out-domain conditions.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 86 of its 135 references that are in the map. First posted on arXiv 25 Sep 2024.
Builds on
86 of 135 references.
References · 86
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2022Video Diffusion Modelscited by 2,305
38 more
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2021Video Swin Transformercited by 1,091
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
- 2022Is synthetic data from generative models ready for image recognition?cited by 320
- 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
- 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 285
- 2023Effective Data Augmentation With Diffusion Modelscited by 283
- 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 181
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
- 2020Temporal Pyramid Network for Action Recognitioncited by 163
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
- 2018Train Sparsely, Generate Densely: Memory-efficient Unsupervised Training of High-resolution Temporal GANcited by 120
- 2022UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormercited by 116
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 86
- 2023Fast ODE-based Sampling for Diffusion Models in Around 5 Stepscited by 84
50 most cited of 86 All 86 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Semantics versus Identity: A Divide-and-Conquer Approach towards Adjustable Medical Image De-Identificationcited by 2
- 2025Subtyping Breast Lesions via Generative Augmentation based Long-tailed Recognition in Ultrasoundcited by 1
- 2026FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detectioncited by 1
- 2026Deep Learning-based Intelligent Diagnosis of Congenital Uterine Anomalies in 3D Ultrasoundcited by 0
- 2026Deep Learning-based Intelligent Diagnosis of Congenital Uterine Anomalies in 3D Ultrasound14 Sep 2026
- 2026FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detection1 Jul 2026
- 2025Subtyping Breast Lesions via Generative Augmentation based Long-tailed Recognition in Ultrasound30 Jul 2025
- 2025Semantics versus Identity: A Divide-and-Conquer Approach towards Adjustable Medical Image De-Identification25 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2022SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generation
- 2024Deep Generative Models Unveil Patterns in Medical Images Through Vision-Language Conditioning
- 2023Synthetic Augmentation with Large-scale Unconditional Pre-training
- 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Models
- 2023Utilizing Synthetic Data for Medical Vision-Language Pre-training: Bypassing the Need for Real Images
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review
- 2026GenMed: A Pairwise Generative Reformulation of Medical Diagnostic Tasks
- 2024Test-time generative augmentation for medical image segmentation