mlsanityData to 14 Oct 2026

Ctrl-GenAug: Controllable Generative Augmentation for Medical Sequence Classification

arXiv 2409.17091 ↗First posted 25 Sep 2024cs.CV cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

In the medical field, the limited availability of large-scale datasets and labor-intensive annotation processes hinder the performance of deep models. Diffusion-based generative augmentation approaches present a promising solution to this issue, having been proven effective in advancing downstream medical recognition tasks. Nevertheless, existing works lack sufficient semantic and sequential steerability for challenging video/3D sequence generation, and neglect quality control of noisy synthesized samples, resulting in unreliable synthetic databases and severely limiting the performance of downstream tasks. In this work, we present Ctrl-GenAug, a novel and general generative augmentation framework that enables highly semantic- and sequential-customized sequence synthesis and suppresses incorrectly synthesized samples, to aid medical sequence classification. Specifically, we first design a multimodal conditions-guided sequence generator for controllably synthesizing diagnosis-promotive samples. A sequential augmentation module is integrated to enhance the temporal/stereoscopic coherence of generated samples. Then, we propose a noisy synthetic data filter to suppress unreliable cases at semantic and sequential levels. Extensive experiments on 3 medical datasets, using 11 networks trained on 3 paradigms, comprehensively analyze the effectiveness and generality of Ctrl-GenAug, particularly in underrepresented high-risk populations and out-domain conditions.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 86 of its 135 references that are in the map. First posted on arXiv 25 Sep 2024.

Builds on

86 of 135 references.

References · 86

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  9. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  11. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  12. 2022Video Diffusion Modelscited by 2,305
38 more
  1. 2018SlowFast Networks for Video Recognitioncited by 1,867
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  4. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  5. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  6. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  9. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  10. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  11. 2021Video Swin Transformercited by 1,091
  12. 2022Diffusion Models in Vision: A Surveycited by 1,015
  13. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  14. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
  15. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  16. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  17. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  18. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
  19. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  20. 2022Is synthetic data from generative models ready for image recognition?cited by 320
  21. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
  22. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  23. 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
  24. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 285
  25. 2023Effective Data Augmentation With Diffusion Modelscited by 283
  26. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 181
  27. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  28. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
  29. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  30. 2020Temporal Pyramid Network for Action Recognitioncited by 163
  31. 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
  32. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
  33. 2018Train Sparsely, Generate Densely: Memory-efficient Unsupervised Training of High-resolution Temporal GANcited by 120
  34. 2022UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormercited by 116
  35. 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
  36. 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
  37. 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 86
  38. 2023Fast ODE-based Sampling for Diffusion Models in Around 5 Stepscited by 84

50 most cited of 86 All 86 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generation
  2. 2024Deep Generative Models Unveil Patterns in Medical Images Through Vision-Language Conditioning
  3. 2023Synthetic Augmentation with Large-scale Unconditional Pre-training
  4. 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Models
  5. 2023Utilizing Synthetic Data for Medical Vision-Language Pre-training: Bypassing the Need for Real Images
  6. 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review
  7. 2026GenMed: A Pairwise Generative Reformulation of Medical Diagnostic Tasks
  8. 2024Test-time generative augmentation for medical image segmentation