mlsanityData to 7 Oct 2026

LayerMix: Enhanced Data Augmentation through Fractal Integration for Robust Deep Learning

arXiv 2501.04861 ↗First posted 8 Jan 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning models have demonstrated remarkable performance across various computer vision tasks, yet their vulnerability to distribution shifts remains a critical challenge. Despite sophisticated neural network architectures, existing models often struggle to maintain consistent performance when confronted with Out-of-Distribution (OOD) samples, including natural corruptions, adversarial perturbations, and anomalous patterns. We introduce LayerMix, an innovative data augmentation approach that systematically enhances model robustness through structured fractal-based image synthesis. By meticulously integrating structural complexity into training datasets, our method generates semantically consistent synthetic samples that significantly improve neural network generalization capabilities. Unlike traditional augmentation techniques that rely on random transformations, LayerMix employs a structured mixing pipeline that preserves original image semantics while introducing controlled variability. Extensive experiments across multiple benchmark datasets, including CIFAR-10, CIFAR-100, ImageNet-200, and ImageNet-1K demonstrate LayerMixs superior performance in classification accuracy and substantially enhances critical Machine Learning (ML) safety metrics, including resilience to natural image corruptions, robustness against adversarial attacks, improved model calibration and enhanced prediction consistency. LayerMix represents a significant advancement toward developing more reliable and adaptable artificial intelligence systems by addressing the fundamental challenges of deep learning generalization. The code is available at https://github.com/ahmadmughees/layermix.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 74 of its 98 references that are in the map. First posted on arXiv 8 Jan 2025.

Builds on

74 of 98 references.

References · 74

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2023GPT-4 Technical Reportcited by 18,132
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  8. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  9. 2017Mask R-CNNcited by 7,259
  10. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  11. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  12. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
38 more
  1. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  2. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2016Wide Residual Networkscited by 3,057
  6. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  8. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
  9. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  10. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  11. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  12. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
  13. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  14. 2019Natural Adversarial Examplescited by 1,401
  15. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  16. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  17. 2017Random Erasing Data Augmentationcited by 1,235
  18. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  19. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
  20. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  21. 2018Deep Anomaly Detection with Outlier Exposurecited by 939
  22. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
  23. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  24. 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
  25. 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
  26. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  27. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  28. 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
  29. 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 422
  30. 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 417
  31. 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
  32. 2018Feature Denoising for Improving Adversarial Robustnesscited by 312
  33. 2021Unsolved Problems in ML Safetycited by 291
  34. 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
  35. 2019Adversarial Examples Improve Image Recognitioncited by 283
  36. 2020Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixupcited by 260
  37. 2021Voxel Transformer for 3D Object Detectioncited by 247
  38. 2019Fast AutoAugmentcited by 243

50 most cited of 74 All 74 (JSON)

Built on by

Not cited yet.