LayerMix: Enhanced Data Augmentation through Fractal Integration for Robust Deep Learning
Not on the map. Why?
Abstract (arXiv)
Deep learning models have demonstrated remarkable performance across various computer vision tasks, yet their vulnerability to distribution shifts remains a critical challenge. Despite sophisticated neural network architectures, existing models often struggle to maintain consistent performance when confronted with Out-of-Distribution (OOD) samples, including natural corruptions, adversarial perturbations, and anomalous patterns. We introduce LayerMix, an innovative data augmentation approach that systematically enhances model robustness through structured fractal-based image synthesis. By meticulously integrating structural complexity into training datasets, our method generates semantically consistent synthetic samples that significantly improve neural network generalization capabilities. Unlike traditional augmentation techniques that rely on random transformations, LayerMix employs a structured mixing pipeline that preserves original image semantics while introducing controlled variability. Extensive experiments across multiple benchmark datasets, including CIFAR-10, CIFAR-100, ImageNet-200, and ImageNet-1K demonstrate LayerMixs superior performance in classification accuracy and substantially enhances critical Machine Learning (ML) safety metrics, including resilience to natural image corruptions, robustness against adversarial attacks, improved model calibration and enhanced prediction consistency. LayerMix represents a significant advancement toward developing more reliable and adaptable artificial intelligence systems by addressing the fundamental challenges of deep learning generalization. The code is available at https://github.com/ahmadmughees/layermix.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 74 of its 98 references that are in the map. First posted on arXiv 8 Jan 2025.
Builds on
74 of 98 references.
References · 74
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023GPT-4 Technical Reportcited by 18,132
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
38 more
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Wide Residual Networkscited by 3,057
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2019Natural Adversarial Examplescited by 1,401
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2017Random Erasing Data Augmentationcited by 1,235
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
- 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 422
- 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 417
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2018Feature Denoising for Improving Adversarial Robustnesscited by 312
- 2021Unsolved Problems in ML Safetycited by 291
- 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
- 2019Adversarial Examples Improve Image Recognitioncited by 283
- 2020Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixupcited by 260
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2019Fast AutoAugmentcited by 243
50 most cited of 74 All 74 (JSON)
Built on by
Not cited yet.