MFI-ResNet: Efficient ResNet Architecture Optimization via MeanFlow Compression and Selective Incubation
Not on the map. Why?
Abstract (arXiv)
ResNet has achieved tremendous success in computer vision through its residual connection mechanism. ResNet can be viewed as a discretized form of ordinary differential equations (ODEs). From this perspective, the multiple residual blocks within a single ResNet stage essentially perform multi-step discrete iterations of the feature transformation for that stage. The recently proposed flow matching model, MeanFlow, enables one-step generative modeling by learning the mean velocity field to transform distributions. Inspired by this, we propose MeanFlow-Incubated ResNet (MFI-ResNet), which employs a compression-expansion strategy to jointly improve parameter efficiency and discriminative performance. In the compression phase, we simplify the multi-layer structure within each ResNet stage to one or two MeanFlow modules to construct a lightweight meta model. In the expansion phase, we apply a selective incubation strategy to the first three stages, expanding them to match the residual block configuration of the baseline ResNet model, while keeping the last stage in MeanFlow form, and fine-tune the incubated model. Experimental results show that on CIFAR-10 and CIFAR-100 datasets, MFI-ResNet achieves remarkable parameter efficiency, reducing parameters by 46.28% and 45.59% compared to ResNet-50, while still improving accuracy by 0.23% and 0.17%, respectively. This demonstrates that generative flow-fields can effectively characterize the feature transformation process in ResNet, providing a new perspective for understanding the relationship between generative modeling and discriminative learning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 30 references that are in the map. First posted on arXiv 16 Nov 2025.
Builds on
28 of 30 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
16 more
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2019Augmented Neural ODEscited by 396
- 2017Stable Architectures for Deep Neural Networkscited by 340
- 2017Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equationscited by 203
- 2022Deep Incubation: Training Large Models by Divide-and-Conqueringcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation
- 2025RecTok: Reconstruction Distillation along Rectified Flow
- 2025Reversing Flow for Image Restoration
- 2025Foundations and Models in Modern Computer Vision: Key Building Blocks in Landmark Architectures
- 2025AlphaFlow: Understanding and Improving MeanFlow Models
- 2026RFMSR: Residual Flow Matching for Image Super-Resolution
- 2025Coupled Flow Matching
- 2025Blockwise Flow Matching: Improving Flow Matching Models For Efficient High-Quality Generation