mlsanityData to 7 Oct 2026

MFI-ResNet: Efficient ResNet Architecture Optimization via MeanFlow Compression and Selective Incubation

arXiv 2511.12422 ↗First posted 16 Nov 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

ResNet has achieved tremendous success in computer vision through its residual connection mechanism. ResNet can be viewed as a discretized form of ordinary differential equations (ODEs). From this perspective, the multiple residual blocks within a single ResNet stage essentially perform multi-step discrete iterations of the feature transformation for that stage. The recently proposed flow matching model, MeanFlow, enables one-step generative modeling by learning the mean velocity field to transform distributions. Inspired by this, we propose MeanFlow-Incubated ResNet (MFI-ResNet), which employs a compression-expansion strategy to jointly improve parameter efficiency and discriminative performance. In the compression phase, we simplify the multi-layer structure within each ResNet stage to one or two MeanFlow modules to construct a lightweight meta model. In the expansion phase, we apply a selective incubation strategy to the first three stages, expanding them to match the residual block configuration of the baseline ResNet model, while keeping the last stage in MeanFlow form, and fine-tune the incubated model. Experimental results show that on CIFAR-10 and CIFAR-100 datasets, MFI-ResNet achieves remarkable parameter efficiency, reducing parameters by 46.28% and 45.59% compared to ResNet-50, while still improving accuracy by 0.23% and 0.17%, respectively. This demonstrates that generative flow-fields can effectively characterize the feature transformation process in ResNet, providing a new perspective for understanding the relationship between generative modeling and discriminative learning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 30 references that are in the map. First posted on arXiv 16 Nov 2025.

Builds on

28 of 30 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  8. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  11. 2017Squeeze-and-Excitation Networkscited by 4,763
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
16 more
  1. 2018Neural Ordinary Differential Equationscited by 3,733
  2. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  4. 2016Pyramid Scene Parsing Networkcited by 2,472
  5. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  6. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  7. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  8. 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
  9. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  10. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
  11. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  12. 2025Mean Flows for One-step Generative Modelingcited by 524
  13. 2019Augmented Neural ODEscited by 396
  14. 2017Stable Architectures for Deep Neural Networkscited by 340
  15. 2017Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equationscited by 203
  16. 2022Deep Incubation: Training Large Models by Divide-and-Conqueringcited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation
  2. 2025RecTok: Reconstruction Distillation along Rectified Flow
  3. 2025Reversing Flow for Image Restoration
  4. 2025Foundations and Models in Modern Computer Vision: Key Building Blocks in Landmark Architectures
  5. 2025AlphaFlow: Understanding and Improving MeanFlow Models
  6. 2026RFMSR: Residual Flow Matching for Image Super-Resolution
  7. 2025Coupled Flow Matching
  8. 2025Blockwise Flow Matching: Improving Flow Matching Models For Efficient High-Quality Generation