Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance
Not on the map. Why?
Abstract (arXiv)
While 10B-level industrial foundation models have pushed the boundaries of image inpainting, their prohibitive computational costs severely hinder practical deployment. Constructing a highly optimized task-specific specialist offers a promising solution; however, extreme structural compression inevitably triggers a severe representation bottleneck. To conquer this, we propose Moebius, a highly efficient lightweight inpainting framework. We systematically reconstruct the diffusion backbone by introducing the Local-λ Mix Interaction (Lλ MI) block. Comprising Local-λ and Interactive-λ modules, it elegantly summarizes spatial contexts and global semantic priors into fixed-size linear matrices, preserving complex latent interactions while drastically shedding parameters. Furthermore, to unlock the full representational capacity of this highly compact architecture, we synergistically pair it with an adaptive multi-granularity distillation strategy. Operating strictly within the latent space to avoid expensive pixel-space decoding, this strategy dynamically balances multiple gradient-based losses to achieve high-fidelity alignment. Extensive experiments across natural and portrait benchmarks demonstrate that this optimal synergy enables Moebius to rival or even surpass the generation quality of the 10B-level industrial generalist FLUX.1-Fill-Dev. Remarkably, Moebius achieves this using less than 2% of the parameters (0.22B vs. 11.9B) while delivering a >15× acceleration in total inference time, setting a new efficiency standard for high-fidelity inpainting. Project page at https://hustvl.github.io/Moebius.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 69 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
51 of 69 references.
References · 51
- 2017Attention Is All You Needcited by 60,361
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2020GLU Variants Improve Transformercited by 1,804
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2021Distilling Knowledge via Knowledge Reviewcited by 288
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2024OpenMoE: An Early Effort on Open Mixture-of-Experts Language Modelscited by 187
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
- 2022Rethinking Vision Transformers for MobileNet Size and Speedcited by 121
- 2021LambdaNetworks: Modeling Long-Range Interactions Without Attentioncited by 107
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 99
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2024Distilling Diffusion Models into Conditional GANscited by 78
- 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Modelscited by 67
- 2024DiG: Scalable and Efficient Diffusion Models with Gated Linear Attentioncited by 56
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Modelscited by 36
- 2021Image Inpainting by End-to-End Cascaded Refinement with Mask Awarenesscited by 35
- 2025RORem: Training a Robust Object Remover with Human-in-the-Loopcited by 23
- 2025PixelHacker: Image Inpainting with Structural and Semantic Consistencycited by 8
- 2024Don't Look into the Dark: Latent Codes for Pluralistic Image Inpaintingcited by 6
- 2024MoSt-DSA: Modeling Motion and Structural Interactions for Direct Multi-Frame Interpolation in DSA Imagescited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.