UniSER: A Foundation Model for Unified Soft Effects Removal
Not on the map. Why?
Abstract (arXiv)
Digital images are often degraded by soft effects such as lens flare, haze, shadows, and reflections, which reduce aesthetics even though the underlying pixels remain partially visible. The prevailing works address these degradations in isolation, developing highly specialized, specialist models that lack scalability and fail to exploit the shared underlying essences of these restoration problems. Meanwhile, although recent large-scale generalist models (e.g., GPT-4o, Flux Kontext, Nano Banana) offer powerful text-driven editing capabilities, they heavily rely on detailed prompts and often fail to achieve robust removal on such fine-grained tasks while preserving the scene's identity. Leveraging the common essence of soft effects, i.e., semi-transparent occlusions, we introduce a foundational versatile model UniSER, capable of addressing diverse degradations caused by soft effects within a single framework. Our methodology centers on curating a massive 3.8M-pair dataset to ensure robustness and generalization, which includes novel, physically-plausible data to fill critical gaps in public benchmarks, and a tailored training pipeline that fine-tunes a Diffusion Transformer to learn robust restoration priors from this diverse data, integrating fine-grained mask and strength controls. This synergistic approach allows UniSER to significantly outperform both specialist and generalist models, achieving robust, high-fidelity restoration in the wild.
Key facts. Cited by 5 papers in the map (data through 13 Oct 2026). Builds on 83 of its 118 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
83 of 118 references.
References · 83
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
- 2020Denoising Diffusion Implicit Modelscited by 9,718
- 2023Segment Anythingcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2024GPT-4o System Cardcited by 4,536
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
- 2023Qwen Technical Reportcited by 3,310
- 2020Supervised Contrastive Learningcited by 2,811
38 more
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,546
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,421
- 2024Depth Anything V2cited by 1,399
- 2025DINOv3cited by 1,355
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,353
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,176
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 985
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 908
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 773
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 733
- 2018End-to-End Multi-Task Learning with Attentioncited by 533
- 2017Benchmarking Single Image Dehazing and Beyondcited by 446
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 278
- 2022Vision Transformers for Single Image Dehazingcited by 258
- 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
- 2017Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removalcited by 161
- 2020MTI-Net: Multi-Scale Task Interaction Networks for Multi-Task Learningcited by 157
- 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
- 2019Dense Haze: A benchmark for image dehazing with dense-haze and haze-free imagescited by 107
- 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 103
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 101
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 99
- 2018Single Image Reflection Separation with Perceptual Lossescited by 98
- 2019Shadow Removal via Shadow Image Decompositioncited by 97
- 2018O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor imagescited by 95
- 2018Gated Context Aggregation Network for Image Dehazing and Derainingcited by 89
- 2022InvPT: Inverted Pyramid Multi-task Transformer for Dense Scene Understandingcited by 89
- 2018Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazingcited by 79
- 2021Auto-Exposure Fusion for Single-Image Shadow Removalcited by 79
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
- 2020Polarized Reflection Removal with Perfect Alignment in the Wildcited by 69
- 2022DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using Unsupervised Domain-Classifier Guided Networkcited by 69
- 2018I-HAZE: a dehazing benchmark with real hazy and haze-free indoor imagescited by 64
- 2017A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothingcited by 60
50 most cited of 83 All 83 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026MTPano: Multi-Task Panoramic Scene Understanding via Label-Free Integration of Dense Prediction Priorscited by 5
- 2026DiffHDR: Re-Exposing LDR Videos with Video Diffusion Modelscited by 3
- 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformercited by 2
- 2026Beyond Thinking: Imagining in 360^circ for Humanoid Visual Searchcited by 0
- 2026HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editingcited by 0
- 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformer17 Aug 2026
- 2026HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editing11 Jun 2026
- 2026Beyond Thinking: Imagining in 360^circ for Humanoid Visual Search9 May 2026
- 2026DiffHDR: Re-Exposing LDR Videos with Video Diffusion Models7 Apr 2026
- 2026MTPano: Multi-Task Panoramic Scene Understanding via Label-Free Integration of Dense Prediction Priors5 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026MDTD-ArtIR: Benchmarking Image Editing and Restoration Models for Art Image Restoration under Texture-Overlay Degradations
- 2025UniRes: Universal Image Restoration for Complex Degradations
- 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models
- 2025UniLDiff: Unlocking the Power of Diffusion Priors for All-in-One Image Restoration
- 2026OmniLight: One Model to Rule All Lighting Conditions
- 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
- 2026UNet-AF: Alias-free UNet architectures
- 2026UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration