Seeing Through the PRISM: Compound & Controllable Restoration of Scientific Images
Not on the map. Why?
Abstract (arXiv)
Scientific and environmental imagery often suffer from complex mixtures of noise related to the sensor and the environment. Existing restoration methods typically remove one degradation at a time, leading to cascading artifacts, overcorrection, or loss of meaningful signal. In scientific applications, restoration must be able to simultaneously handle compound degradations while allowing experts to selectively remove subsets of distortions without erasing important features. To address these challenges, we present PRISM (Precision Restoration with Interpretable Separation of Mixtures). PRISM is a prompted conditional diffusion framework which combines compound-aware supervision over mixed degradations with a weighted contrastive disentanglement objective that aligns primitives and their mixtures in the latent space. This compositional geometry enables high-fidelity joint removal of overlapping distortions while also allowing flexible, targeted fixes through natural language prompts. Across microscopy, wildlife monitoring, remote sensing, and urban weather datasets, PRISM outperforms state-of-the-art baselines on complex compound degradations, including zero-shot mixtures not seen during training. Importantly, we show that selective restoration significantly improves downstream scientific accuracy in several domains over standard "black-box" restoration. These results establish PRISM as a generalizable and controllable framework for high-fidelity restoration in domains where scientific utility is a priority.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 70 references that are in the map. First posted on arXiv 14 Mar 2026.
Builds on
34 of 70 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2024GPT-4o System Cardcited by 4,467
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2020Pre-Trained Image Processing Transformercited by 891
- 2022Simple Baselines for Image Restorationcited by 701
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
22 more
- 2018Understanding disentangling in β-VAEcited by 332
- 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2019Fast Underwater Image Enhancement for Improved Visual Perceptioncited by 181
- 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
- 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
- 2019SEN12MS -- A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusioncited by 95
- 2020On Disentangled Representations Learned From Correlated Datacited by 94
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
- 2023Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restorationcited by 50
- 2020Image Restoration for Under-Display Cameracited by 47
- 2022Deep Constrained Least Squares for Blind Image Super-Resolutioncited by 47
- 2024Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Taskscited by 47
- 2020Multi-Sensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagerycited by 36
- 2024Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Modelscited by 19
- 2021Benchmarking and scaling of deep learning models for land cover image classificationcited by 14
- 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
- 2024AllRestorer: All-in-One Transformer for Image Restoration under Composite Degradationscited by 5
- 2025Compositional Generalization via Forced Rendering of Disentangled Latentscited by 4
- 2023Adaptation of the super resolution SOTA for Art Restoration in camera capture imagescited by 1
Built on by
Not cited yet.