mlsanityData to 7 Oct 2026

Seeing Through the PRISM: Compound & Controllable Restoration of Scientific Images

arXiv 2603.14151 ↗First posted 14 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific and environmental imagery often suffer from complex mixtures of noise related to the sensor and the environment. Existing restoration methods typically remove one degradation at a time, leading to cascading artifacts, overcorrection, or loss of meaningful signal. In scientific applications, restoration must be able to simultaneously handle compound degradations while allowing experts to selectively remove subsets of distortions without erasing important features. To address these challenges, we present PRISM (Precision Restoration with Interpretable Separation of Mixtures). PRISM is a prompted conditional diffusion framework which combines compound-aware supervision over mixed degradations with a weighted contrastive disentanglement objective that aligns primitives and their mixtures in the latent space. This compositional geometry enables high-fidelity joint removal of overlapping distortions while also allowing flexible, targeted fixes through natural language prompts. Across microscopy, wildlife monitoring, remote sensing, and urban weather datasets, PRISM outperforms state-of-the-art baselines on complex compound degradations, including zero-shot mixtures not seen during training. Importantly, we show that selective restoration significantly improves downstream scientific accuracy in several domains over standard "black-box" restoration. These results establish PRISM as a generalizable and controllable framework for high-fidelity restoration in domains where scientific utility is a priority.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 70 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

34 of 70 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  7. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  8. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  9. 2020Pre-Trained Image Processing Transformercited by 891
  10. 2022Simple Baselines for Image Restorationcited by 701
  11. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  12. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
22 more
  1. 2018Understanding disentangling in β-VAEcited by 332
  2. 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
  3. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  4. 2019Fast Underwater Image Enhancement for Improved Visual Perceptioncited by 181
  5. 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
  6. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
  7. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
  8. 2019SEN12MS -- A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusioncited by 95
  9. 2020On Disentangled Representations Learned From Correlated Datacited by 94
  10. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
  11. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  12. 2023Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restorationcited by 50
  13. 2020Image Restoration for Under-Display Cameracited by 47
  14. 2022Deep Constrained Least Squares for Blind Image Super-Resolutioncited by 47
  15. 2024Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Taskscited by 47
  16. 2020Multi-Sensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagerycited by 36
  17. 2024Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Modelscited by 19
  18. 2021Benchmarking and scaling of deep learning models for land cover image classificationcited by 14
  19. 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
  20. 2024AllRestorer: All-in-One Transformer for Image Restoration under Composite Degradationscited by 5
  21. 2025Compositional Generalization via Forced Rendering of Disentangled Latentscited by 4
  22. 2023Adaptation of the super resolution SOTA for Art Restoration in camera capture imagescited by 1

Built on by

Not cited yet.