mlsanityData to 14 Oct 2026

Contourlet Refinement Gate Framework for Thermal Spectrum Distribution Regularized Infrared Image Super-Resolution

arXiv 2411.12530 ↗First posted 19 Nov 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Image super-resolution (SR) is a classical yet still active low-level vision problem that aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts, serving as a key technique for image enhancement. Current approaches to address SR tasks, such as transformer-based and diffusion-based methods, are either dedicated to extracting RGB image features or assuming similar degradation patterns, neglecting the inherent modal disparities between infrared and visible images. When directly applied to infrared image SR tasks, these methods inevitably distort the infrared spectral distribution, compromising the machine perception in downstream tasks. In this work, we emphasize the infrared spectral distribution fidelity and propose a Contourlet refinement gate framework to restore infrared modal-specific features while preserving spectral distribution fidelity. Our approach captures high-pass subbands from multi-scale and multi-directional infrared spectral decomposition to recover infrared-degraded information through a gate architecture. The proposed Spectral Fidelity Loss regularizes the spectral frequency distribution during reconstruction, which ensures the preservation of both high- and low-frequency components and maintains the fidelity of infrared-specific features. We propose a two-stage prompt-learning optimization to guide the model in learning infrared HR characteristics from LR degradation. Extensive experiments demonstrate that our approach outperforms existing image SR models in both visual and perceptual tasks while notably enhancing machine perception in downstream tasks. Our code is available at https://github.com/hey-it-s-me/CoRPLE.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 44 of its 93 references that are in the map. First posted on arXiv 19 Nov 2024.

Builds on

44 of 93 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  10. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  11. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
32 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  2. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  3. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  4. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  5. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  6. 2018Dual Attention Network for Scene Segmentationcited by 1,003
  7. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  8. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  9. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  10. 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 627
  11. 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
  12. 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
  13. 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 394
  14. 2018Deep Learning for Generic Object Detection: A Surveycited by 392
  15. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
  16. 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
  17. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
  18. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
  19. 2021Deblurring via Stochastic Refinementcited by 249
  20. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
  21. 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
  22. 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 218
  23. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 129
  24. 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
  25. 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
  26. 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
  27. 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
  28. 2023DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Modelscited by 41
  29. 2022Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolutioncited by 30
  30. 2024CAMixerSR: Only Details Need More "Attention"cited by 30
  31. 2022Mitigating Artifacts in Real-World Video Super-Resolution Modelscited by 29
  32. 2023Bilevel Fast Scene Adaptation for Low-Light Image Enhancementcited by 22

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 2.

6 papers.