Contourlet Refinement Gate Framework for Thermal Spectrum Distribution Regularized Infrared Image Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Image super-resolution (SR) is a classical yet still active low-level vision problem that aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts, serving as a key technique for image enhancement. Current approaches to address SR tasks, such as transformer-based and diffusion-based methods, are either dedicated to extracting RGB image features or assuming similar degradation patterns, neglecting the inherent modal disparities between infrared and visible images. When directly applied to infrared image SR tasks, these methods inevitably distort the infrared spectral distribution, compromising the machine perception in downstream tasks. In this work, we emphasize the infrared spectral distribution fidelity and propose a Contourlet refinement gate framework to restore infrared modal-specific features while preserving spectral distribution fidelity. Our approach captures high-pass subbands from multi-scale and multi-directional infrared spectral decomposition to recover infrared-degraded information through a gate architecture. The proposed Spectral Fidelity Loss regularizes the spectral frequency distribution during reconstruction, which ensures the preservation of both high- and low-frequency components and maintains the fidelity of infrared-specific features. We propose a two-stage prompt-learning optimization to guide the model in learning infrared HR characteristics from LR degradation. Extensive experiments demonstrate that our approach outperforms existing image SR models in both visual and perceptual tasks while notably enhancing machine perception in downstream tasks. Our code is available at https://github.com/hey-it-s-me/CoRPLE.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 44 of its 93 references that are in the map. First posted on arXiv 19 Nov 2024.
Builds on
44 of 93 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
32 more
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2018Dual Attention Network for Scene Segmentationcited by 1,003
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 627
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
- 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 394
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
- 2021Deblurring via Stochastic Refinementcited by 249
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
- 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 218
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 129
- 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
- 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
- 2023DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Modelscited by 41
- 2022Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolutioncited by 30
- 2024CAMixerSR: Only Details Need More "Attention"cited by 30
- 2022Mitigating Artifacts in Real-World Video Super-Resolution Modelscited by 29
- 2023Bilevel Fast Scene Adaptation for Low-Light Image Enhancementcited by 22
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 2.
6 papers.
- 2024Unsupervised Hyperspectral Image Super-Resolution via Self-Supervised Modality Decouplingcited by 26
- 2025Rethinking Causal Mask Attention for Vision-Language Inferencecited by 6
- 2026HATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-Resolutioncited by 1
- 2026Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Imagescited by 1
- 2024MPSI: Mamba enhancement model for pixel-wise sequential interaction Image Super-Resolutioncited by 0
- 2024EchoIR: Advancing Image Restoration with Echo Upsampling and Bi-Level Optimizationcited by 0
- 2026Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images13 May 2026
- 2026HATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-Resolution8 Jan 2026
- 2025Rethinking Causal Mask Attention for Vision-Language Inference24 May 2025
- 2024EchoIR: Advancing Image Restoration with Echo Upsampling and Bi-Level Optimization10 Dec 2024
- 2024MPSI: Mamba enhancement model for pixel-wise sequential interaction Image Super-Resolution10 Dec 2024
- 2024Unsupervised Hyperspectral Image Super-Resolution via Self-Supervised Modality Decoupling6 Dec 2024