Teacher-Guided Causal Interventions for Image Denoising: Orthogonal Content-Noise Disentanglement in Vision Transformers
Not on the map. Why?
Abstract (arXiv)
Conventional image denoising models often inadvertently learn spurious correlations between environmental factors and noise patterns. Moreover, due to high-frequency ambiguity, they struggle to reliably distinguish subtle textures from stochastic noise, resulting in over-removed details or residual noise artifacts. We therefore revisit denoising via causal intervention, arguing that purely correlational fitting entangles intrinsic content with extrinsic noise, which directly degrades robustness under distribution shifts. Motivated by this, we propose the Teacher-Guided Causal Disentanglement Network (TCD-Net), which explicitly decomposes the generative mechanism via structured interventions on feature spaces within a Vision Transformer framework. Specifically, our method integrates three key components: (1) An Environmental Bias Adjustment (EBA) module projects features into a stable, de-centered subspace to suppress global environmental bias (de-confounding). (2) A dual-branch disentanglement head employs an orthogonality constraint to force a strict separation between content and noise representations, preventing information leakage. (3) To resolve structural ambiguity, we leverage Nano Banana Pro, Google's reasoning-guided AI image generation model, to guide a causal prior, effectively pulling content representations back onto the natural-image manifold. Extensive experiments demonstrate that TCD-Net outperforms mainstream methods across multiple benchmarks in both fidelity and efficiency, achieving a real-time speed of 104.2 FPS on a single RTX 5090 GPU.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 1 Mar 2026.
Builds on
33 of 45 references.
References · 33
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2017Deep Image Priorcited by 1,097
21 more
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022Simple Baselines for Image Restorationcited by 701
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
- 2021Conditional Positional Encodings for Vision Transformerscited by 402
- 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 359
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
- 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 255
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
- 2019Real Image Denoising with Feature Attentioncited by 176
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2024MambaIRv2: Attentive State Space Restorationcited by 90
- 2022Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesiscited by 85
- 2023HAT: Hybrid Attention Transformer for Image Restorationcited by 64
- 2021Dynamic Attentive Graph Learning for Image Restorationcited by 48
- 2025Is Nano Banana Pro a Low-Level Vision All-Rounder? A Comprehensive Evaluation on 14 Tasks and 40 Datasetscited by 19
- 2023Image Blind Denoising Using Dual Convolutional Neural Network with Skip Connectioncited by 4
Built on by
Not cited yet.