# DEHRFormer: Real-time Transformer for Depth Estimation and Haze Removal from Varicolored Haze Scenes

arXiv: https://arxiv.org/abs/2303.06905 · HTML: https://mlsanity.com/paper/2303.06905/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 32 references that are in the map.
- First posted on arXiv 13 Mar 2023.

## Builds on (most cited first, 24 of 24)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [End-to-End Object Detection with Transformers](https://mlsanity.com/paper/2005.12872/) (2020)
- [SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers](https://mlsanity.com/paper/2105.15203/) (2021)
- [MegaDepth: Learning Single-View Depth Prediction from Internet Photos](https://mlsanity.com/paper/1804.00607/) (2018)
- [Simple Baselines for Image Restoration](https://mlsanity.com/paper/2204.04676/) (2022)
- [Benchmarking Single Image Dehazing and Beyond](https://mlsanity.com/paper/1712.04143/) (2017)
- [NIMA: Neural Image Assessment](https://mlsanity.com/paper/1709.05424/) (2017)
- [Vision Transformers for Single Image Dehazing](https://mlsanity.com/paper/2204.03883/) (2022)
- [TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions](https://mlsanity.com/paper/2111.14813/) (2021)
- [Translating Natural Language to Planning Goals with Large-Language Models](https://mlsanity.com/paper/2302.05128/) (2023)
- [Transformer-Based Attention Networks for Continuous Pixel-Wise Prediction](https://mlsanity.com/paper/2103.12091/) (2021)
- [Domain Adaptation for Image Dehazing](https://mlsanity.com/paper/2005.04668/) (2020)
- [Unsupervised Night Image Enhancement: When Layer Decomposition Meets Light-Effects Suppression](https://mlsanity.com/paper/2207.10564/) (2022)
- [NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results](https://mlsanity.com/paper/2205.05675/) (2022)
- [MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing](https://mlsanity.com/paper/2207.05621/) (2022)
- [Perceiving and Modeling Density is All You Need for Image Dehazing](https://mlsanity.com/paper/2111.09733/) (2021)
- [Structure Representation Network and Uncertainty Feedback Learning for Dense Non-Uniform Fog Removal](https://mlsanity.com/paper/2210.03061/) (2022)
- [Underwater Light Field Retention : Neural Rendering for Underwater Imaging](https://mlsanity.com/paper/2203.11006/) (2022)
- [Self-Calibrated Efficient Transformer for Lightweight Super-Resolution](https://mlsanity.com/paper/2204.08913/) (2022)
- [AIM 2022 Challenge on Super-Resolution of Compressed Image and Video: Dataset, Methods and Results](https://mlsanity.com/paper/2208.11184/) (2022)
- [Estimating Reflectance Layer from A Single Image: Integrating Reflectance Guidance and Shadow/Specular Aware Learning](https://mlsanity.com/paper/2211.14751/) (2022)
- [Prior-Guided One-shot Neural Architecture Search](https://mlsanity.com/paper/2206.13329/) (2022)
- [Towards Real-time High-Definition Image Snow Removal: Efficient Pyramid Network with Asymmetrical Encoder-decoder Architecture](https://mlsanity.com/paper/2207.05605/) (2022)
- [Mutual Learning for Domain Adaptation: Self-distillation Image Dehazing Network with Sample-cycle](https://mlsanity.com/paper/2203.09430/) (2022)

## Built on by (most cited first, 9 of 9)

- [Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks](https://mlsanity.com/paper/2308.14153/) (2023)
- [Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNN](https://mlsanity.com/paper/2308.08333/) (2023)
- [Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Network](https://mlsanity.com/paper/2406.07966/) (2024)
- [Five A+ Network: You Only Need 9K Parameters for Underwater Image Enhancement](https://mlsanity.com/paper/2305.08824/) (2023)
- [NightHazeFormer: Single Nighttime Haze Removal Using Prior Query Transformer](https://mlsanity.com/paper/2305.09533/) (2023)
- [VersaT2I: Improving Text-to-Image Models with Versatile Reward](https://mlsanity.com/paper/2403.18493/) (2024)
- [AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancement](https://mlsanity.com/paper/2407.14900/) (2024)
- [Depth-Centric Dehazing and Depth-Estimation from Real-World Hazy Driving Video](https://mlsanity.com/paper/2412.11395/) (2024)
- [Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priors](https://mlsanity.com/paper/2409.18899/) (2024)

## Abstract (arXiv)

Varicolored haze caused by chromatic casts poses haze removal and depth estimation challenges. Recent learning-based depth estimation methods are mainly targeted at dehazing first and estimating depth subsequently from haze-free scenes. This way, the inner connections between colored haze and scene depth are lost. In this paper, we propose a real-time transformer for simultaneous single image Depth Estimation and Haze Removal (DEHRFormer). DEHRFormer consists of a single encoder and two task-specific decoders. The transformer decoders with learnable queries are designed to decode coupling features from the task-agnostic encoder and project them into clean image and depth map, respectively. In addition, we introduce a novel learning paradigm that utilizes contrastive learning and domain consistency learning to tackle weak-generalization problem for real-world dehazing, while predicting the same depth map from the same scene with varicolored haze. Experiments demonstrate that DEHRFormer achieves significant performance improvement across diverse varicolored haze scenes over previous depth estimation networks and dehazing approaches.