Bridging Day and Night: Target-Class Hallucination Suppression in Unpaired Image Translation
Not on the map. Why?
Abstract (arXiv)
Day-to-night unpaired image translation is important to downstream tasks but remains challenging due to large appearance shifts and the lack of direct pixel-level supervision. Existing methods often introduce semantic hallucinations, where objects from target classes such as traffic signs and vehicles, as well as man-made light effects, are incorrectly synthesized. These hallucinations significantly degrade downstream performance. We propose a novel framework that detects and suppresses hallucinations of target-class features during unpaired translation. To detect hallucination, we design a dual-head discriminator that additionally performs semantic segmentation to identify hallucinated content in background regions. To suppress these hallucinations, we introduce class-specific prototypes, constructed by aggregating features of annotated target-domain objects, which act as semantic anchors for each class. Built upon a Schrodinger Bridge-based translation model, our framework performs iterative refinement, where detected hallucination features are explicitly pushed away from class prototypes in feature space, thus preserving object semantics across the translation trajectory.Experiments show that our method outperforms existing approaches both qualitatively and quantitatively. On the BDD100K dataset, it improves mAP by 15.5% for day-to-night domain adaptation, with a notable 31.7% gain for classes such as traffic lights that are prone to hallucinations.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 34 of its 47 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
34 of 47 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,082
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
22 more
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2018Strong-Weak Distribution Alignment for Adaptive Object Detectioncited by 270
- 2018Cross-Domain Weakly-Supervised Object Detection through Progressive Domain Adaptationcited by 218
- 2017Image to Image Translation for Domain Adaptationcited by 171
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2019Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detectioncited by 123
- 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
- 2019Domain Adaptation for Object Detection via Style Consistencycited by 45
- 2018InstaGAN: Instance-aware Image-to-Image Translationcited by 37
- 2019Towards Instance-level Image-to-Image Translationcited by 36
- 2022FlexIT: Towards Flexible Semantic Image Translationcited by 28
- 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformercited by 28
- 2018Sem-GAN: Semantically-Consistent Image-to-Image Translationcited by 26
- 2025Mamba as a Bridge: Where Vision Foundation Models Meet Vision Language Models for Domain-Generalized Semantic Segmentationcited by 24
- 2024NightHaze: Nighttime Image Dehazing via Self-Prior Learningcited by 23
- 2021Memory-guided Unsupervised Image-to-image Translationcited by 21
- 2019Segmentation Guided Image-to-Image Translation with Adversarial Networkscited by 4
- 2024BlenDA: Domain Adaptive Object Detection through diffusion-based blendingcited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026LaS-Comp: Zero-shot 3D Completion with Latent-Spatial Consistencycited by 9
- 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Modelscited by 5
- 2026GlowGS: Generative Semantic Feature Learning for 3D Gaussian Splatting in Nighttime Glow Scenescited by 2
- 2026Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPOcited by 1
- 2026FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identificationcited by 0
- 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Modelscited by 0
- 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models15 Aug 2026
- 2026Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPO13 Jul 2026
- 2026FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identification18 Jun 2026
- 2026GlowGS: Generative Semantic Feature Learning for 3D Gaussian Splatting in Nighttime Glow Scenes22 May 2026
- 2026WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Models18 Mar 2026
- 2026LaS-Comp: Zero-shot 3D Completion with Latent-Spatial Consistency21 Feb 2026