Decoupling High and Low Frequencies for Faithful Image Generation with Fine Details
Not on the map. Why?
Abstract (arXiv)
Latent generative models compress images into learned embeddings prior to synthesis, and the generation quality critically depends on how faithfully these embeddings preserve visual detail. We observe that while such embeddings are effective at reconstructing low frequency structure, they struggle to recover sharp high frequency details that are essential for perceptual realism. Conventional reconstruction objectives implicitly prioritize coarse structural information over high frequency content, which can lead to overly smoothed outputs and degraded visual quality in textured regions. Motivated by this observation, we propose DeBaT, a Decoupled frequency Band Tokenizer that explicitly separates the learning of low and high frequency band embeddings. This decoupling enables accurate reconstruction of fine details while preserving global coherence. Integrated into a latent diffusion based generative model, DeBaT allows for sharper and more realistic samples than previous latent tokenizers, confirming that the explicit decoupling of high and low frequency bands eases the preservation of visual details in learned embedding spaces.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 57 of its 64 references that are in the map. First posted on arXiv 5 Sep 2025.
Builds on
57 of 64 references.
References · 57
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2017Neural Discrete Representation Learningcited by 4,712
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
38 more
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
- 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 262
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2023Fast Training of Diffusion Models with Masked Transformerscited by 176
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2023Low-Light Image Enhancement with Wavelet-based Diffusion Modelscited by 127
- 2022Diffusion Probabilistic Model Made Slimcited by 121
- 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 117
- 2025FlexTok: Resampling Images into 1D Token Sequences of Flexible Lengthcited by 110
- 2025Masked Autoencoders Are Effective Tokenizers for Diffusion Modelscited by 96
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 89
- 2023Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restorationcited by 88
- 2025Improving the Diffusability of Autoencoderscited by 80
- 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 65
- 2024FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modificationcited by 64
- 2022Wavelet Score-Based Generative Modelingcited by 62
- 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesiscited by 59
- 2024WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Modelcited by 57
- 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 55
- 2025One-D-Piece: Image Tokenizer Meets Quality-Controllable Compressioncited by 48
- 2021WaveFill: A Wavelet-based Generation Network for Image Inpaintingcited by 44
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidancecited by 34
- 2023HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayescited by 27
- 2024Make-A-Shape: a Ten-Million-scale 3D Shape Modelcited by 25
- 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusioncited by 25
- 2024LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Modelscited by 22
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Toward Diffusible High-Dimensional Latent Spaces: A Frequency Perspectivecited by 10
- 2026Spectrum Matching: a Unified Perspective for Superior Diffusability in Latent Diffusioncited by 7
- 2026Why Do DiT Editors Drift? Plug-and-Play Low Frequency Alignment in VAE Latent Spacecited by 3
- 2025FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolutioncited by 2
- 2025RePack then Refine: Efficient Diffusion Transformer with Vision Foundation Modelcited by 1
- 2026PixelControl: Fine-Grained Condition Fidelity in Text-to-Image Diffusioncited by 1
- 2026PuYun-LDM: A Latent Diffusion Model for High-Resolution Ensemble Weather Forecastscited by 0
- 2026PixelControl: Fine-Grained Condition Fidelity in Text-to-Image Diffusion16 Aug 2026
- 2026Why Do DiT Editors Drift? Plug-and-Play Low Frequency Alignment in VAE Latent Space7 May 2026
- 2026Spectrum Matching: a Unified Perspective for Superior Diffusability in Latent Diffusion15 Mar 2026
- 2026PuYun-LDM: A Latent Diffusion Model for High-Resolution Ensemble Weather Forecasts12 Feb 2026
- 2025RePack then Refine: Efficient Diffusion Transformer with Vision Foundation Model12 Dec 2025
- 2025FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolution1 Dec 2025
- 2025Toward Diffusible High-Dimensional Latent Spaces: A Frequency Perspective27 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation
- 2023Reconstruct-and-Generate Diffusion Model for Detail-Preserving Image Denoising
- 2026Accelerating Diffusion Decoders via Multi-Scale Sampling and One-Step Distillation
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion
- 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Error
- 2025HiWave: Training-Free High-Resolution Image Generation via Wavelet-Based Diffusion Sampling
- 2026Colorful-Noise: Training-Free Low-Frequency Noise Manipulation for Color-Based Conditional Image Generation
- 2025Decoupling Complexity from Scale in Latent Diffusion Model