mlsanityData to 14 Oct 2026

Decoupling High and Low Frequencies for Faithful Image Generation with Fine Details

arXiv 2509.05441 ↗First posted 5 Sep 2025cs.CV cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Latent generative models compress images into learned embeddings prior to synthesis, and the generation quality critically depends on how faithfully these embeddings preserve visual detail. We observe that while such embeddings are effective at reconstructing low frequency structure, they struggle to recover sharp high frequency details that are essential for perceptual realism. Conventional reconstruction objectives implicitly prioritize coarse structural information over high frequency content, which can lead to overly smoothed outputs and degraded visual quality in textured regions. Motivated by this observation, we propose DeBaT, a Decoupled frequency Band Tokenizer that explicitly separates the learning of low and high frequency band embeddings. This decoupling enables accurate reconstruction of fine details while preserving global coherence. Integrated into a latent diffusion based generative model, DeBaT allows for sharper and more realistic samples than previous latent tokenizers, confirming that the explicit decoupling of high and low frequency bands eases the preservation of visual details in learned embedding spaces.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 57 of its 64 references that are in the map. First posted on arXiv 5 Sep 2025.

Builds on

57 of 64 references.

References · 57

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023Segment Anythingcited by 8,234
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  8. 2017Neural Discrete Representation Learningcited by 4,712
  9. 2013Auto-Encoding Variational Bayescited by 4,053
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  12. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
38 more
  1. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  2. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  3. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  4. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  5. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  6. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  7. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  8. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  9. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
  10. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  11. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  12. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
  13. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 262
  14. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  15. 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
  16. 2023Fast Training of Diffusion Models with Masked Transformerscited by 176
  17. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  18. 2023Low-Light Image Enhancement with Wavelet-based Diffusion Modelscited by 127
  19. 2022Diffusion Probabilistic Model Made Slimcited by 121
  20. 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 117
  21. 2025FlexTok: Resampling Images into 1D Token Sequences of Flexible Lengthcited by 110
  22. 2025Masked Autoencoders Are Effective Tokenizers for Diffusion Modelscited by 96
  23. 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 89
  24. 2023Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restorationcited by 88
  25. 2025Improving the Diffusability of Autoencoderscited by 80
  26. 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 65
  27. 2024FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modificationcited by 64
  28. 2022Wavelet Score-Based Generative Modelingcited by 62
  29. 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesiscited by 59
  30. 2024WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Modelcited by 57
  31. 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 55
  32. 2025One-D-Piece: Image Tokenizer Meets Quality-Controllable Compressioncited by 48
  33. 2021WaveFill: A Wavelet-based Generation Network for Image Inpaintingcited by 44
  34. 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidancecited by 34
  35. 2023HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayescited by 27
  36. 2024Make-A-Shape: a Ten-Million-scale 3D Shape Modelcited by 25
  37. 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusioncited by 25
  38. 2024LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Modelscited by 22

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation
  2. 2023Reconstruct-and-Generate Diffusion Model for Detail-Preserving Image Denoising
  3. 2026Accelerating Diffusion Decoders via Multi-Scale Sampling and One-Step Distillation
  4. 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion
  5. 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Error
  6. 2025HiWave: Training-Free High-Resolution Image Generation via Wavelet-Based Diffusion Sampling
  7. 2026Colorful-Noise: Training-Free Low-Frequency Noise Manipulation for Color-Based Conditional Image Generation
  8. 2025Decoupling Complexity from Scale in Latent Diffusion Model