mlsanityData to 14 Oct 2026

HiMat: DiT-based Ultra-High Resolution SVBRDF Generation

arXiv 2508.07011 ↗First posted 9 Aug 2025cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Creating ultra-high-resolution spatially varying bidirectional reflectance functions (SVBRDFs) is critical for photorealistic 3D content creation, to faithfully represent fine-scale surface details required for close-up rendering. However, achieving 4K generation faces two key challenges: (1) the need to synthesize multiple reflectance maps at full resolution, which multiplies the pixel budget and imposes prohibitive memory and computational cost, and (2) the requirement to maintain strong pixel-level alignment across maps at 4K, which is particularly difficult when adapting pretrained models designed for the RGB image domain. We introduce HiMat, a diffusion-based framework tailored for efficient and diverse 4K SVBRDF generation. To address the first challenge, HiMat performs generation in a high-compression latent space via DC-AE, and employs a pretrained diffusion transformer with linear attention to improve per-map efficiency. To address the second challenge, we propose CrossStitch, a lightweight convolutional module that enforces cross-map consistency without incurring the cost of global attention. Our experiments show that HiMat achieves high-fidelity 4K SVBRDF generation with superior efficiency, structural consistency, and diversity compared to prior methods. Beyond materials, our framework also generalizes to related applications such as intrinsic decomposition.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 60 of its 92 references that are in the map. First posted on arXiv 9 Aug 2025.

Builds on

60 of 92 references.

References · 60

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  10. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  11. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
38 more
  1. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  2. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  3. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  4. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  5. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  6. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  7. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  8. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  9. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  10. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 397
  11. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  12. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 329
  13. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  14. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  15. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  16. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 161
  17. 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
  18. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  19. 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 107
  20. 2015Fast Algorithms for Convolutional Neural Networkscited by 102
  21. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
  22. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
  23. 2024ZigMa: A DiT-style Zigzag Mamba Diffusion Modelcited by 84
  24. 2023HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusioncited by 68
  25. 2024UltraPixel: Advancing Ultra-High-Resolution Image Synthesis to New Peakscited by 65
  26. 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 65
  27. 2019Flexible SVBRDF Capture with a Multi-Image Deep Networkcited by 50
  28. 2023ControlMat: A Controlled Generative Approach to Material Capturecited by 50
  29. 2025DC-AE 1.5: Accelerating Diffusion Model Convergence with Structured Latent Spacecited by 47
  30. 2024MatSynth: A Modern PBR Materials Datasetcited by 42
  31. 2023MatFuse: Controllable Material Generation with Diffusion Modelscited by 39
  32. 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidancecited by 34
  33. 2020MaterialGAN: Reflectance Capture using a Generative SVBRDF Modelcited by 33
  34. 2024MatFusion: A Generative Diffusion Model for SVBRDF Capturecited by 31
  35. 2023HiDiffusion: Unlocking Higher-Resolution Creativity and Efficiency in Pretrained Diffusion Modelscited by 29
  36. 2023Material Palette: Extraction of Materials from a Single Imagecited by 28
  37. 2022TileGen: Tileable, Controllable Material Generation and Capturecited by 27
  38. 2023Generating Procedural Materials from Text or Image Promptscited by 21

50 most cited of 60 All 60 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Diffusion Reflectance Map: Single-Image Stochastic Inverse Rendering of Illumination and Reflectance
  2. 2025SViM3D: Stable Video Material Diffusion for Single Image 3D Generation
  3. 2025Fast and accurate neural reflectance transformation imaging through knowledge distillation
  4. 2026DIAMOND-SSS: Diffusion-Augmented Multi-View Optimization for Data-efficient SubSurface Scattering
  5. 2026UltraTex: Unleashing 2K Multi-View Diffusion for 3D Texturing
  6. 2026Q-DiT4SR: Exploration of Detail-Preserving Diffusion Transformer Quantization for Real-World Image Super-Resolution
  7. 2025AlphaVAE: Unified End-to-End RGBA Image Reconstruction and Generation with Alpha-Aware Representation Learning
  8. 2025HiWave: Training-Free High-Resolution Image Generation via Wavelet-Based Diffusion Sampling