mlsanityData to 7 Oct 2026

MatSynth: A Modern PBR Materials Dataset

arXiv 2401.06056 ↗First posted 11 Jan 2024cs.CV cs.GRcited by 42

Not on the map. Why?

Abstract (arXiv)

We introduce MatSynth, a dataset of 4,000+ CC0 ultra-high resolution PBR materials. Materials are crucial components of virtual relightable assets, defining the interaction of light at the surface of geometries. Given their importance, significant research effort was dedicated to their representation, creation and acquisition. However, in the past 6 years, most research in material acquisiton or generation relied either on the same unique dataset, or on company-owned huge library of procedural materials. With this dataset we propose a significantly larger, more diverse, and higher resolution set of materials than previously publicly available. We carefully discuss the data collection process and demonstrate the benefits of this dataset on material acquisition and generation applications. The complete data further contains metadata with each material's origin, license, category, tags, creation method and, when available, descriptions and physical size, as well as 3M+ renderings of the augmented materials, in 1K, under various environment lightings. The MatSynth dataset is released through the project page at: https://www.gvecchio.com/matsynth.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 27 of its 49 references that are in the map. First posted on arXiv 11 Jan 2024.

Builds on

27 of 49 references.

References · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  7. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  8. 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 202
  9. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
  10. 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
  11. 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
  12. 2020OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasetscited by 73
15 more
  1. 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
  2. 2021Deep Polarization Imaging for 3D shape and SVBRDF Acquisitioncited by 56
  3. 2018Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networkscited by 51
  4. 2019Flexible SVBRDF Capture with a Multi-Image Deep Networkcited by 50
  5. 2023ControlMat: A Controlled Generative Approach to Material Capturecited by 50
  6. 2023MatFuse: Controllable Material Generation with Diffusion Modelscited by 39
  7. 2021Generative Modelling of BRDF Textures from Flash Imagescited by 35
  8. 2020Guided Fine-Tuning for Large-Scale Material Transfercited by 27
  9. 2022TileGen: Tileable, Controllable Material Generation and Capturecited by 27
  10. 2023Materialistic: Selecting Similar Materials in Imagescited by 26
  11. 2021SurfaceNet: Adversarial SVBRDF Estimation from a Single Imagecited by 25
  12. 2023PSDR-Room: Single Photo to Scene using Differentiable Renderingcited by 23
  13. 2023Generating Procedural Materials from Text or Image Promptscited by 21
  14. 2023PhotoMat: A Material Generator Learned from Single Flash Photoscited by 18
  15. 2023The Visual Language of Fabricscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 21; 2026: 13.

42 papers.

Sort:

By area:

  1. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
  2. 2024Neural LightRig: Unlocking Accurate Object Normal and Material Estimation with Multi-Light Diffusioncited by 19
  3. 2025LuxDiT: Lighting Estimation with Video Diffusion Transformercited by 14
  4. 2024MaterialPicker: Multi-Modal DiT-Based Material Generationcited by 10
  5. 2025Light of Normals: Unified Feature Representation for Universal Photometric Stereocited by 8
  6. 2026Generative World Renderercited by 8
  7. 2025MatSwap: Light-aware material transfers in imagescited by 6
  8. 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materialscited by 5
  9. 2025Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Imagescited by 5
  10. 2025OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Controlcited by 5
  11. 2024StableMaterials: Enhancing Diversity in Material Generation via Semi-Supervised Learningcited by 4
  12. 2024Vastextures: Vast repository of textures and PBR materials extracted from real-world images using unsupervised methodscited by 3
30 more
  1. 2024Generate Any Scene: Scene Graph Driven Data Synthesis for Visual Generation Trainingcited by 3
  2. 2025Fine-Grained Spatially Varying Material Selection in Imagescited by 3
  3. 2025MatPedia: A Universal Generative Foundation for High-Fidelity Material Synthesiscited by 3
  4. 2026VideoMatGen: PBR Materials through Joint Generative Modelingcited by 3
  5. 2024Learning Zero-Shot Material States Segmentation, by Implanting Natural Image Patterns in Synthetic Datacited by 2
  6. 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Modelscited by 2
  7. 2025Twinner: Shining Light on Digital Twins in a Few Snapscited by 2
  8. 2025MatPredict: a dataset and benchmark for learning material properties of diverse indoor objectscited by 2
  9. 2025Material-informed Gaussian Splatting for 3D World Reconstruction in a Digital Twincited by 2
  10. 2026VideoNeuMat: Neural Material Extraction from Generative Video Modelscited by 2
  11. 2026Monocular Normal Estimation via Shading Sequence Estimationcited by 2
  12. 2024FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Imagescited by 1
  13. 2025RETRO: REthinking Tactile Representation Learning with Material PriOrscited by 1
  14. 2025Generative Perception of Shape and Material from Differential Motioncited by 1
  15. 2025RealMat: Realistic Materials with Diffusion and Reinforcement Learningcited by 1
  16. 2025SciTextures: Collecting and Connecting Visual Patterns, Models, and Code Across Science and Artcited by 1
  17. 2026TexEditor: Structure-Preserving Text-Driven Texture Editingcited by 1
  18. 2026Relit-LiVE: Relight Video by Jointly Learning Environment Videocited by 1
  19. 2024Structured Pattern Expansion with Diffusion Modelscited by 0
  20. 2025HiMat: DiT-based Ultra-High Resolution SVBRDF Generationcited by 0
  21. 2025MUJICA: Reforming SISR Models for PBR Material Super-Resolution via Cross-Map Attentioncited by 0
  22. 2025Phieat: Physically Grounded Material Feature Representationcited by 0
  23. 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptationcited by 0
  24. 2025MatE: Material Extraction from Single-Image via Geometric Priorcited by 0
  25. 2026Mining Attribute Subspaces for Efficient Fine-tuning of 3D Foundation Modelscited by 0
  26. 2026Advances in Neural 3D Mesh Texturing: A Surveycited by 0
  27. 2026FF-ProCams: Feed-Forward Gaussian Splatting for Projector-Camera Systemcited by 0
  28. 2026RenderFormer-V2: Neural Rendering with Heterogeneous Scene Primitivescited by 0
  29. 2026SyntheticDoc: A Large Synthetic Dataset for Document Unwarping and Illumination Correctioncited by 0
  30. 2026MatLoom: Layered Text-to-Material Generation in a Compact Program Spacecited by 0