MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processing
Not on the map. Why?
Abstract (arXiv)
Current methods for 3D generation still fall short in physically based rendering (PBR) texturing, primarily due to limited data and challenges in modeling multi-channel materials. In this work, we propose MuMA, a method for 3D PBR texturing through Multi-channel Multi-view generation and Agentic post-processing. Our approach features two key innovations: 1) We opt to model shaded and albedo appearance channels, where the shaded channels enables the integration intrinsic decomposition modules for material properties. 2) Leveraging multimodal large language models, we emulate artists' techniques for material assessment and selection. Experiments demonstrate that MuMA achieves superior results in visual quality and material fidelity compared to existing methods.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 56 of its 59 references that are in the map. First posted on arXiv 24 Mar 2025.
Builds on
56 of 59 references.
References · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Visual Instruction Tuningcited by 7,792
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2018Demystifying MMD GANscited by 1,268
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
- 2023HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusioncited by 68
- 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
- 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
- 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
- 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
- 2023UniDream: Unifying Diffusion Priors for Relightable Text-to-3D Generationcited by 47
- 2024MVPaint: Synchronized Multi-View Diffusion for Painting Anything 3Dcited by 34
- 2024Material Anything: Generating Materials for Any 3D Object via Diffusioncited by 31
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistencycited by 29
- 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
- 2024MaPa: Text-driven Photorealistic Material Painting for 3D Shapescited by 27
- 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resamplingcited by 24
- 2024IDArb: Intrinsic Decomposition for Arbitrary Number of Input Views and Illuminationscited by 21
- 2024Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materialscited by 17
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 2.
8 papers.
- 2025MAR-3D: Progressive Masked Auto-regressor for High-Resolution 3D Generationcited by 11
- 2025GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generationcited by 3
- 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generationcited by 3
- 2025Large Material Gaussian Model for Relightable 3D Generationcited by 2
- 2025LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination Contextcited by 2
- 2025MatLat: Material Latent Space for PBR Texture Generationcited by 1
- 2026AssetFormer: Modular 3D Assets Generation with Autoregressive Transformercited by 1
- 2026MV2UV: Generating High-quality UV Texture Maps with Multiview Promptscited by 0
- 2026MV2UV: Generating High-quality UV Texture Maps with Multiview Prompts16 Mar 2026
- 2026AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer12 Feb 2026
- 2025MatLat: Material Latent Space for PBR Texture Generation19 Dec 2025
- 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generation26 Nov 2025
- 2025LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination Context24 Nov 2025
- 2025Large Material Gaussian Model for Relightable 3D Generation26 Sep 2025
- 2025GarmentX: Autoregressive Parametric Representations for High-Fidelity 3D Garment Generation29 Apr 2025
- 2025MAR-3D: Progressive Masked Auto-regressor for High-Resolution 3D Generation26 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025PBR3DGen: A VLM-guided Mesh Generation with High-quality PBR Texture
- 2025MatPedia: A Universal Generative Foundation for High-Fidelity Material Synthesis
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Models
- 2026Toward Richer Material Generation via Procedural Data Enhancement
- 2025Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images
- 2024MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignment
- 2024DreamPBR: Text-driven Generation of High-resolution SVBRDF with Multi-modal Guidance
- 2026Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design