Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models
Not on the map. Why?
Abstract (arXiv)
Recent 3D generative models can synthesize high-quality geometry but often struggle to reproduce intricate textures from reference images, largely due to the scarcity of large-scale 3D training data with rich surface appearance. In contrast, visual generative models are trained on datasets several orders of magnitude larger and excel at modeling complex visual patterns. Motivated by this gap, we introduce Ink3D, a framework that bridges 3D generation with large-scale video generative models to synthesize extremely complex textures. Ink3D first reconstructs a white-mesh geometry using an off-the-shelf 3D generation model. It then employs OrbitPainter, a conditional video generative model, to produce dense orbit-scan videos capturing object appearance across viewpoints. To convert these views into coherent textures, we introduce TextureOptimizer, a neural baking module that integrates dense multi-view observations while mitigating geometry inconsistencies arising from video generation. By decoupling geometry and texture synthesis and leveraging large-scale pretrained video priors, Ink3D enables significantly richer and more faithful texture generation than prior approaches.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 57 of its 66 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
57 of 66 references.
References · 57
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2025Qwen-Image Technical Reportcited by 1,044
38 more
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 98
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
- 2025LongCat-Video Technical Reportcited by 85
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 83
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 64
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 61
- 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
- 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 46
- 2025TexVerse: A Universe of 3D Objects with High-Resolution Texturescited by 45
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.