mlsanityData to 7 Oct 2026

TAPESTRY: From Geometry to Appearance via Consistent Turntable Videos

arXiv 2603.17735 ↗First posted 18 Mar 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Automatically generating photorealistic and self-consistent appearances for untextured 3D models is a critical challenge in digital content creation. The advancement of large-scale video generation models offers a natural approach: directly synthesizing 360-degree turntable videos (TTVs), which can serve not only as high-quality dynamic previews but also as an intermediate representation to drive texture synthesis and neural rendering. However, existing general-purpose video diffusion models struggle to maintain strict geometric consistency and appearance stability across the full range of views, making their outputs ill-suited for high-quality 3D reconstruction. To this end, we introduce TAPESTRY, a framework for generating high-fidelity TTVs conditioned on explicit 3D geometry. We reframe the 3D appearance generation task as a geometry-conditioned video diffusion problem: given a 3D mesh, we first render and encode multi-modal geometric features to constrain the video generation process with pixel-level precision, thereby enabling the creation of high-quality and consistent TTVs. Building upon this, we also design a method for downstream reconstruction tasks from the TTV input, featuring a multi-stage pipeline with 3D-Aware Inpainting. By rotating the model and performing a context-aware secondary generation, this pipeline effectively completes self-occluded regions to achieve full surface coverage. The videos generated by TAPESTRY are not only high-quality dynamic previews but also serve as a reliable, 3D-aware intermediate representation that can be seamlessly back-projected into UV textures or used to supervise neural rendering methods like 3DGS. This enables the automated creation of production-ready, complete 3D assets from untextured meshes. Experimental results demonstrate that our method outperforms existing approaches in both video consistency and final reconstruction quality.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 39 of its 52 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

39 of 52 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024World-consistent Video Diffusion with Explicit 3D Modeling2 Dec
  2. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
  3. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models21 Dec
  4. 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Prior11 Dec
  5. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  6. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  7. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  8. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  9. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  11. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  12. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  9. 2022Video Diffusion Modelscited by 2,280
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  11. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
15 more
  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  2. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  4. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  5. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  6. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  7. 2025VACE: All-in-One Video Creation and Editingcited by 467
  8. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
  9. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  10. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 147
  11. 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
  12. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  13. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 95
  14. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  15. 2023HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Imagecited by 17

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025WorldWarp: Propagating 3D Geometry with Asynchronous Video Diffusion
  2. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior
  3. 2024Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models
  4. 2025NOVA3D: Normal Aligned Video Diffusion Model for Single Image to 3D Generation
  5. 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking
  6. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior
  7. 2025VideoFrom3D: 3D Scene Video Generation via Complementary Image and Video Diffusion Models
  8. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets