mlsanityData to 14 Oct 2026

Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization

arXiv 2508.14811 ↗First posted 20 Aug 2025cs.CVcited by 9

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We introduce Tinker, a versatile framework for high-fidelity 3D editing that operates in both one-shot and few-shot regimes without any per-scene finetuning. Unlike prior techniques that demand extensive per-scene optimization to ensure multi-view consistency or to produce dozens of consistent edited input views, Tinker delivers robust, multi-view consistent edits from as few as one or two images. This capability stems from repurposing pretrained diffusion models, which unlocks their latent 3D awareness. To drive research in this space, we curate the first large-scale multi-view editing dataset and data pipeline, spanning diverse scenes and styles. Building on this dataset, we develop our framework capable of generating multi-view consistent edited views without per-scene training, which consists of two novel components: (1) Referring multi-view editor: Enables precise, reference-driven edits that remain coherent across all viewpoints. (2) Any-view-to-video synthesizer: Leverages spatial-temporal priors from video diffusion to perform high-quality scene completion and novel-view generation even from sparse inputs. Through extensive experiments, Tinker significantly reduces the barrier to generalizable 3D content creation, achieving state-of-the-art performance on editing, novel-view synthesis, and rendering enhancement tasks. We believe that Tinker represents a key step towards truly scalable, zero-shot 3D editing. Project webpage: https://aim-uofa.github.io/Tinker

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 67 of its 73 references that are in the map. First posted on arXiv 20 Aug 2025.

Builds on

67 of 73 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting16 Dec
  2. 2024DreamCatalyst: Fast and High-Quality 3D Editing via Controlling Editability and Identity Preservation16 Jul
  3. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
  4. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation4 Dec
  5. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  6. 2023Vox-E: Text-guided Voxel Editing of 3D Objects21 Mar
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  8. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 59

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  10. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  11. 2022Scalable Diffusion Models with Transformerscited by 6,054
  12. 2022Flow Matching for Generative Modelingcited by 5,702
38 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  9. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  10. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  12. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  13. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  14. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  15. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  16. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  17. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
  18. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  19. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  20. 2025VACE: All-in-One Video Creation and Editingcited by 479
  21. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  22. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  23. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  24. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  25. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  26. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  27. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  28. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  29. 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
  30. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  31. 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Modelscited by 105
  32. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  33. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  34. 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
  35. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
  36. 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 76
  37. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
  38. 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 7.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025DisCo3D: Distilling Multi-View Consistency for 3D Scene Editing
  2. 2025Coupled Diffusion Sampling for Training-Free Multi-View Image Editing
  3. 2024ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editing
  4. 20243DEgo: 3D Editing on the Go!
  5. 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-View
  6. 2025Edit360: 2D Image Edits to 3D Assets from Any Angle
  7. 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing
  8. 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers