Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We introduce Tinker, a versatile framework for high-fidelity 3D editing that operates in both one-shot and few-shot regimes without any per-scene finetuning. Unlike prior techniques that demand extensive per-scene optimization to ensure multi-view consistency or to produce dozens of consistent edited input views, Tinker delivers robust, multi-view consistent edits from as few as one or two images. This capability stems from repurposing pretrained diffusion models, which unlocks their latent 3D awareness. To drive research in this space, we curate the first large-scale multi-view editing dataset and data pipeline, spanning diverse scenes and styles. Building on this dataset, we develop our framework capable of generating multi-view consistent edited views without per-scene training, which consists of two novel components: (1) Referring multi-view editor: Enables precise, reference-driven edits that remain coherent across all viewpoints. (2) Any-view-to-video synthesizer: Leverages spatial-temporal priors from video diffusion to perform high-quality scene completion and novel-view generation even from sparse inputs. Through extensive experiments, Tinker significantly reduces the barrier to generalizable 3D content creation, achieving state-of-the-art performance on editing, novel-view synthesis, and rendering enhancement tasks. We believe that Tinker represents a key step towards truly scalable, zero-shot 3D editing. Project webpage: https://aim-uofa.github.io/Tinker
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 67 of its 73 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
67 of 73 references.
Closest ancestors · 8
Same direction, newest first
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting16 Dec
- 2024DreamCatalyst: Fast and High-Quality 3D Editing via Controlling Editability and Identity Preservation16 Jul
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation4 Dec
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
- 2023Vox-E: Text-guided Voxel Editing of 3D Objects21 Mar
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 59
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Modelscited by 105
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2023Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusioncited by 78
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
- 2023MagicEdit: High-Fidelity and Temporally Coherent Video Editingcited by 76
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 7.
9 papers.
- 2026Alleviating Sparse Rewards by Modeling Step-Wise and Long-Term Sampling Effects in Flow-Based GRPOcited by 9
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2026Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editingcited by 4
- 2026MARBLE: Multi-Aspect Reward Balance for Diffusion RLcited by 4
- 2025Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformercited by 2
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
- 2025InstructMix2Mix: Consistent Sparse-View Editing Through Multi-View Model Personalizationcited by 1
- 2026Information-Regularized Constrained Inversion for Stable Avatar Editing from Sparse Supervisioncited by 0
- 2026FluSplat: Sparse-View 3D Editing without Test-Time Optimizationcited by 0
- 2026MARBLE: Multi-Aspect Reward Balance for Diffusion RL7 May 2026
- 2026FluSplat: Sparse-View 3D Editing without Test-Time Optimization21 Apr 2026
- 2026Information-Regularized Constrained Inversion for Stable Avatar Editing from Sparse Supervision3 Apr 2026
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking1 Apr 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
- 2026Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editing3 Mar 2026
- 2026Alleviating Sparse Rewards by Modeling Step-Wise and Long-Term Sampling Effects in Flow-Based GRPO6 Feb 2026
- 2025Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformer30 Nov 2025
- 2025InstructMix2Mix: Consistent Sparse-View Editing Through Multi-View Model Personalization18 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025DisCo3D: Distilling Multi-View Consistency for 3D Scene Editing
- 2025Coupled Diffusion Sampling for Training-Free Multi-View Image Editing
- 2024ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editing
- 20243DEgo: 3D Editing on the Go!
- 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-View
- 2025Edit360: 2D Image Edits to 3D Assets from Any Angle
- 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers