Integrating View Conditions for Image Synthesis
Not on the map. Why?
Abstract (arXiv)
In the field of image processing, applying intricate semantic modifications within existing images remains an enduring challenge. This paper introduces a pioneering framework that integrates viewpoint information to enhance the control of image editing tasks, especially for interior design scenes. By surveying existing object editing methodologies, we distill three essential criteria -- consistency, controllability, and harmony -- that should be met for an image editing method. In contrast to previous approaches, our framework takes the lead in satisfying all three requirements for addressing the challenge of image synthesis. Through comprehensive experiments, encompassing both quantitative assessments and qualitative comparisons with contemporary state-of-the-art methods, we present compelling evidence of our framework's superior performance across multiple dimensions. This work establishes a promising avenue for advancing image synthesis techniques and empowering precise object modifications while preserving the visual coherence of the entire composition.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
41 of 48 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
29 more
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2016HyperNetworkscited by 1,003
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Instruction Tuning with GPT-4cited by 676
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2015A Neural Algorithm of Artistic Stylecited by 480
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2023Translating Natural Language to Planning Goals with Large-Language Modelscited by 132
- 2017Deep Image Harmonizationcited by 120
- 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
- 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
- 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
- 2023Five A+ Network: You Only Need 9K Parameters for Underwater Image Enhancementcited by 22
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 20
- 2022Identifying Hard Noise in Long-Tailed Sample Distributioncited by 19
- 2023Reference-based Image Composition with Sketch via Structure-aware Diffusion Modelcited by 16
- 2023Invariant Training 2D-3D Joint Hard Samples for Few-Shot Point Cloud Recognitioncited by 13
- 2022LaT: Latent Translation with Cycle-Consistency for Video-Text Retrievalcited by 9
- 2023DreamPaint: Few-Shot Inpainting of E-Commerce Items for Virtual Try-On without 3D Modelingcited by 7
- 2023Taming Diffusion Models for Music-driven Conducting Motion Generationcited by 7
- 2023RSFDM-Net: Real-time Spatial and Frequency Domains Modulation Network for Underwater Image Enhancementcited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 9; 2025: 5; 2026: 1.
16 papers.
Sort:
By area:
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
- 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2024Diffusion Time-step Curriculum for One Image to 3D Generationcited by 20
- 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generationcited by 18
- 2024AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancementcited by 16
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferencescited by 16
- 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Modelscited by 14
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfercited by 14
- 2025Track Any Anomalous Object: A Granular Video Anomaly Detection Pipelinecited by 8
4 more
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2024Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priorscited by 4
- 2025RecTok: Reconstruction Distillation along Rectified Flowcited by 4
- 2025Personalized Safety Alignment for Text-to-Image Diffusion Modelscited by 1
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2025RecTok: Reconstruction Distillation along Rectified Flow15 Dec 2025
- 2025Personalized Safety Alignment for Text-to-Image Diffusion Models2 Aug 2025
- 2025Track Any Anomalous Object: A Granular Video Anomaly Detection Pipeline5 Jun 2025
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer21 Mar 2025
- 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generation24 Jan 2025
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing5 Dec 2024
- 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Models17 Oct 2024
- 2024Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priors27 Sep 2024
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences26 Aug 2024
- 2024AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancement20 Jul 2024
- 2024Diffusion Time-step Curriculum for One Image to 3D Generation6 Apr 2024
4 more
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
- 2024AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancementcited by 16
- 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Modelscited by 14
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfercited by 14
- 2024Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priorscited by 4
- 2025RecTok: Reconstruction Distillation along Rectified Flowcited by 4
- 2025Personalized Safety Alignment for Text-to-Image Diffusion Modelscited by 1
- 2025RecTok: Reconstruction Distillation along Rectified Flow15 Dec 2025
- 2025Personalized Safety Alignment for Text-to-Image Diffusion Models2 Aug 2025
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer21 Mar 2025
- 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Models17 Oct 2024
- 2024Unsupervised Low-light Image Enhancement with Lookup Tables and Diffusion Priors27 Sep 2024
- 2024AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancement20 Jul 2024
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey7 Mar 2024
- 2023VideoBooth: Diffusion-based Video Generation with Image Prompts1 Dec 2023
- 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2024Diffusion Time-step Curriculum for One Image to 3D Generationcited by 20
- 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generationcited by 18
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferencescited by 16
- 2025Track Any Anomalous Object: A Granular Video Anomaly Detection Pipelinecited by 8
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2025Track Any Anomalous Object: A Granular Video Anomaly Detection Pipeline5 Jun 2025
- 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generation24 Jan 2025
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing5 Dec 2024
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences26 Aug 2024
- 2024Diffusion Time-step Curriculum for One Image to 3D Generation6 Apr 2024
- 2024View-Consistent 3D Editing with Gaussian Splatting18 Mar 2024
- 2024Magic-Me: Identity-Specific Video Customized Diffusion14 Feb 2024