mlsanityData to 7 Oct 2026

Integrating View Conditions for Image Synthesis

arXiv 2310.16002 ↗First posted 24 Oct 2023cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

In the field of image processing, applying intricate semantic modifications within existing images remains an enduring challenge. This paper introduces a pioneering framework that integrates viewpoint information to enhance the control of image editing tasks, especially for interior design scenes. By surveying existing object editing methodologies, we distill three essential criteria -- consistency, controllability, and harmony -- that should be met for an image editing method. In contrast to previous approaches, our framework takes the lead in satisfying all three requirements for addressing the challenge of image synthesis. Through comprehensive experiments, encompassing both quantitative assessments and qualitative comparisons with contemporary state-of-the-art methods, we present compelling evidence of our framework's superior performance across multiple dimensions. This work establishes a promising avenue for advancing image synthesis techniques and empowering precise object modifications while preserving the visual coherence of the entire composition.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 24 Oct 2023.

Builds on

41 of 48 references.

References · 41

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023Segment Anythingcited by 8,158
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  12. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
29 more
  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  4. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  5. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  6. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  7. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  8. 2016HyperNetworkscited by 1,003
  9. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  10. 2023Instruction Tuning with GPT-4cited by 676
  11. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  12. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  13. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  14. 2015A Neural Algorithm of Artistic Stylecited by 480
  15. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  16. 2023Translating Natural Language to Planning Goals with Large-Language Modelscited by 132
  17. 2017Deep Image Harmonizationcited by 120
  18. 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
  19. 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
  20. 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
  21. 2023Five A+ Network: You Only Need 9K Parameters for Underwater Image Enhancementcited by 22
  22. 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 20
  23. 2022Identifying Hard Noise in Long-Tailed Sample Distributioncited by 19
  24. 2023Reference-based Image Composition with Sketch via Structure-aware Diffusion Modelcited by 16
  25. 2023Invariant Training 2D-3D Joint Hard Samples for Few-Shot Point Cloud Recognitioncited by 13
  26. 2022LaT: Latent Translation with Cycle-Consistency for Video-Text Retrievalcited by 9
  27. 2023DreamPaint: Few-Shot Inpainting of E-Commerce Items for Virtual Try-On without 3D Modelingcited by 7
  28. 2023Taming Diffusion Models for Music-driven Conducting Motion Generationcited by 7
  29. 2023RSFDM-Net: Real-time Spatial and Frequency Domains Modulation Network for Underwater Image Enhancementcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 9; 2025: 5; 2026: 1.

16 papers.

Sort:

By area: