Does FLUX Already Know How to Perform Physically Plausible Image Composition?
Not on the map. Why?
Abstract (arXiv)
Image composition aims to seamlessly insert a user-specified object into a new scene, but existing models struggle with complex lighting (e.g., accurate shadows, water reflections) and diverse, high-resolution inputs. Modern text-to-image diffusion models (e.g., SD3.5, FLUX) already encode essential physical and resolution priors, yet lack a framework to unleash them without resorting to latent inversion, which often locks object poses into contextually inappropriate orientations, or brittle attention surgery. We propose SHINE, a training-free framework for Seamless, High-fidelity Insertion with Neutralized Errors. SHINE introduces manifold-steered anchor loss, leveraging pretrained customization adapters (e.g., IP-Adapter) to guide latents for faithful subject representation while preserving background integrity. Degradation-suppression guidance and adaptive background blending are proposed to further eliminate low-quality outputs and visible seams. To address the lack of rigorous benchmarks, we introduce ComplexCompo, featuring diverse resolutions and challenging conditions such as low lighting, strong illumination, intricate shadows, and reflective surfaces. Experiments on ComplexCompo and DreamEditBench show state-of-the-art performance on standard metrics (e.g., DINOv2) and human-aligned scores (e.g., DreamSim, ImageReward, VisionReward). Code is available at https://github.com/ZhumingLian/SHINE.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 125 of its 149 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
125 of 149 references.
References · 125
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
38 more
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2024OmniGen: Unified Image Generationcited by 394
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 307
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2022Diffusion models as plug-and-play priorscited by 231
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2023Controlling Text-to-Image Diffusion by Orthogonal Finetuningcited by 208
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
50 most cited of 125 All 125 (JSON)
Built on by
Citing papers per year: 2025: 9; 2026: 23.
32 papers.
Sort:
By area:
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
- 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Datasetcited by 18
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 17
- 2026LUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Expertscited by 15
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Modelscited by 11
- 2025BideDPO: Conditional Image Generation with Simultaneous Text and Condition Alignmentcited by 10
- 2025ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecastingcited by 8
- 2026From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmarkcited by 7
20 more
- 2026RefineAnything: Multimodal Region-Specific Refinement for Perfect Local Detailscited by 5
- 2025Diffusion-Based Image Editing for Breaking Robust Watermarkscited by 4
- 2026MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generationcited by 4
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarkscited by 3
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 3
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarkingcited by 2
- 2026Spiking Pyramid Wavelet Transformation for High-efficient and Low-energy Image Restorationcited by 2
- 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systemscited by 1
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offscited by 1
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 1
- 2026RevealLayer: Disentangling Hidden and Visible Layers via Occlusion-Aware Image Decompositioncited by 1
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrievalcited by 1
- 2025DeRainMamba: A Frequency-Aware State Space Model with Detail Enhancement for Image Derainingcited by 0
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editingcited by 0
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarkingcited by 0
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Modelscited by 0
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
- 2026Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositingcited by 0
- 2026On the Controllability-Fidelity Frontier in Diffusion Editingcited by 0
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generationcited by 0
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation11 Oct 2026
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning2 Jul 2026
- 2026Spiking Pyramid Wavelet Transformation for High-efficient and Low-energy Image Restoration17 Jun 2026
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval6 Jun 2026
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing5 Jun 2026
- 2026MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation3 Jun 2026
- 2026Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing31 May 2026
- 2026RevealLayer: Disentangling Hidden and Visible Layers via Occlusion-Aware Image Decomposition12 May 2026
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval23 Apr 2026
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval22 Apr 2026
- 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrieval20 Apr 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
20 more
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrieval20 Apr 2026
- 2026From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmark17 Apr 2026
- 2026RefineAnything: Multimodal Region-Specific Refinement for Perfect Local Details8 Apr 2026
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs31 Mar 2026
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysis20 Mar 2026
- 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems19 Mar 2026
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Models14 Mar 2026
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarking13 Mar 2026
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing5 Mar 2026
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking24 Feb 2026
- 2026LUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Experts12 Feb 2026
- 2025BideDPO: Conditional Image Generation with Simultaneous Text and Condition Alignment24 Nov 2025
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks5 Nov 2025
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecasting27 Oct 2025
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Dataset23 Oct 2025
- 2025DeRainMamba: A Frequency-Aware State Space Model with Detail Enhancement for Image Deraining8 Oct 2025
- 2025Diffusion-Based Image Editing for Breaking Robust Watermarks7 Oct 2025
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editing2 Oct 2025
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models30 Sep 2025
- 2025ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecasting27 Sep 2025
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
- 2026LUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Expertscited by 15
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Modelscited by 11
- 2025Diffusion-Based Image Editing for Breaking Robust Watermarkscited by 4
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarkscited by 3
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarkingcited by 2
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offscited by 1
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editingcited by 0
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarkingcited by 0
- 2026Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositingcited by 0
- 2026On the Controllability-Fidelity Frontier in Diffusion Editingcited by 0
- 2026On the Controllability-Fidelity Frontier in Diffusion Editing5 Jun 2026
- 2026Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing31 May 2026
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs31 Mar 2026
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarking13 Mar 2026
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing5 Mar 2026
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking24 Feb 2026
- 2026LUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Experts12 Feb 2026
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks5 Nov 2025
- 2025Diffusion-Based Image Editing for Breaking Robust Watermarks7 Oct 2025
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editing2 Oct 2025
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models30 Sep 2025
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
- 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Datasetcited by 18
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
- 2025ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecastingcited by 8
- 2026From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmarkcited by 7
- 2026RefineAnything: Multimodal Region-Specific Refinement for Perfect Local Detailscited by 5
- 2026Spiking Pyramid Wavelet Transformation for High-efficient and Low-energy Image Restorationcited by 2
- 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systemscited by 1
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 1
- 2026RevealLayer: Disentangling Hidden and Visible Layers via Occlusion-Aware Image Decompositioncited by 1
12 most cited of 16 All 16 (JSON)
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation11 Oct 2026
- 2026Spiking Pyramid Wavelet Transformation for High-efficient and Low-energy Image Restoration17 Jun 2026
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval6 Jun 2026
- 2026RevealLayer: Disentangling Hidden and Visible Layers via Occlusion-Aware Image Decomposition12 May 2026
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval23 Apr 2026
- 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrieval20 Apr 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrieval20 Apr 2026
- 2026From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmark17 Apr 2026
- 2026RefineAnything: Multimodal Region-Specific Refinement for Perfect Local Details8 Apr 2026
- 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems19 Mar 2026
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Models14 Mar 2026
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026A training-free framework for high-fidelity appearance transfer via diffusion transformers
- 2024Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering
- 2023Cross-domain Compositing with Pretrained Diffusion Models
- 2024Draw Like an Artist: Complex Scene Generation with Diffusion Model via Composition, Painting, and Retouching
- 2026Panoptic Scene Program Diffusion Transformer
- 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Models
- 2026PICS: Pairwise Image Compositing with Spatial Interactions
- 2026Learning Illumination Control in Diffusion Models