mlsanityData to 14 Oct 2026

Does FLUX Already Know How to Perform Physically Plausible Image Composition?

arXiv 2509.21278 ↗First posted 25 Sep 2025cs.CV cs.AI cs.LGcited by 32

Not on the map. Why?

Abstract (arXiv)

Image composition aims to seamlessly insert a user-specified object into a new scene, but existing models struggle with complex lighting (e.g., accurate shadows, water reflections) and diverse, high-resolution inputs. Modern text-to-image diffusion models (e.g., SD3.5, FLUX) already encode essential physical and resolution priors, yet lack a framework to unleash them without resorting to latent inversion, which often locks object poses into contextually inappropriate orientations, or brittle attention surgery. We propose SHINE, a training-free framework for Seamless, High-fidelity Insertion with Neutralized Errors. SHINE introduces manifold-steered anchor loss, leveraging pretrained customization adapters (e.g., IP-Adapter) to guide latents for faithful subject representation while preserving background integrity. Degradation-suppression guidance and adaptive background blending are proposed to further eliminate low-quality outputs and visible seams. To address the lack of rigorous benchmarks, we introduce ComplexCompo, featuring diverse resolutions and challenging conditions such as low lighting, strong illumination, intricate shadows, and reflective surfaces. Experiments on ComplexCompo and DreamEditBench show state-of-the-art performance on standard metrics (e.g., DINOv2) and human-aligned scores (e.g., DreamSim, ImageReward, VisionReward). Code is available at https://github.com/ZhumingLian/SHINE.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 125 of its 149 references that are in the map. First posted on arXiv 25 Sep 2025.

Builds on

125 of 149 references.

References · 125

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
38 more
  1. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  8. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  9. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  10. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  11. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  12. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  13. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  14. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  15. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  16. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  17. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  18. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  19. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  20. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  21. 2024OmniGen: Unified Image Generationcited by 394
  22. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
  23. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  24. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  25. 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 307
  26. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  27. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  28. 2025Transfer between Modalities with MetaQueriescited by 236
  29. 2022Diffusion models as plug-and-play priorscited by 231
  30. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  31. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  32. 2023Controlling Text-to-Image Diffusion by Orthogonal Finetuningcited by 208
  33. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  34. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  35. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
  36. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  37. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
  38. 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169

50 most cited of 125 All 125 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 23.

32 papers.

Sort:

By area:

  1. 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
  2. 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
  3. 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
  4. 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
  5. 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Datasetcited by 18
  6. 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 17
  7. 2026LUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Expertscited by 15
  8. 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
  9. 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Modelscited by 11
  10. 2025BideDPO: Conditional Image Generation with Simultaneous Text and Condition Alignmentcited by 10
  11. 2025ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecastingcited by 8
  12. 2026From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmarkcited by 7
20 more
  1. 2026RefineAnything: Multimodal Region-Specific Refinement for Perfect Local Detailscited by 5
  2. 2025Diffusion-Based Image Editing for Breaking Robust Watermarkscited by 4
  3. 2026MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generationcited by 4
  4. 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarkscited by 3
  5. 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 3
  6. 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarkingcited by 2
  7. 2026Spiking Pyramid Wavelet Transformation for High-efficient and Low-energy Image Restorationcited by 2
  8. 2026GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systemscited by 1
  9. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offscited by 1
  10. 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 1
  11. 2026RevealLayer: Disentangling Hidden and Visible Layers via Occlusion-Aware Image Decompositioncited by 1
  12. 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrievalcited by 1
  13. 2025DeRainMamba: A Frequency-Aware State Space Model with Detail Enhancement for Image Derainingcited by 0
  14. 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editingcited by 0
  15. 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarkingcited by 0
  16. 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Modelscited by 0
  17. 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
  18. 2026Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositingcited by 0
  19. 2026On the Controllability-Fidelity Frontier in Diffusion Editingcited by 0
  20. 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026A training-free framework for high-fidelity appearance transfer via diffusion transformers
  2. 2024Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering
  3. 2023Cross-domain Compositing with Pretrained Diffusion Models
  4. 2024Draw Like an Artist: Complex Scene Generation with Diffusion Model via Composition, Painting, and Retouching
  5. 2026Panoptic Scene Program Diffusion Transformer
  6. 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Models
  7. 2026PICS: Pairwise Image Compositing with Spatial Interactions
  8. 2026Learning Illumination Control in Diffusion Models