mlsanityData to 7 Oct 2026

Painterly Image Harmonization by Learning from Painterly Objects

arXiv 2312.10263 ↗First posted 15 Dec 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Given a composite image with photographic object and painterly background, painterly image harmonization targets at stylizing the composite object to be compatible with the background. Despite the competitive performance of existing painterly harmonization works, they did not fully leverage the painterly objects in artistic paintings. In this work, we explore learning from painterly objects for painterly image harmonization. In particular, we learn a mapping from background style and object information to object style based on painterly objects in artistic paintings. With the learnt mapping, we can hallucinate the target style of composite object, which is used to harmonize encoder feature maps to produce the harmonized image. Extensive experiments on the benchmark dataset demonstrate the effectiveness of our proposed method.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 44 of its 58 references that are in the map. First posted on arXiv 15 Dec 2023.

Builds on

44 of 58 references.

References · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  8. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
  9. 2017Universal Style Transfer via Feature Transformscited by 352
  10. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
  11. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
  12. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
32 more
  1. 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
  2. 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 134
  3. 2017Deep Image Harmonizationcited by 120
  4. 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
  5. 2016Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesiscited by 102
  6. 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
  7. 2017StyleBank: An Explicit Representation for Neural Image Style Transfercited by 89
  8. 2019Dynamic Instance Normalization for Arbitrary Style Transfercited by 83
  9. 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
  10. 2019Improving the Harmony of the Composite Image by Spatial-Separated Attention Modulecited by 73
  11. 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
  12. 2019Deep Image Blendingcited by 62
  13. 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
  14. 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
  15. 2018A Style-Aware Content Loss for Real-time HD Style Transfercited by 58
  16. 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
  17. 2020Foreground-aware Semantic Representations for Image Harmonizationcited by 53
  18. 2020Collaborative Distillation for Ultra-Resolution Universal Style Transfercited by 52
  19. 2020BargainNet: Background-Guided Domain Translation for Image Harmonizationcited by 52
  20. 2018Learning Linear Transformations for Fast Arbitrary Style Transfercited by 48
  21. 2022DCCF: Deep Comprehensible Color Filter Learning Framework for High-Resolution Image Harmonizationcited by 46
  22. 2020Manifold Alignment for Semantically Aligned Style Transfercited by 34
  23. 2019Multimodal Style Transfer via Graph Cutscited by 32
  24. 2023Semi-supervised Parametric Real-world Image Harmonizationcited by 26
  25. 2021Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonizationcited by 25
  26. 2018Deep Painterly Harmonizationcited by 19
  27. 2022QuantArt: Quantizing Image Style Transfer Towards High Visual Fidelitycited by 18
  28. 2016Style-Transfer via Texture-Synthesiscited by 17
  29. 2023Cross-domain Compositing with Pretrained Diffusion Modelscited by 13
  30. 2023LEMaRT: Label-Efficient Masked Region Transform for Image Harmonizationcited by 12
  31. 2022FRIH: Fine-grained Region-aware Image Harmonizationcited by 9
  32. 2022Image Harmonization by Matching Regional Referencescited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.

  1. 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
  2. 2024Magic Insert: Style-Aware Drag-and-Dropcited by 17
  3. 2026Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositingcited by 0