Local Content-Style Control for Diffusion-based Image Stylization
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Image stylization with latent-diffusion models entangles two independently refined axes: what a region depicts and how it is depicted. Such pipelines expose only global controls, yet professional retouching demands deliberate, region-specific control. We lift two conditioning weights already present in a ControlNet + IP-Adapter stylization pipeline from global scalars to per-location spatial maps, yielding local, per-axis control of content and style in a single generative pass. Because the two weights act on disjoint pathways, adjusting them independently spans a 2x2 retouching vocabulary, from free regeneration to identity preservation. We validate that edits stay confined to the retouched region and that each weight predominantly steers its own axis. Our approach requires no retraining and drops unchanged into any such pipeline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 6 of its 26 references that are in the map. First posted on arXiv 6 Oct 2026.
Builds on
6 of 26 references.
Closest ancestors · 3
Same direction, newest first
- 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
Other references · 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Staying True to the Origin: Continuous Image Stylization with Smooth Transitions
- 2023PARASOL: Parametric Style Control for Diffusion Image Synthesis
- 2026RegionRoute: Regional Style Transfer with Diffusion Model
- 2026SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylization
- 2026Scale-Separated Conditioning for Style-Encoder-Free Diffusion Stylization
- 2026Stylistic Attribute Control in Latent Diffusion Models
- 2024Conditional Balance: Improving Multi-Conditioning Trade-Offs in Image Generation
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer