mlsanityData to 14 Oct 2026

Training Free Stylized Abstraction

arXiv 2505.22663 ↗First posted 28 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Stylized abstraction synthesizes visually exaggerated yet semantically faithful representations of subjects, balancing recognizability with perceptual distortion. Unlike image-to-image translation, which prioritizes structural fidelity, stylized abstraction demands selective retention of identity cues while embracing stylistic divergence, especially challenging for out-of-distribution individuals. We propose a training-free framework that generates stylized abstractions from a single image using inference-time scaling in vision-language models (VLLMs) to extract identity-relevant features, and a novel cross-domain rectified flow inversion strategy that reconstructs structure based on style-dependent priors. Our method adapts structural restoration dynamically through style-aware temporal scheduling, enabling high-fidelity reconstructions that honor both subject and style. It supports multi-round abstraction-aware generation without fine-tuning. To evaluate this task, we introduce StyleBench, a GPT-based human-aligned metric suited for abstract styles where pixel-level similarity fails. Experiments across diverse abstraction (e.g., LEGO, knitted dolls, South Park) show strong generalization to unseen identities and styles in a fully open-source setup.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 60 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

47 of 60 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  8. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  9. 2018Demystifying MMD GANscited by 1,293
  10. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  11. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  12. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
35 more
  1. 2015A Neural Algorithm of Artistic Stylecited by 483
  2. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  3. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  4. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
  5. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  6. 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
  7. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  8. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  9. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  10. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 212
  11. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  12. 2017Neural Style Transfer: A Reviewcited by 199
  13. 2021StyTr2: Image Style Transfer with Transformerscited by 187
  14. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  15. 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 155
  16. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  17. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  18. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  19. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  20. 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
  21. 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
  22. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  23. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
  24. 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
  25. 2024Instruct-Imagen: Image Generation with Multi-modal Instructioncited by 65
  26. 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 53
  27. 2023DreamTuner: Single Image is Enough for Subject-Driven Generationcited by 41
  28. 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 40
  29. 2023Highly Personalized Text Embedding for Image Manipulation by Stable Diffusioncited by 39
  30. 2024LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generationcited by 30
  31. 2023Text-to-Image Generation for Abstract Conceptscited by 18
  32. 2023A Data Perspective on Enhanced Identity Preservation for Diffusion Personalizationcited by 18
  33. 2023Decoupled Textual Embeddings for Customized Image Generationcited by 18
  34. 2024Subject-driven Text-to-Image Generation via Preference-based Reinforcement Learningcited by 12
  35. 2022StyleID: Identity Disentanglement for Anonymizing Facescited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Training-Free Diffusion Framework for Stylized Image Generation with Identity Preservation
  2. 2026StyleID: A Perception-Aware Dataset and Metric for Stylization-Agnostic Facial Identity Recognition
  3. 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfer
  4. 2026StyleDecoupler: Generalizable Artistic Style Disentanglement
  5. 2026SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylization
  6. 2025Inversion-Free Style Transfer with Dual Rectified Flows
  7. 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer
  8. 2025Training-free Stylized Text-to-Image Generation with Fast Inference