Training Free Stylized Abstraction
Not on the map. Why?
Abstract (arXiv)
Stylized abstraction synthesizes visually exaggerated yet semantically faithful representations of subjects, balancing recognizability with perceptual distortion. Unlike image-to-image translation, which prioritizes structural fidelity, stylized abstraction demands selective retention of identity cues while embracing stylistic divergence, especially challenging for out-of-distribution individuals. We propose a training-free framework that generates stylized abstractions from a single image using inference-time scaling in vision-language models (VLLMs) to extract identity-relevant features, and a novel cross-domain rectified flow inversion strategy that reconstructs structure based on style-dependent priors. Our method adapts structural restoration dynamically through style-aware temporal scheduling, enabling high-fidelity reconstructions that honor both subject and style. It supports multi-round abstraction-aware generation without fine-tuning. To evaluate this task, we introduce StyleBench, a GPT-based human-aligned metric suited for abstract styles where pixel-level similarity fails. Experiments across diverse abstraction (e.g., LEGO, knitted dolls, South Park) show strong generalization to unseen identities and styles in a fully open-source setup.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 60 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
47 of 60 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2018Demystifying MMD GANscited by 1,293
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
35 more
- 2015A Neural Algorithm of Artistic Stylecited by 483
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
- 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 212
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2017Neural Style Transfer: A Reviewcited by 199
- 2021StyTr2: Image Style Transfer with Transformerscited by 187
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 155
- 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
- 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
- 2024Instruct-Imagen: Image Generation with Multi-modal Instructioncited by 65
- 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 53
- 2023DreamTuner: Single Image is Enough for Subject-Driven Generationcited by 41
- 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 40
- 2023Highly Personalized Text Embedding for Image Manipulation by Stable Diffusioncited by 39
- 2024LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generationcited by 30
- 2023Text-to-Image Generation for Abstract Conceptscited by 18
- 2023A Data Perspective on Enhanced Identity Preservation for Diffusion Personalizationcited by 18
- 2023Decoupled Textual Embeddings for Customized Image Generationcited by 18
- 2024Subject-driven Text-to-Image Generation via Preference-based Reinforcement Learningcited by 12
- 2022StyleID: Identity Disentanglement for Anonymizing Facescited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Training-Free Diffusion Framework for Stylized Image Generation with Identity Preservation
- 2026StyleID: A Perception-Aware Dataset and Metric for Stylization-Agnostic Facial Identity Recognition
- 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfer
- 2026StyleDecoupler: Generalizable Artistic Style Disentanglement
- 2026SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylization
- 2025Inversion-Free Style Transfer with Dual Rectified Flows
- 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer
- 2025Training-free Stylized Text-to-Image Generation with Fast Inference