CharGen: Fast and Fluent Portrait Modification
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Interactive editing of character images with diffusion models remains challenging due to the inherent trade-off between fine-grained control, generation speed, and visual fidelity. We introduce CharGen, a character-focused editor that combines attribute-specific Concept Sliders, trained to isolate and manipulate attributes such as facial feature size, expression, and decoration with the StreamDiffusion sampling pipeline for more interactive performance. To counteract the loss of detail that often accompanies accelerated sampling, we propose a lightweight Repair Step that reinstates fine textures without compromising structural consistency. Throughout extensive ablation studies and in comparison to open-source InstructPix2Pix and closed-source Google Gemini, and a comprehensive user study, CharGen achieves two-to-four-fold faster edit turnaround with precise editing control and identity-consistent results. Project page: https://chargen.jdihlmann.com/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 21 of its 32 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
21 of 32 references.
Closest ancestors · 8
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2024Prompt Sliders for Fine-Grained Control, Editing and Erasing of Concepts in Diffusion Models25 Sep
- 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
- 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing26 Jun
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct
Other references · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2016Pixel Recurrent Neural Networkscited by 816
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
- 2023DiffiT: Diffusion Vision Transformers for Image Generationcited by 106
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2023StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generationcited by 58
- 2019SliderGAN: Synthesizing Expressive Face Images by Sliding 3D Blendshape Parameterscited by 10
1 more
- 2024SOEDiff: Efficient Distillation for Small Object Editingcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024CharGen: High Accurate Character-Level Visual Text Generation Model with MultiModal Encoder
- 2025PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement
- 2026ExpressEdit: Fast Editing of Stylized Facial Expressions with Diffusion Models in Photoshop
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting
- 2024Streamlining Image Editing with Layered Diffusion Brushes
- 2024BrushEdit: All-In-One Image Inpainting and Editing
- 2024ByteEdit: Boost, Comply and Accelerate Generative Image Editing
- 2024FunEditor: Achieving Complex Image Edits via Function Aggregation with Diffusion Models