mlsanityData to 14 Oct 2026

ReMix: Towards a Unified View of Consistent Character Generation and Editing

arXiv 2510.10156 ↗First posted 11 Oct 2025cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent advances in large-scale text-to-image diffusion models (e.g., FLUX.1) have greatly improved visual fidelity in consistent character generation and editing. However, existing methods rarely unify these tasks within a single framework. Generation-based approaches struggle with fine-grained identity consistency across instances, while editing-based methods often lose spatial controllability and instruction alignment. To bridge this gap, we propose ReMix, a unified framework for character-consistent generation and editing. It constitutes two core components: the ReMix Module and IP-ControlNet. The ReMix Module leverages the multimodal reasoning ability of MLLMs to edit semantic features of input images and adapt instruction embeddings to the native DiT backbone without fine-tuning. While this ensures coherent semantic layouts, pixel-level consistency and pose controllability remain challenging. To address this, IP-ControlNet extends ControlNet to decouple semantic and layout cues from reference images and introduces an ε-equivariant latent space that jointly denoises the reference and target images within a shared noise space. Inspired by convergent evolution and quantum decoherence,i.e., where environmental noise drives state convergence, this design promotes feature alignment in the hidden space, enabling consistent object generation while preserving identity. ReMix supports a wide range of tasks, including personalized generation, image editing, style transfer, and multi-condition synthesis. Extensive experiments validate its effectiveness and efficiency as a unified framework for character-consistent image generation and editing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 44 of its 53 references that are in the map. First posted on arXiv 11 Oct 2025.

Builds on

44 of 53 references.

Closest ancestors · 21

Same direction, newest first

  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  2. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervision11 Nov
  3. 2024In-Context LoRA for Diffusion Transformers31 Oct
  4. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generation12 Aug
  5. 2024EMMA: Your Text-to-Image Diffusion Model Can Secretly Accept Multi-Modal Prompts13 Jun
  6. 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedback11 Apr
  7. 2024An Item is Worth a Prompt: Versatile Image Editing with Disentangled Control7 Mar
  8. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
  9. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  10. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models25 May
  11. 2023Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models25 May
  12. 2023Reference-based Image Composition with Sketch via Structure-aware Diffusion Model31 Mar
9 more
  1. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb
  2. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  3. 2023Boundary Guided Learning-Free Semantic Control with Diffusion Models16 Feb
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  5. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  8. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance10 Dec
  9. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct

Other references · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  8. 2025Qwen-Image Technical Reportcited by 1,044
  9. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  10. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  11. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  12. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
11 more
  1. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  2. 2022Diffusion Models already have a Semantic Latent Spacecited by 328
  3. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  4. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  5. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  6. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
  7. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  8. 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
  9. 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
  10. 2024InsightEdit: Towards Better Instruction Following for Image Editingcited by 17
  11. 2025AnyStory: Towards Unified Single and Multiple Subject Personalization in Text-to-Image Generationcited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026On the Controllability-Fidelity Frontier in Diffusion Editing
  2. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  3. 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Rendering
  4. 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing
  5. 2024Latent Space Disentanglement in Diffusion Transformers Enables Zero-shot Fine-grained Semantic Editing
  6. 2025CharCom: Composable Identity Control for Multi-Character Story Illustration
  7. 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
  8. 2024Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps