mlsanityData to 7 Oct 2026

ByteEdit: Boost, Comply and Accelerate Generative Image Editing

arXiv 2404.04860 ↗First posted 7 Apr 2024cs.CVcited by 10

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent advancements in diffusion-based generative image editing have sparked a profound revolution, reshaping the landscape of image outpainting and inpainting tasks. Despite these strides, the field grapples with inherent challenges, including: i) inferior quality; ii) poor consistency; iii) insufficient instrcution adherence; iv) suboptimal generation efficiency. To address these obstacles, we present ByteEdit, an innovative feedback learning framework meticulously designed to Boost, Comply, and Accelerate Generative Image Editing tasks. ByteEdit seamlessly integrates image reward models dedicated to enhancing aesthetics and image-text alignment, while also introducing a dense, pixel-level reward model tailored to foster coherence in the output. Furthermore, we propose a pioneering adversarial and progressive feedback learning strategy to expedite the model's inference speed. Through extensive large-scale user evaluations, we demonstrate that ByteEdit surpasses leading generative image editing products, including Adobe, Canva, and MeiTu, in both generation quality and consistency. ByteEdit-Outpainting exhibits a remarkable enhancement of 388% and 135% in quality and consistency, respectively, when compared to the baseline model. Experiments also verfied that our acceleration models maintains excellent performance results in terms of quality and consistency.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 42 of its 46 references that are in the map. First posted on arXiv 7 Apr 2024.

Builds on

42 of 46 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation18 Jan
  2. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs14 Nov
  3. 2023DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection7 Sep
  4. 2023Iterative Multi-granular Image Editing using Diffusion Models1 Sep
  5. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting13 Dec
  6. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
  7. 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
  8. 2022Blended Latent Diffusion6 Jun
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  10. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  7. 2023Segment Anythingcited by 8,158
  8. 2023Visual Instruction Tuningcited by 7,792
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
20 more
  1. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
  2. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  3. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  4. 2023Adversarial Diffusion Distillationcited by 741
  5. 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
  6. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  7. 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
  8. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  9. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
  10. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
  11. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  12. 2024Self-Play Fine-Tuning of Diffusion Models for Text-to-Image Generationcited by 85
  13. 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Modelscited by 66
  14. 2024A Dense Reward View on Aligning Text-to-Image Diffusion with Preferencecited by 55
  15. 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
  16. 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Modelscited by 30
  17. 2024Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biasescited by 29
  18. 2023Semi-Implicit Denoising Diffusion Models (SIDDMs)cited by 14
  19. 2024Social Reward: Evaluating and Enhancing Generative AI through Million-User Feedback from an Online Creative Communitycited by 8
  20. 2023UGC: Unified GAN Compression for Efficient Image-to-Image Translationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 2.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EPEdit: Redefining Image Editing with Generative AI and User-Centric Design
  2. 2025EditInfinity: Image Editing with Binary-Quantized Generative Models
  3. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learning
  4. 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space
  5. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  6. 2026CoCoEdit: Content-Consistent Image Editing via Region Regularized Reinforcement Learning
  7. 2025ImgEdit: A Unified Image Editing Dataset and Benchmark
  8. 2026Masked Generative Transformer Is What You Need for Image Editing