ByteEdit: Boost, Comply and Accelerate Generative Image Editing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent advancements in diffusion-based generative image editing have sparked a profound revolution, reshaping the landscape of image outpainting and inpainting tasks. Despite these strides, the field grapples with inherent challenges, including: i) inferior quality; ii) poor consistency; iii) insufficient instrcution adherence; iv) suboptimal generation efficiency. To address these obstacles, we present ByteEdit, an innovative feedback learning framework meticulously designed to Boost, Comply, and Accelerate Generative Image Editing tasks. ByteEdit seamlessly integrates image reward models dedicated to enhancing aesthetics and image-text alignment, while also introducing a dense, pixel-level reward model tailored to foster coherence in the output. Furthermore, we propose a pioneering adversarial and progressive feedback learning strategy to expedite the model's inference speed. Through extensive large-scale user evaluations, we demonstrate that ByteEdit surpasses leading generative image editing products, including Adobe, Canva, and MeiTu, in both generation quality and consistency. ByteEdit-Outpainting exhibits a remarkable enhancement of 388% and 135% in quality and consistency, respectively, when compared to the baseline model. Experiments also verfied that our acceleration models maintains excellent performance results in terms of quality and consistency.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 42 of its 46 references that are in the map. First posted on arXiv 7 Apr 2024.
Builds on
42 of 46 references.
Closest ancestors · 10
Same direction, newest first
- 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation18 Jan
- 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs14 Nov
- 2023DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection7 Sep
- 2023Iterative Multi-granular Image Editing using Diffusion Models1 Sep
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting13 Dec
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
- 2022Blended Latent Diffusion6 Jun
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
- 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
20 more
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Adversarial Diffusion Distillationcited by 741
- 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 672
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2024Self-Play Fine-Tuning of Diffusion Models for Text-to-Image Generationcited by 85
- 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Modelscited by 66
- 2024A Dense Reward View on Aligning Text-to-Image Diffusion with Preferencecited by 55
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
- 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Modelscited by 30
- 2024Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biasescited by 29
- 2023Semi-Implicit Denoising Diffusion Models (SIDDMs)cited by 14
- 2024Social Reward: Evaluating and Enhancing Generative AI through Million-User Feedback from an Online Creative Communitycited by 8
- 2023UGC: Unified GAN Compression for Efficient Image-to-Image Translationcited by 3
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 2.
10 papers.
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
- 2025RewardDance: Reward Scaling in Visual Generationcited by 63
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 61
- 2025OneReward: Unified Mask-Guided Image Generation via Multi-Task Human Preference Learningcited by 22
- 2024Multi-Reward as Condition for Instruction-based Image Editingcited by 20
- 2025Hyper-Bagel: A Unified Acceleration Framework for Multimodal Understanding and Generationcited by 13
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editingcited by 8
- 2024RFSR: Improving ISR Diffusion Models via Reward Feedback Learningcited by 5
- 2025ADT: Tuning Diffusion Models with Adversarial Supervisioncited by 4
- 2026You Only Erase Once: Erasing Anything without Bringing Unexpected Contentcited by 0
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing30 Apr 2026
- 2026You Only Erase Once: Erasing Anything without Bringing Unexpected Content29 Mar 2026
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling28 Sep 2025
- 2025Hyper-Bagel: A Unified Acceleration Framework for Multimodal Understanding and Generation23 Sep 2025
- 2025RewardDance: Reward Scaling in Visual Generation10 Sep 2025
- 2025OneReward: Unified Mask-Guided Image Generation via Multi-Task Human Preference Learning28 Aug 2025
- 2025ADT: Tuning Diffusion Models with Adversarial Supervision15 Apr 2025
- 2024RFSR: Improving ISR Diffusion Models via Reward Feedback Learning4 Dec 2024
- 2024Multi-Reward as Condition for Instruction-based Image Editing6 Nov 2024
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis21 Apr 2024
Similar, not cited
Close in wording, no citation either way
- 2026EPEdit: Redefining Image Editing with Generative AI and User-Centric Design
- 2025EditInfinity: Image Editing with Binary-Quantized Generative Models
- 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learning
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2026CoCoEdit: Content-Consistent Image Editing via Region Regularized Reinforcement Learning
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmark
- 2026Masked Generative Transformer Is What You Need for Image Editing