Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
We study instruction-based image editing under professional workflows and identify three persistent challenges: (i) editors often over-edit, modifying content beyond the user's intent; (ii) existing models are largely single-turn, while multi-turn edits can alter object faithfulness; and (iii) evaluation at around 1K resolution is misaligned with real workflows that often operate on ultra high-definition images (e.g., 4K). We propose Agent Banana, a hierarchical agentic planner-executor framework for high-fidelity, object-aware, deliberative editing. Agent Banana introduces two key mechanisms: (1) Context Folding, which compresses long interaction histories into structured memory for stable long-horizon control; and (2) Image Layer Decomposition, which performs localized layer-based edits to preserve non-target regions while enabling native-resolution outputs. To support rigorous evaluation, we build HDD-Bench, a high-definition, dialogue-based benchmark featuring verifiable stepwise targets and native 4K images (11.8M pixels) for diagnosing long-horizon failures. On HDD-Bench, Agent Banana achieves the best multi-turn consistency and background fidelity (e.g., IC 0.871, SSIM-OM 0.84, LPIPS-OM 0.12) while remaining competitive on instruction following, and also attains strong performance on standard single-turn editing benchmarks. We hope this work advances reliable, professional-grade agentic image editing and its integration into real workflows.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 56 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
42 of 56 references.
Closest ancestors · 3
Same direction, newest first
- 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent21 Jun
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing8 Jul
Other references · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
27 more
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
- 2023InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Compositioncited by 297
- 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 271
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
- 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
- 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 88
- 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 52
- 2021Unsupervised Layered Image Decomposition into Object Prototypescited by 50
- 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
- 2024Generative Image Layer Decomposition with Visual Effectscited by 33
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
- 2024Layered Image Vectorization via Semantic Simplificationcited by 18
- 2025Generative AI for Film Creation: A Survey of Recent Advancescited by 17
- 2025Multi-turn Consistent Image Editingcited by 17
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026FORTIS: Benchmarking Over-Privilege in Agent Skillscited by 11
- 2026The Autonomy Tax: Defense Training Breaks LLM Agentscited by 8
- 2026Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generationcited by 8
- 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 7
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Modelscited by 2
- 2026CAMEO: A Conditional and Quality-Aware Multi-Agent Image Editing Orchestratorcited by 2
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinementcited by 1
- 2026Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generationcited by 1
- 2026ExpressEdit: Fast Editing of Stylized Facial Expressions with Diffusion Models in Photoshopcited by 0
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
5 more
- 2026Agent Safety Is Action Alignmentcited by 0
- 2026Making Implicit Preservation Intent Explicit in Conversational Image Editingcited by 0
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Designcited by 0
- 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generationcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generation23 Aug 2026
- 2026Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation7 Aug 2026
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Design4 Aug 2026
- 2026Making Implicit Preservation Intent Explicit in Conversational Image Editing8 Jul 2026
- 2026Agent Safety Is Action Alignment27 Jun 2026
- 2026Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation25 Jun 2026
- 2026Aurora: Unified Video Editing with a Tool-Using Agent18 May 2026
- 2026FORTIS: Benchmarking Over-Privilege in Agent Skills9 May 2026
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement8 May 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026ExpressEdit: Fast Editing of Stylized Facial Expressions with Diffusion Models in Photoshop3 Apr 2026
5 more
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro3 Apr 2026
- 2026CAMEO: A Conditional and Quality-Aware Multi-Agent Image Editing Orchestrator3 Apr 2026
- 2026The Autonomy Tax: Defense Training Breaks LLM Agents19 Mar 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models26 Feb 2026
- 2026FORTIS: Benchmarking Over-Privilege in Agent Skillscited by 11
- 2026The Autonomy Tax: Defense Training Breaks LLM Agentscited by 8
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinementcited by 1
- 2026Agent Safety Is Action Alignmentcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Agent Safety Is Action Alignment27 Jun 2026
- 2026FORTIS: Benchmarking Over-Privilege in Agent Skills9 May 2026
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement8 May 2026
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro3 Apr 2026
- 2026The Autonomy Tax: Defense Training Breaks LLM Agents19 Mar 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generationcited by 8
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Modelscited by 2
- 2026CAMEO: A Conditional and Quality-Aware Multi-Agent Image Editing Orchestratorcited by 2
- 2026Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generationcited by 1
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
- 2026Making Implicit Preservation Intent Explicit in Conversational Image Editingcited by 0
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Designcited by 0
- 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generationcited by 0
- 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generation23 Aug 2026
- 2026Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation7 Aug 2026
- 2026UniWorld-Design: From Pixel Generation to Layer-Native Design4 Aug 2026
- 2026Making Implicit Preservation Intent Explicit in Conversational Image Editing8 Jul 2026
- 2026Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation25 Jun 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026CAMEO: A Conditional and Quality-Aware Multi-Agent Image Editing Orchestrator3 Apr 2026
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models26 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions
- 2025An LLM-LVLM Driven Agent for Iterative and Fine-Grained Image Editing
- 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
- 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflection
- 2026APE: Agentic Prompt Enhancer for Image Generation and Editing
- 2026MSRAMIE: Multimodal Structured Reasoning Agent for Multi-instruction Image Editing
- 2026Agentic Planning with Reasoning for Image Styling via Offline RL