SceneCraft: Interactive System for Image Editing via Scene Graph
Not on the map. Why?
Abstract (arXiv)
Recent advances in generative AI have enabled natural language-driven image editing, yet existing systems often fail in complex scenes with multiple interacting objects because they rely heavily on users crafting precise text prompts. To address the absence of structured control, we propose SceneCraft, a novel interactive framework that bridges user intent and model execution by representing images as editable scene graphs. Instead of guessing text prompts through trial and error, users interact directly with a visual graph to perform complex spatial and relational operations. These graph modifications are automatically translated into precise, context-aware editing prompts, effectively eliminating linguistic ambiguity. To ensure robust and diverse results, structured prompts are dispatched to multiple state-of-the-art generative models. Evaluations across diverse editing scenarios show that SceneCraft provides a more intuitive control mechanism, significantly reducing the cognitive burden of manual prompt engineering while generating outputs that users consistently rate as higher in quality and fidelity.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
16 of 28 references.
References · 16
- 2023Segment Anythingcited by 8,234
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
- 2023Grounded Text-to-Image Synthesis with Attention Refocusingcited by 164
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
- 2024SGEdit: Bridging LLM with Text2Image Generative Model for Scene Graph-based Image Editingcited by 10
4 more
- 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
- 2023PromptCrafter: Crafting Text-to-Image Prompt through Mixed-Initiative Dialogue with LLMcited by 6
- 2024Empowering Visual Creativity: A Vision-Language Assistant to Image Editing Recommendationscited by 6
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.