Progressive Photorealistic Simplification
Not on the map. Why?
Abstract (arXiv)
Existing image simplification techniques often rely on Non-Photorealistic Rendering (NPR), transforming photographs into stylized sketches, cartoons, or paintings. While effective at reducing visual complexity, such approaches typically sacrifice photographic realism. In this work, we explore a complementary direction: simplifying images while preserving their photorealistic appearance. We introduce progressive semantic image simplification, a framework that iteratively reduces scene complexity by removing and inpainting elements in a controlled manner. At each step, the resulting image remains a plausible natural photograph. Our method combines semantic understanding with generative editing, leveraging Vision-Language Models (VLMs) to identify and prioritize elements for removal, and a learned verifier to ensure photorealism and coherence throughout the process. This is implemented via an iterative Select-Remove-Verify pipeline that produces high-quality simplification trajectories. To improve efficiency, we further distill this process into an image-to-video generation model that directly predicts coherent simplification sequences from a single input image. Beyond generating cleaner and more focused compositions, our approach enables applications such as content-aware decluttering, semantic layer decomposition, and interactive editing. More broadly, our work suggests that simplification through structured content removal can serve as a practical mechanism for guiding visual interpretation within the photorealistic domain, complementing traditional abstraction methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 45 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
8 of 45 references.
References · 8
- 2023Segment Anythingcited by 8,158
- 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstractioncited by 63
- 2022CLIPasso: Semantically-Aware Object Sketchingcited by 57
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
- 2021Image Composition Assessment with Saliency-augmented Multi-pattern Poolingcited by 21
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos
- 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesis
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space
- 2025BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing
- 2024Pathways on the Image Manifold: Image Editing via Video Generation
- 2024FashionR2R: Texture-preserving Rendered-to-Real Image Translation with Diffusion Models