presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search
Not on the map. Why?
Abstract (arXiv)
Object placement is critical in image composition, requiring spatially and semantically coherent positioning of objects within diverse scenes. Existing approaches typically rely on hand-crafted rules or supervised learning on limited datasets, which restricts their generalization and interpretability, especially in open-world scenarios involving novel objects and scenes. In this work, we reformulate open-world object placement as a heuristic search task guided by reasoning from a Multimodal Large Language Model (MLLM). We introduce textsfpresto, a zero-shot, training-free framework that operates within an imaginary action space to iteratively refine object position and scale. Our coarse-to-fine search strategy ensures fast convergence, and we evaluate two decision-making variants: Metric-guided Selection and MLLM-as-a-judge. Experiments across multiple benchmarks show that textsfpresto~achieves state-of-the-art performance, particularly in previously unseen, open-world settings. Human studies further reveal that the MLLM-as-a-judge variant produces more perceptually coherent placements than metric-driven approaches, highlighting a gap between standard evaluation metrics and human visual judgment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 59 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
47 of 59 references.
References · 47
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
35 more
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 268
- 2023Large Language Model Guided Tree-of-Thoughtcited by 221
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
- 2025Competitive Programming with Large Reasoning Modelscited by 119
- 2023LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Modelscited by 113
- 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
- 2019InstaBoost: Boosting Instance Segmentation via Probability Map Guided Copy-Pastingcited by 95
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 65
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2024MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Controlcited by 53
- 2019Learning to Generate Synthetic Data via Compositingcited by 52
- 2024Toward Visual Grounding: A Surveycited by 52
- 2017Synthesizing Training Data for Object Detection in Indoor Scenescited by 48
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 46
- 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
- 2018Learning to Segment via Cut-and-Pastecited by 42
- 2018Context-Aware Synthesis and Placement of Object Instancescited by 41
- 2023CoTDet: Affordance Knowledge Prompting for Task Driven Object Detectioncited by 36
- 2021OPA: Object Placement Assessment Datasetcited by 28
- 2025UniCombine: Unified Multi-Conditional Combination with Diffusion Transformercited by 26
- 2017Where and Who? Automatic Semantic-Aware Person Compositioncited by 21
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
- 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
- 2018On the Importance of Visual Context for Data Augmentation in Scene Understandingcited by 19
- 2023Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Modelscited by 16
- 2018Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyondcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HiddenObjects: Scalable Diffusion-Distilled Spatial Priors for Object Placement
- 2024Imagining the Unseen: Generative Location Modeling for Object Placement
- 2025OpenGround: Planning-based Online Perception for Open-World 3D Visual Grounding
- 2026FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization
- 2023OCTOPUS: Open-vocabulary Content Tracking and Object Placement Using Semantic Understanding in Mixed Reality
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models
- 2026Finder: Agentic Closed-Loop Object Finding for Embodied Grounding
- 2025AnyPlace: Learning Generalized Object Placement for Robot Manipulation