mlsanityData to 14 Oct 2026

presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search

arXiv 2608.21543 ↗First posted 21 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Object placement is critical in image composition, requiring spatially and semantically coherent positioning of objects within diverse scenes. Existing approaches typically rely on hand-crafted rules or supervised learning on limited datasets, which restricts their generalization and interpretability, especially in open-world scenarios involving novel objects and scenes. In this work, we reformulate open-world object placement as a heuristic search task guided by reasoning from a Multimodal Large Language Model (MLLM). We introduce textsfpresto, a zero-shot, training-free framework that operates within an imaginary action space to iteratively refine object position and scale. Our coarse-to-fine search strategy ensures fast convergence, and we evaluate two decision-making variants: Metric-guided Selection and MLLM-as-a-judge. Experiments across multiple benchmarks show that textsfpresto~achieves state-of-the-art performance, particularly in previously unseen, open-world settings. Human studies further reveal that the MLLM-as-a-judge variant produces more perceptually coherent placements than metric-driven approaches, highlighting a gap between standard evaluation metrics and human visual judgment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 59 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

47 of 59 references.

References · 47

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2024GPT-4o System Cardcited by 4,588
  9. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  10. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  12. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
35 more
  1. 2021Grounded Language-Image Pre-trainingcited by 1,156
  2. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  3. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  4. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  5. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  6. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
  7. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  8. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 268
  9. 2023Large Language Model Guided Tree-of-Thoughtcited by 221
  10. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
  11. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
  12. 2025Competitive Programming with Large Reasoning Modelscited by 119
  13. 2023LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Modelscited by 113
  14. 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
  15. 2019InstaBoost: Boosting Instance Segmentation via Probability Map Guided Copy-Pastingcited by 95
  16. 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 65
  17. 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
  18. 2024MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Controlcited by 53
  19. 2019Learning to Generate Synthetic Data via Compositingcited by 52
  20. 2024Toward Visual Grounding: A Surveycited by 52
  21. 2017Synthesizing Training Data for Object Detection in Indoor Scenescited by 48
  22. 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
  23. 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 46
  24. 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
  25. 2018Learning to Segment via Cut-and-Pastecited by 42
  26. 2018Context-Aware Synthesis and Placement of Object Instancescited by 41
  27. 2023CoTDet: Affordance Knowledge Prompting for Task Driven Object Detectioncited by 36
  28. 2021OPA: Object Placement Assessment Datasetcited by 28
  29. 2025UniCombine: Unified Multi-Conditional Combination with Diffusion Transformercited by 26
  30. 2017Where and Who? Automatic Semantic-Aware Person Compositioncited by 21
  31. 2022Learning Object Placement via Dual-path Graph Completioncited by 20
  32. 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
  33. 2018On the Importance of Visual Context for Data Augmentation in Scene Understandingcited by 19
  34. 2023Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Modelscited by 16
  35. 2018Pedestrian-Synthesis-GAN: Generating Pedestrian Data in Real Scene and Beyondcited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HiddenObjects: Scalable Diffusion-Distilled Spatial Priors for Object Placement
  2. 2024Imagining the Unseen: Generative Location Modeling for Object Placement
  3. 2025OpenGround: Planning-based Online Perception for Open-World 3D Visual Grounding
  4. 2026FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization
  5. 2023OCTOPUS: Open-vocabulary Content Tracking and Object Placement Using Semantic Understanding in Mixed Reality
  6. 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models
  7. 2026Finder: Agentic Closed-Loop Object Finding for Embodied Grounding
  8. 2025AnyPlace: Learning Generalized Object Placement for Robot Manipulation