See it to Place it: Evolving Macro Placements with Vision-Language Models
Not on the map. Why?
Abstract (arXiv)
We propose using Vision-Language Models (VLMs) for macro placement in chip floorplanning, a complex optimization task that has recently shown promising advancements through machine learning methods. Because human designers rely heavily on spatial reasoning to arrange components on the chip canvas, we hypothesize that VLMs with strong visual reasoning abilities can effectively complement existing learning-based approaches. We introduce VeoPlace (Visual Evolutionary Optimization Placement), a novel framework that uses a VLM, without any fine-tuning, to guide the actions of a base placer by constraining them to subregions of the chip canvas. The VLM proposals are iteratively optimized through an evolutionary search strategy with respect to resulting placement quality. On open-source benchmarks, VeoPlace outperforms the best prior learning-based approach on 9 of 10 benchmarks with peak wirelength reductions exceeding 32%. We further demonstrate that VeoPlace generalizes to analytical placers, improving DREAMPlace performance on all 8 evaluated benchmarks with gains up to 4.3%. Our approach opens new possibilities for electronic design automation tools that leverage foundation models to solve complex physical design problems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
26 of 49 references.
References · 26
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
14 more
- 2022Multi-Game Decision Transformerscited by 212
- 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMscited by 187
- 2025Evolving Deeper LLM Thinkingcited by 58
- 2021On Joint Learning for Solving Placement and Routing in Chip Designcited by 44
- 2022MaskPlace: Fast Chip Placement via Reinforced Visual Representation Learningcited by 43
- 2023ChiPFormer: Transferable Chip Placement via Offline Decision Transformercited by 42
- 2024Evolving Code with A Large Language Modelcited by 42
- 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Countingcited by 36
- 2023Fully Autonomous Programming with Large Language Modelscited by 31
- 2024Learning to Learn Faster from Human Feedback with Language Model Predictive Controlcited by 25
- 2023Macro Placement by Wire-Mask-Guided Black-Box Optimizationcited by 23
- 2024Reinforcement Learning Policy as Macro Regulator Rather than Macro Placercited by 10
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processescited by 8
- 2025Evolution of Optimization Algorithms for Global Placement via Large Language Modelscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026PlaceReasoner-Beta: Reasoning-Driven Macro Placement and Benchmarking
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models
- 2024Chip Placement with Diffusion Models
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space
- 2026FlowPlace: Flow Matching for Chip Placement
- 2026TLC-Plan: A Two-Level Codebook Based Network for End-to-End Vector Floorplan Generation
- 2026Trinity: One Differentiable Physics for Training, Refining and Scoring Generative Floorplanners
- 2026FloorplanVLM: A Vision-Language Model for Floorplan Vectorization