MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Generative visual models fundamentally struggle with precise spatial control. This arises from a core disconnect: models can process textual descriptions of space but cannot directly map numerical coordinates onto the 2D image canvas. We introduce MetaPoint, a method that bridges this gap by representing a continuous 2D coordinate as a single, special token. Crucially, MetaPoint requires no new architectural components; it directly leverages the model's inherent positional encoding schemes to interpret these coordinates, treating our token as a virtual point on the canvas. This lightweight approach enables pixel-level control of an object's position with one token or its bounding box with two, all without requiring architectural changes or bespoke attention masking. The MetaPoint tokens are designed to be compositional, serving as spatial primitives. This allows a planner agent to decompose a high-level user request into a structured sequence of primitives for the generator. By providing a simple, precise, and scalable building block for spatial control, MetaPoint unlocks more powerful compositional generative agents and enables intuitive, interactive editing systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 68 of its 72 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
68 of 72 references.
Closest ancestors · 1
Same direction, newest first
Other references · 67
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Segment Anythingcited by 8,158
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
38 more
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025Seed1.5-VL Technical Reportcited by 367
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 298
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 123
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 112
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
- 2023Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restorationcited by 86
- 2025Describe Anything: Detailed Localized Image and Video Captioningcited by 84
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 58
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 38
- 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
- 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 36
- 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?cited by 33
- 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generationcited by 32
- 2025EliGen: Entity-Level Controlled Image Generation with Regional Attentioncited by 32
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
- 2025DreamRenderer: Taming Multi-Instance Attribute Control in Large-Scale Text-to-Image Modelscited by 28
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine Systemcited by 7
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Paint-Anything: Unified Any-Color Control for Image Generation and Editingcited by 0
- 2026Paint-Anything: Unified Any-Color Control for Image Generation and Editing17 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System29 Jul 2026
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning2 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling
- 2026GenClaw: Code-Driven Agentic Image Generation
- 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning
- 2026Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
- 2025Seeing through Imagination: Learning Scene Geometry via Implicit Spatial World Modeling
- 2026Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction