BBQ-to-Image: Numeric Bounding Box and Qolor Control in Large-Scale Text-to-Image Models
Not on the map. Why?
Abstract (arXiv)
Text-to-image models have rapidly advanced in realism and controllability, with recent approaches leveraging long, detailed captions to support fine-grained generation. However, a fundamental parametric gap remains: existing models rely on descriptive language, whereas professional workflows require precise numeric control over object location, size, and color. In this work, we introduce BBQ, a large-scale text-to-image model that directly conditions on numeric bounding boxes and RGB triplets within a unified structured-text framework. We obtain precise spatial and chromatic control by training on captions enriched with parametric annotations, without architectural modifications or inference-time optimization. This also enables intuitive user interfaces such as object dragging and color pickers, replacing ambiguous iterative prompting with precise, familiar controls. Across comprehensive evaluations, BBQ achieves strong box alignment and improves RGB color fidelity over state-of-the-art baselines. More broadly, our results support a new paradigm in which user intent is translated into an intermediate structured language, consumed by a flow-based transformer acting as a renderer and naturally accommodating numeric parameters.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 46 of its 58 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
46 of 58 references.
References · 46
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Qwen3-VL Technical Reportcited by 2,534
34 more
- 2024Depth Anything V2cited by 1,385
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2016Colorful Image Colorizationcited by 1,113
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 247
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
- 2017Real-Time User-Guided Image Colorization with Learned Deep Priorscited by 123
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
- 2018Image Generation from Layoutcited by 105
- 2019Image Synthesis From Reconfigurable Layout and Stylecited by 85
- 2023Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Followingcited by 77
- 2020Instance-aware Image Colorizationcited by 76
- 2022Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesiscited by 75
- 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2019Fully Automatic Video Colorization with Self-Regularization and Diversitycited by 40
- 2018Coloring with Words: Guiding Image Colorization Through Text-based Palette Generationcited by 35
- 2024ColorPeel: Color Prompt Learning with Diffusion Models via Color and Shape Disentanglementcited by 28
- 2020BachGAN: High-Resolution Image Synthesis from Salient Object Layoutcited by 22
- 2022PalGAN: Image Colorization with Palette Generative Adversarial Networkscited by 15
- 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 13
- 2021AttrLostGAN: Attribute Controlled Image Synthesis from Reconfigurable Layout and Stylecited by 11
- 2025Color Conditional Generation with Sliced Wasserstein Guidancecited by 10
- 2025Leveraging Semantic Attribute Binding for Free-Lunch Color Control in Diffusion Modelscited by 7
- 2024Test-time Conditional Text-to-Image Synthesis Using Diffusion Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.