Camera Control for Text-to-Image Generation via Learning Viewpoint Tokens
Not on the map. Why?
Abstract (arXiv)
Current text-to-image models struggle to provide precise camera control using natural language alone. In this work, we present a framework for precise camera control with global scene understanding in text-to-image generation by learning parametric camera tokens. We fine-tune image generation models for viewpoint-conditioned text-to-image generation on a curated dataset that combines 3D-rendered images for geometric supervision and photorealistic augmentations for appearance and background diversity. Qualitative and quantitative experiments demonstrate that our method achieves state-of-the-art accuracy while preserving image quality and prompt fidelity. Unlike prior methods that overfit to object-specific appearance correlations, our viewpoint tokens learn factorized geometric representations that transfer to unseen object categories. Our work shows that text-vision latent spaces can be endowed with explicit 3D camera structure, offering a pathway toward geometrically-aware prompts for text-to-image generation. Project page: https://randdl.github.io/viewtoken_control/
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
45 of 55 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2024Qwen2 Technical Reportcited by 2,076
33 more
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
- 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Imagecited by 67
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
- 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 45
- 2024One Diffusion to Generate Them Allcited by 41
- 2025TexVerse: A Universe of 3D Objects with High-Resolution Texturescited by 41
- 2024SceneCraft: Layout-Guided 3D Scene Generationcited by 40
- 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
- 2025Compass Control: Multi Object Orientation Control for Text-to-Image Generationcited by 11
- 2023Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Modelscited by 7
- 2025LACONIC: A 3D Layout Adapter for Controllable Image Creationcited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.