mlsanityData to 7 Oct 2026

Camera Control for Text-to-Image Generation via Learning Viewpoint Tokens

arXiv 2604.19954 ↗First posted 21 Apr 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Current text-to-image models struggle to provide precise camera control using natural language alone. In this work, we present a framework for precise camera control with global scene understanding in text-to-image generation by learning parametric camera tokens. We fine-tune image generation models for viewpoint-conditioned text-to-image generation on a curated dataset that combines 3D-rendered images for geometric supervision and photorealistic augmentations for appearance and background diversity. Qualitative and quantitative experiments demonstrate that our method achieves state-of-the-art accuracy while preserving image quality and prompt fidelity. Unlike prior methods that overfit to object-specific appearance correlations, our viewpoint tokens learn factorized geometric representations that transfer to unseen object categories. Our work shows that text-vision latent spaces can be endowed with explicit 3D camera structure, offering a pathway toward geometrically-aware prompts for text-to-image generation. Project page: https://randdl.github.io/viewtoken_control/

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 21 Apr 2026.

Builds on

45 of 55 references.

References · 45

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2024Qwen2 Technical Reportcited by 2,076
33 more
  1. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  5. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  6. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  7. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  8. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  9. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  10. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  11. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  12. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  13. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  14. 2024Autoregressive Image Generation without Vector Quantizationcited by 644
  15. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  16. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  17. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  18. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  19. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  20. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
  21. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  22. 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
  23. 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
  24. 2024MultiDiff: Consistent Novel View Synthesis from a Single Imagecited by 67
  25. 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
  26. 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 45
  27. 2024One Diffusion to Generate Them Allcited by 41
  28. 2025TexVerse: A Universe of 3D Objects with High-Resolution Texturescited by 41
  29. 2024SceneCraft: Layout-Guided 3D Scene Generationcited by 40
  30. 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
  31. 2025Compass Control: Multi Object Orientation Control for Text-to-Image Generationcited by 11
  32. 2023Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Modelscited by 7
  33. 2025LACONIC: A 3D Layout Adapter for Controllable Image Creationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.