Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesis
Not on the map. Why?
Abstract (arXiv)
Image generation today can produce somewhat realistic images from text prompts. However, if one asks the generator to synthesize a specific camera setting such as creating different fields of view using a 24mm lens versus a 70mm lens, the generator will not be able to interpret and generate scene-consistent images. This limitation not only hinders the adoption of generative tools in professional photography but also highlights the broader challenge of aligning data-driven models with real-world physical settings. In this paper, we introduce Generative Photography, a framework that allows controlling camera intrinsic settings during content generation. The core innovation of this work are the concepts of Dimensionality Lifting and Differential Camera Intrinsics Learning, enabling smooth and consistent transitions across different camera settings. Experimental results show that our method produces significantly more scene-consistent photorealistic images than state-of-the-art models such as Stable Diffusion 3 and FLUX. Our code and additional results are available at https://generative-photography.github.io/project.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 64 of its 79 references that are in the map. First posted on arXiv 3 Dec 2024.
Builds on
64 of 79 references.
References · 64
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
38 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2019An Introduction to Variational Autoencoderscited by 997
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Modelscited by 148
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
- 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
- 2024Training-free Camera Control for Video Generationcited by 119
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
- 2019Zoom To Learn, Learn To Zoomcited by 114
- 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
- 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Modelscited by 57
- 2024Tutorial on Diffusion Models for Imaging and Visioncited by 49
- 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
- 2019Synthetic Defocus and Look-Ahead Autofocus for Casual Videographycited by 28
- 2024E.T. the Exceptional Trajectories: Text-to-camera-trajectory generation with character awarenesscited by 24
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 12; 2026: 13.
26 papers.
Sort:
By area:
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 16
- 2025BokehDiff: Neural Lens Blur with One-Step Diffusioncited by 8
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
- 2025Generative Photographic Control for Scene-Consistent Video Cinematic Editingcited by 3
- 2025CameraMaster: Unified Camera Semantic-Parameter Control for Photography Retouchingcited by 3
- 2025Generative Refocusing: Flexible Defocus Control from a Single Imagecited by 3
- 2026Towards Intrinsic-Aware Monocular 3D Object Detectioncited by 2
14 more
- 2025Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion Modelcited by 1
- 2025Fine-grained Defocus Blur Control for Generative Image Modelscited by 1
- 2026CameraAnything: Refilming Videos with Arbitrary Camera Controlcited by 1
- 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generationcited by 0
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Renderingcited by 0
- 2026RawGen: Learning Camera Raw Image Generationcited by 0
- 2026Linear Image Generation by Synthesizing Exposure Bracketscited by 0
- 2026Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flowscited by 0
- 2026AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfercited by 0
- 2026ReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generationcited by 0
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World Statescited by 0
- 2026LensStyle: Learning the Optical Aesthetics for Controllable Stylized Lens Effect Renderingcited by 0
- 2026Measured Sliders: Learning Continuous Controls from Differentiable Image Measurementscited by 0
- 2026The Camera Inside the Editor: Reading the Implicit Camera of Image Editors with Painted Calibration Patternscited by 0
- 2026The Camera Inside the Editor: Reading the Implicit Camera of Image Editors with Painted Calibration Patterns29 Sep 2026
- 2026Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements4 Sep 2026
- 2026LensStyle: Learning the Optical Aesthetics for Controllable Stylized Lens Effect Rendering4 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026ReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generation19 Aug 2026
- 2026CameraAnything: Refilming Videos with Arbitrary Camera Control27 Jul 2026
- 2026AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfer30 Jun 2026
- 2026Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flows5 Jun 2026
- 2026Linear Image Generation by Synthesizing Exposure Brackets22 Apr 2026
- 2026Lyra 2.0: Explorable Generative 3D Worlds14 Apr 2026
- 2026RawGen: Learning Camera Raw Image Generation31 Mar 2026
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
14 more
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models12 Jan 2026
- 2025Generative Refocusing: Flexible Defocus Control from a Single Image18 Dec 2025
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Rendering13 Dec 2025
- 2025CameraMaster: Unified Camera Semantic-Parameter Control for Photography Retouching26 Nov 2025
- 2025Generative Photographic Control for Scene-Consistent Video Cinematic Editing17 Nov 2025
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generation9 Oct 2025
- 2025Fine-grained Defocus Blur Control for Generative Image Models7 Oct 2025
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamics25 Sep 2025
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation23 Sep 2025
- 2025BokehDiff: Neural Lens Blur with One-Step Diffusion24 Jul 2025
- 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generation11 Jul 2025
- 2025Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion Model27 May 2025
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Models26 May 2025
- 2024Wonderland: Navigating 3D Scenes from a Single Image16 Dec 2024
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2025BokehDiff: Neural Lens Blur with One-Step Diffusioncited by 8
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
- 2025CameraMaster: Unified Camera Semantic-Parameter Control for Photography Retouchingcited by 3
- 2025Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion Modelcited by 1
- 2025Fine-grained Defocus Blur Control for Generative Image Modelscited by 1
- 2026RawGen: Learning Camera Raw Image Generationcited by 0
- 2026Linear Image Generation by Synthesizing Exposure Bracketscited by 0
- 2026Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flowscited by 0
- 2026Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flows5 Jun 2026
- 2026Linear Image Generation by Synthesizing Exposure Brackets22 Apr 2026
- 2026RawGen: Learning Camera Raw Image Generation31 Mar 2026
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models12 Jan 2026
- 2025CameraMaster: Unified Camera Semantic-Parameter Control for Photography Retouching26 Nov 2025
- 2025Fine-grained Defocus Blur Control for Generative Image Models7 Oct 2025
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation23 Sep 2025
- 2025BokehDiff: Neural Lens Blur with One-Step Diffusion24 Jul 2025
- 2025Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion Model27 May 2025
- 2024Wonderland: Navigating 3D Scenes from a Single Image16 Dec 2024
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 16
- 2025Generative Photographic Control for Scene-Consistent Video Cinematic Editingcited by 3
- 2025Generative Refocusing: Flexible Defocus Control from a Single Imagecited by 3
- 2026Towards Intrinsic-Aware Monocular 3D Object Detectioncited by 2
- 2026CameraAnything: Refilming Videos with Arbitrary Camera Controlcited by 1
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Renderingcited by 0
- 2026AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfercited by 0
- 2026ReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generationcited by 0
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World Statescited by 0
12 most cited of 15 All 15 (JSON)
- 2026The Camera Inside the Editor: Reading the Implicit Camera of Image Editors with Painted Calibration Patterns29 Sep 2026
- 2026Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements4 Sep 2026
- 2026LensStyle: Learning the Optical Aesthetics for Controllable Stylized Lens Effect Rendering4 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026ReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generation19 Aug 2026
- 2026CameraAnything: Refilming Videos with Arbitrary Camera Control27 Jul 2026
- 2026AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfer30 Jun 2026
- 2026Lyra 2.0: Explorable Generative 3D Worlds14 Apr 2026
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
- 2025Generative Refocusing: Flexible Defocus Control from a Single Image18 Dec 2025
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Rendering13 Dec 2025
- 2025Generative Photographic Control for Scene-Consistent Video Cinematic Editing17 Nov 2025
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Setting the Stage: Text-Driven Scene-Consistent Image Generation
- 2025Generative AI for Vision: A Comprehensive Study of Frameworks and Applications
- 2024PaintScene4D: Consistent 4D Scene Generation from Text Prompts
- 20243D-SceneDreamer: Text-Driven 3D-Consistent Scene Generation
- 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
- 2025RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewards
- 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models
- 2025Towards Spatially Consistent Image Generation: On Incorporating Intrinsic Scene Properties into Diffusion Models