Subjective Camera 1.0: Bridging Human Cognition and Visual Reconstruction through Sequence-Aware Sketch-Guided Diffusion
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We introduce the concept of a subjective camera to reconstruct meaningful moments that physical cameras fail to capture. We propose Subjective Camera 1.0, a framework for reconstructing real-world scenes from readily accessible subjective readouts, i.e., textual descriptions and progressively drawn rough sketches. Built on optimization-based alignment of diffusion models, our approach avoids large-scale paired training data and mitigates generalization issues. To address the challenge of integrating multiple abstract concepts in real-world scenarios, we design a Sequence-Aware Sketch-Guided Diffusion framework with three loss terms for concept-wise sequential optimization, following the natural order of subjective readouts. Experiments on two datasets demonstrate that our method achieves state-of-the-art performance in image quality as well as spatial and semantic alignment with target scenes. User studies with 40 participants further confirm that our approach is consistently preferred. Our project page is at: subjective-camera.github.io
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 26 of its 37 references that are in the map. First posted on arXiv 30 Jun 2025.
Builds on
26 of 37 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
14 more
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
- 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 119
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
- 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generationcited by 36
- 2024DyMO: Training-Free Diffusion Model Alignment with Dynamic Multi-Objective Schedulingcited by 27
- 2024Block and Detail: Scaffolding Sketch-to-Image Generationcited by 9
- 2024CoCoNO: Attention Contrast-and-Complete for Initial Noise Optimization in Text-to-Image Synthesiscited by 7
- 2024Sketch-Guided Scene Image Generationcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
- 2026CT-1: Vision-Language-Camera Models Transfer Spatial Reasoning Knowledge to Camera-Controllable Video Generation
- 2024Fixing the Perspective: A Critical Examination of Zero-1-to-3
- 2024Animate Your Motion: Turning Still Images into Dynamic Videos
- 2024It's All About Your Sketch: Democratising Sketch Control in Diffusion Models
- 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
- 2025From Pixels to Feelings: Aligning MLLMs with Human Cognitive Perception of Images