Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings
Not on the map. Why?
Abstract (arXiv)
Artists coordinate human pose, illumination, and camera placement to convey narrative and emotion, but existing generative methods typically model these elements independently. We introduce text-to-editable 3D staging, a task that jointly generates human poses, a dominant light, and a camera configuration from an affective description. We construct 11,911 text--staging pairs from 2,328 figurative paintings by reconstructing SMPL bodies, estimating low-frequency illumination, recovering camera parameters, and pairing each scene with ArtEmis descriptions. We train a flow-matching transformer that supports variable numbers of figures and produces multiple staging alternatives for each prompt. On held-out descriptions, the model achieves 32.2% retrieval R@1, compared with 16.6% for CLIP-based nearest-neighbor retrieval, while approximately preserving corpus-level diversity. These results demonstrate the feasibility of generating editable, emotionally conditioned 3D staging references from text.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 11 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
9 of 11 references.
References · 9
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2021ArtEmis: Affective Language for Visual Artcited by 104
- 2023ChatPose: Chatting about 3D Human Posecited by 72
- 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 57
- 2024E.T. the Exceptional Trajectories: Text-to-camera-trajectory generation with character awarenesscited by 25
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Setting the Stage: Text-Driven Scene-Consistent Image Generation
- 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Models
- 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art
- 2026Beyond Starry Night: Shortcut-Aware Control-State Planning for Artist-Grounded Text to Image Generation
- 2025EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generation
- 2023DreamStyler: Paint by Style Inversion with Text-to-Image Diffusion Models
- 2024Text2Relight: Creative Portrait Relighting with Text Guidance
- 2024From Text to Pose to Image: Improving Diffusion Model Control and Quality