mlsanityData to 14 Oct 2026

3DProxyImg: Controllable 3D-Aware Animation Synthesis from Single Image via 2D-3D Aligned Proxy Embedding

arXiv 2512.15126 ↗First posted 17 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D animation is central to modern visual media, yet traditional production pipelines remain labor-intensive, expertise-demanding, and computationally expensive. Recent AIGC-based approaches partially automate asset creation and rigging, but they either inherit the heavy costs of full 3D pipelines or rely on video-synthesis paradigms that sacrifice 3D controllability and interactivity. We focus on single-image 3D animation generation and argue that progress is fundamentally constrained by a trade-off between rendering quality and 3D control. To address this limitation, we propose a lightweight 3D animation framework that decouples geometric control from appearance synthesis. The core idea is a 2D-3D aligned proxy representation that uses a coarse 3D estimate as a structural carrier, while delegating high-fidelity appearance and view synthesis to learned image-space generative priors. This proxy formulation enables 3D-aware motion control and interaction comparable to classical pipelines, without requiring accurate geometry or expensive optimization, and naturally extends to coherent background animation. Extensive experiments demonstrate that our method achieves efficient animation generation on low-power platforms and outperforms video-based 3D animation generation in identity preservation, geometric and textural consistency, and the level of precise, interactive control it offers to users.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 17 Dec 2025.

Builds on

31 of 40 references.

References · 31

  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  6. 2017Deep Image Priorcited by 1,098
  7. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  9. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  10. 2020First Order Motion Model for Image Animationcited by 704
  11. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  12. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
19 more
  1. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  2. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
  3. 2020Local Implicit Grid Representations for 3D Scenescited by 373
  4. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  5. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  6. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  7. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  8. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
  9. 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
  10. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  11. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 89
  12. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
  13. 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 63
  14. 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
  15. 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
  16. 2025Puppeteer: Rig and Animate Your 3D Modelscited by 43
  17. 2022NeRFInvertor: High Fidelity NeRF-GAN Inversion for Single-shot Real Image Animationcited by 23
  18. 2024AniClipart: Clipart Animation with Text-to-Video Priorscited by 17
  19. 2024Image Neural Field Diffusion Modelscited by 13

Built on by

Not cited yet.