mlsanityData to 14 Oct 2026

Twist and Compute: The Cost of Pose in 3D Generative Diffusion

arXiv 2511.08203 ↗First posted 11 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite their impressive results, large-scale image-to-3D generative models remain opaque in their inductive biases. We identify a significant limitation in image-conditioned 3D generative models: a strong canonical view bias. Through controlled experiments using simple 2D rotations, we show that the state-of-the-art Hunyuan3D 2.0 model can struggle to generalize across viewpoints, with performance degrading under rotated inputs. We show that this failure can be mitigated by a lightweight CNN that detects and corrects input orientation, restoring model performance without modifying the generative backbone. Our findings raise an important open question: Is scale enough, or should we pursue modular, symmetry-aware designs?

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 14 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

12 of 14 references.

References · 12

  1. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  3. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  4. 2016Group Equivariant Convolutional Networkscited by 1,165
  5. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  6. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
  7. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
  8. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  9. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  10. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  11. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  12. 2025Orientation Matters: Making 3D Generative Models Orientation-Alignedcited by 13

Built on by

Not cited yet.