Annotation-Free Furniture Codes: What They Encode, and How Far They Transfer
Not on the map. Why?
Abstract (arXiv)
Layout-based 3D scene synthesizers place each object using two human-annotated channels: a categorical class label and a canonical-pose convention. We ask whether a single self-supervised token derived from object geometry can replace both, and study such tokens directly as a representation, decoupled from any synthesizer. A Finite Scalar Quantization (FSQ) point-cloud autoencoder is chamfer-trained on placed 3D-FUTURE furniture with no labels or pose annotations. Diagnostic probes recover fine-category (62.6 +/- 0.5%), super-category (85.6 +/- 1.3%), and yaw (52.7 +/- 0.5 deg) from the codes alone. Swapping the chamfer target from the rotated to the un-rotated point cloud collapses the yaw signal while raising class recovery, showing the codes' rotation content can be set by the training objective. Scaling across asset libraries needs codes that transfer; on an unseen dataset (ShapeNet), alignment is category-dependent: box-like furniture transfers, organically-shaped furniture does not, and a target-blind augmentation partly closes the gap.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 27 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
25 of 27 references.
References · 25
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017Neural Discrete Representation Learningcited by 4,650
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2020Jukebox: A Generative Model for Musiccited by 535
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
13 more
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 166
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
- 2020Robust Training of Vector Quantized Bottleneck Modelscited by 53
- 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapescited by 31
- 2022MetaSets: Meta-Learning on Point Sets for Generalizable Representationscited by 22
Built on by
Not cited yet.