mlsanityData to 14 Oct 2026

Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure

arXiv 2605.10438 ↗First posted 11 May 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Current 3D tokenizers largely treat representation as spatial compression: compact codes reconstruct surface geometry, but leave component ownership and attachment validity implicit. In open-world assets with intersecting components, noisy topology, and weak canonical structure, this creates a representation mismatch: local shape, component identity, and assembly relations become entangled in a latent stream and are not natively addressable during decoding. We formulate an alternative view, interface-centric generative states, in which tokenization constructs an operational state rather than a passive compressed code. The state exposes local geometry, component ownership, and attachment validity as variables that can be queried, constrained, and repaired during decoding. We instantiate this formulation with Component-Conditioned Canonical Local Tokens (C2LT-3D), factorizing representation into canonical local geometry, partition-conditioned context, and relational seam variables. Each factor targets a distinct failure mode of compression-centric tokens: pose leakage, cross-component interference, or invalid local attachment. This exposed state supports attachment validation, latent structural repair, targeted intervention, and constrained serialization without a separate post-hoc structure recovery module. Trained on single-object CAD models and evaluated zero-shot on open-world multi-component assets, C2LT-3D improves structural robustness and shows that its latent variables remain actionable under adversarial attachment settings. These results suggest that open-world 3D generative representations should be evaluated not only by reconstruction fidelity, but by whether their discrete states remain operational for assembly-level structural reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 25 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

21 of 25 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  8. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  9. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
  10. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  11. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
  12. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
9 more
  1. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
  2. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
  3. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 104
  4. 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
  5. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 91
  6. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
  7. 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
  8. 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
  9. 2026LoST: Level of Semantics Tokenization for 3D Shapescited by 4

Built on by

Not cited yet.