SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation
Not on the map. Why?
Abstract (arXiv)
High-resolution 3D generation increasingly relies on voxel latents and multi-stage pipelines that first predict active structure and then synthesize local geometry. While effective, this design fragments continuous surfaces into many local tokens, inflates generation cost, and often weakens topological consistency for thin or highly connected shapes. We introduce SILSA, a topology-aware 3D generation framework that represents shapes with compact sliding-window slice latents. Instead of generating expensive voxel tokens, SILSA uses a fixed set of overlapping slices along the three canonical axes, where each token summarizes a local depth window to preserve cross-sectional continuity and support single-stage rectified-flow generation. A Slice VAE encodes oriented surface samples into multi-axis slice latents and reconstructs them with a sparse volumetric decoder, while a Volumetric Anchor Lattice coordinates directional slice streams through a shared 3D workspace. To preserve structural correctness, we introduce slice-level topology supervision that matches persistence diagrams and aligns Betti transitions across neighboring slices. Experiments show that SILSA improves structural fidelity while substantially reducing generation cost. SILSA improves PSNR by 8.7%, coverage by 5.96 absolute points, and Betti error by 9.2% over the strongest baseline, while using 70.0% fewer tokens than the next-most compact baseline and over 98% fewer tokens than sparse or hierarchical tokenizers, effectively reducing training memory by 40.4% and inference time by 58.5%. Qualitative results further show improved preservation of thin structures, repeated components, and long-range connectivity.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 79 of its 92 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
79 of 92 references.
References · 79
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
- 2022Flow Matching for Generative Modelingcited by 5,542
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,231
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,019
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,056
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,486
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,288
- 2018Demystifying MMD GANscited by 1,277
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,212
38 more
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2020Neural Sparse Voxel Fieldscited by 959
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 931
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 843
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 771
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 744
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 732
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 686
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 685
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 640
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 557
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 518
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 452
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 447
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 440
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 424
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 363
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 349
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 308
- 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 290
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2019Topology-Preserving Deep Image Segmentationcited by 198
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 185
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 164
- 2025Native and Compact Structured Latents for 3D Generationcited by 164
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 141
50 most cited of 79 All 79 (JSON)
Built on by
Not cited yet.