mlsanityData to 13 Oct 2026

SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation

arXiv 2610.02201 ↗First posted 1 Oct 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

High-resolution 3D generation increasingly relies on voxel latents and multi-stage pipelines that first predict active structure and then synthesize local geometry. While effective, this design fragments continuous surfaces into many local tokens, inflates generation cost, and often weakens topological consistency for thin or highly connected shapes. We introduce SILSA, a topology-aware 3D generation framework that represents shapes with compact sliding-window slice latents. Instead of generating expensive voxel tokens, SILSA uses a fixed set of overlapping slices along the three canonical axes, where each token summarizes a local depth window to preserve cross-sectional continuity and support single-stage rectified-flow generation. A Slice VAE encodes oriented surface samples into multi-axis slice latents and reconstructs them with a sparse volumetric decoder, while a Volumetric Anchor Lattice coordinates directional slice streams through a shared 3D workspace. To preserve structural correctness, we introduce slice-level topology supervision that matches persistence diagrams and aligns Betti transitions across neighboring slices. Experiments show that SILSA improves structural fidelity while substantially reducing generation cost. SILSA improves PSNR by 8.7%, coverage by 5.96 absolute points, and Betti error by 9.2% over the strongest baseline, while using 70.0% fewer tokens than the next-most compact baseline and over 98% fewer tokens than sparse or hierarchical tokenizers, effectively reducing training memory by 40.4% and inference time by 58.5%. Qualitative results further show improved preservation of thin structures, repeated components, and long-range connectivity.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 79 of its 92 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

79 of 92 references.

References · 79

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
  3. 2022Flow Matching for Generative Modelingcited by 5,542
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,231
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,019
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
  7. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,056
  8. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
  9. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,486
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,288
  11. 2018Demystifying MMD GANscited by 1,277
  12. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,212
38 more
  1. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  2. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  3. 2020Neural Sparse Voxel Fieldscited by 959
  4. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 931
  5. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 843
  6. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 771
  7. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 753
  8. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 744
  9. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 732
  10. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 686
  11. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 685
  12. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 640
  13. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  14. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 557
  15. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 518
  16. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 452
  17. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 447
  18. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 440
  19. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 424
  20. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  21. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 363
  22. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 349
  23. 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
  24. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  25. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 308
  26. 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 290
  27. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  28. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  29. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  30. 2019Topology-Preserving Deep Image Segmentationcited by 198
  31. 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
  32. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 185
  33. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
  34. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
  35. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 164
  36. 2025Native and Compact Structured Latents for 3D Generationcited by 164
  37. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
  38. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 141

50 most cited of 79 All 79 (JSON)

Built on by

Not cited yet.