FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Scaling image-to-3D generation to ultra-high resolutions requires controlling rapidly growing computational costs without sacrificing fine geometric detail. We present Filigree3D, a sparse latent flow-matching framework that generates 3D geometry from a single image at voxel resolutions up to 20483, with straightforward extensibility to 40963. To make training tractable, we introduce Structure-Aware Sparse Scaling, which combines spatial bounding with alternating local-global attention to constrain token growth while preserving both fine-scale details and long-range structural context. To enhance detail reconstruction, we curate training samples based on their high-resolution geometric gains and inject multi-scale image features into a sparse 3D DiT, effectively coupling structural semantics with fine-grained visual cues. Furthermore, a visibility-aware voxel regularization strategy improves robustness against sparse perturbations and facilitates the completion of unobserved geometry. Under our default configuration, Filigree3D maintains peak GPU memory consumption within practical limits for contemporary hardware, enabling the generation of highly intricate 3D geometry in approximately one minute. Extensive experiments demonstrate that our method yields substantial improvements in overall geometric fidelity and fine-detail preservation compared to existing baselines, validating practical, detail-preserving 3D generation at unprecedented resolutions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 46 of its 51 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
46 of 51 references.
Closest ancestors · 16
Same direction, newest first
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling20 May
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets12 May
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models10 Feb
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders23 Dec
- 20243D Shape Tokenization via Latent Flow Matching20 Dec
- 2024GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation12 Nov
- 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generation27 Aug
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
4 more
Other references · 30
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 2021Deep ViT Features as Dense Visual Descriptorscited by 330
18 more
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 202
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 99
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2018Learning Shape Priors for Single-View 3D Completion and Reconstructioncited by 68
- 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 44
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
- 2026Pixal3D: Pixel-Aligned 3D Generation from Imagescited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation
- 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation
- 2026MeshCarve: Artisan Mesh Generation with Flow Matching in Compact Latent Spaces
- 2025Bolt3D: Generating 3D Scenes in Seconds
- 2026Seen2Scene: Completing Realistic 3D Scenes with Visibility-Guided Flow
- 2026Meshy T2: Fast Native Mesh Generation with Flow Matching
- 2026Channel Match: Calibrating Shape Latents for Few-Step 3D Generation