TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
Sparse-view 3D reconstruction is increasingly addressed with feed-forward splatting networks that predict explicit primitives directly from images. Yet most existing methods remain centered on Gaussian primitives and expose surfaces only indirectly: extracting a usable mesh for downstream simulation, physics reasoning, or embodied interaction still requires expensive post-hoc steps that break the feed-forward promise. This limitation is especially pronounced in pose-free settings, where scene structure and camera parameters must be estimated jointly from sparse observations. We present TriSplat, a feed-forward reconstruction network that represents scenes with oriented triangle primitives and directly exports simulation-ready mesh scenes from a single forward pass. Given input images, the network predicts local 3D point maps, triangle attributes, camera poses, and optional intrinsics. Rather than regressing triangle orientation as an unconstrained latent variable, our approach constructs geometry normals from the predicted point maps, refines them with an image-conditioned normal head, and converts them into stable local frames for triangle parameterization. A mono-normal bootstrap schedule further stabilizes early training, while opacity and blur scheduling progressively sharpens the learned surface representation for direct mesh extraction. Experiments on RealEstate10K and DL3DV show that this representation produces more geometry-faithful reconstructions than Gaussian feed-forward baselines while maintaining competitive novel-view rendering quality. Because the rendering primitives are themselves surface triangles, the output can be directly ingested by physics engines, collision detectors, and standard rendering pipelines without any conversion, making it a practical simulation-ready solution for feed-forward 3D scene reconstruction.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 73 of its 80 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
73 of 80 references.
References · 73
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
38 more
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 232
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
- 2024FreGS: 3D Gaussian Splatting with Progressive Frequency Regularizationcited by 103
- 2020An Analysis of SVD for Deep Rotation Estimationcited by 85
- 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 78
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 71
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
- 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
- 2024SplatSim: Zero-Shot Sim2Real Transfer of RGB Manipulation Policies Using Gaussian Splattingcited by 63
- 2024BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splattingcited by 61
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
- 2024HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View Reconstructioncited by 55
- 2025Triangle Splatting for Real-Time Radiance Field Renderingcited by 50
- 2024BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modelingcited by 42
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Latent Spatial Memory for Video World Modelscited by 7
- 2026Latent Spatial Memory for Video World Models8 Jun 2026