Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Neural rendering, particularly 3D Gaussian Splatting (3DGS), has evolved rapidly and become a key component for building world models. However, existing viewer solutions remain fragmented, heavy, or constrained by legacy pipelines, resulting in high deployment friction and limited support for dynamic content and generative models. In this work, we present Visionary, an open, web-native platform for real-time various Gaussian Splatting and meshes rendering. Built on an efficient WebGPU renderer with per-frame ONNX inference, Visionary enables dynamic neural processing while maintaining a lightweight, "click-to-run" browser experience. It introduces a standardized Gaussian Generator contract, which not only supports standard 3DGS rendering but also allows plug-and-play algorithms to generate or update Gaussians each frame. Such inference also enables us to apply feedforward generative post-processing. The platform further offers a plug in three.js library with a concise TypeScript API for seamless integration into existing web applications. Experiments show that, under identical 3DGS assets, Visionary achieves superior rendering efficiency compared to current Web viewers due to GPU-based primitive sorting. It already supports multiple variants, including MLP-based 3DGS, 4DGS, neural avatars, and style transformation or enhancement networks. By unifying inference and rendering directly in the browser, Visionary significantly lowers the barrier to reproduction, comparison, and deployment of 3DGS-family methods, serving as a unified World Model Carrier for both reconstructive and generative paradigms.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 94 of its 101 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
94 of 101 references.
Closest ancestors · 4
Same direction, newest first
- 2025Video World Models with Long-term Spatial Memory5 Jun
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 90
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
38 more
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 504
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 190
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
50 most cited of 90 All 90 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025MoE-GS: Mixture of Experts for Dynamic Gaussian Splatting
- 2025DirectTriGS: Triplane-based Gaussian Splatting Field Representation for 3D Generation
- 2026Nix and Fix: Targeting 1000x Compression of 3D Gaussian Splatting with Diffusion Models
- 2026LightBridge: Feed-Forward Generative Relighting for 3D Gaussian Splatting
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis
- 2024DiffGS: Functional Gaussian Splatting Diffusion
- 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Training