mlsanityData to 7 Oct 2026

Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform

arXiv 2512.08478 ↗First posted 9 Dec 2025cs.CV cs.AI cs.GRcited by 1

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Neural rendering, particularly 3D Gaussian Splatting (3DGS), has evolved rapidly and become a key component for building world models. However, existing viewer solutions remain fragmented, heavy, or constrained by legacy pipelines, resulting in high deployment friction and limited support for dynamic content and generative models. In this work, we present Visionary, an open, web-native platform for real-time various Gaussian Splatting and meshes rendering. Built on an efficient WebGPU renderer with per-frame ONNX inference, Visionary enables dynamic neural processing while maintaining a lightweight, "click-to-run" browser experience. It introduces a standardized Gaussian Generator contract, which not only supports standard 3DGS rendering but also allows plug-and-play algorithms to generate or update Gaussians each frame. Such inference also enables us to apply feedforward generative post-processing. The platform further offers a plug in three.js library with a concise TypeScript API for seamless integration into existing web applications. Experiments show that, under identical 3DGS assets, Visionary achieves superior rendering efficiency compared to current Web viewers due to GPU-based primitive sorting. It already supports multiple variants, including MLP-based 3DGS, 4DGS, neural avatars, and style transformation or enhancement networks. By unifying inference and rendering directly in the browser, Visionary significantly lowers the barrier to reproduction, comparison, and deployment of 3DGS-family methods, serving as a unified World Model Carrier for both reconstructive and generative paradigms.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 94 of its 101 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

94 of 101 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Video World Models with Long-term Spatial Memory5 Jun
  2. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  3. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
  4. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 90

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  8. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  9. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  10. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  12. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
38 more
  1. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  2. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  3. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  4. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  5. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  6. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  7. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  8. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  9. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  10. 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 504
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  13. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
  14. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  15. 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
  16. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  17. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  18. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
  19. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  20. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  21. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
  22. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  23. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  24. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
  25. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
  26. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  27. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  28. 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
  29. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  30. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  31. 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 190
  32. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
  33. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
  34. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  35. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
  36. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  37. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
  38. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160

50 most cited of 90 All 90 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025MoE-GS: Mixture of Experts for Dynamic Gaussian Splatting
  2. 2025DirectTriGS: Triplane-based Gaussian Splatting Field Representation for 3D Generation
  3. 2026Nix and Fix: Targeting 1000x Compression of 3D Gaussian Splatting with Diffusion Models
  4. 2026LightBridge: Feed-Forward Generative Relighting for 3D Gaussian Splatting
  5. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
  6. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis
  7. 2024DiffGS: Functional Gaussian Splatting Diffusion
  8. 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Training