Gaussian-JEPA: Joint-Embedding Predictive Learning for 3D Gaussian Splats
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) represents 3D content with anisotropic primitives that jointly encode geometry and appearance. Fixed-budget encoders consume sampled observations of Gaussian assets, so the same object may be observed through different primitive realizations. Existing self-supervised methods mainly reconstruct masked Gaussian attributes, tying supervision to one sampled realization and requiring an input-space decoder. Latent prediction offers an alternative, but its application to Gaussian tokens requires targets that accommodate coupled attributes and heterogeneous spatial support. We introduce Gaussian-JEPA, which predicts representations of held-out Gaussian token blocks from visible context. An online encoder processes the context, while a shared exponential-moving-average encoder supplies stop-gradient features for multi-scale targets. Complementary target projections and feature-space grounding provide latent supervision without reconstructing Gaussian attributes. We evaluate the features under Gaussian resampling, partial observations, and renderable shape completion, together with transfer to part segmentation and object classification. Compared with matched reconstruction pretraining, Gaussian-JEPA is more consistent across resampled inputs, retains more instance information under partial observations, and provides stronger frozen features for Gaussian completion. These results support latent prediction as an effective objective for reusable 3D Gaussian representations. Code is on the project page (https://amazingren.github.io/Gaussian-JEPA/).
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 16 Aug 2026.
Builds on
20 of 28 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
8 more
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 164
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 52
- 2026VISReg: Variance-Invariance-Sketching Regularization for JEPA trainingcited by 16
- 2025LongSplat: Online Generalizable 3D Gaussian Splatting from Long Sequence Imagescited by 13
- 2025Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encodingcited by 10
- 2025CrossJEPA: Cross-Modal Joint-Embedding Predictive Architecture for Efficient 3D Representation Learning from 2D Imagescited by 4
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-trainingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.