Efficient Dense Matching for Enhanced Gaussian Splatting Using AV1 Motion Vectors
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has emerged as a prominent framework for real-time, photorealistic scene reconstruction, offering significant speed-ups over Neural Radiance Fields (NeRF). However, the fidelity of 3DGS representations remains heavily dependent on the quality of the initial point cloud. While standard Structure-from-Motion (SfM) pipelines using COLMAP provide adequate initialisation, they often suffer from high computational costs and sparsity in textureless regions, which degrades subsequent reconstruction accuracy and convergence speed. In this work, we introduce an AV1-based feature detection and matching pipeline that significantly reduces SfM processing overhead. By leveraging motion vectors inherent to the AV1 video codec, we bypass computationally expensive exhaustive matching while maintaining geometric robustness. Our pipeline produces substantially denser point clouds, with up to eight times as many points as classical SfM. We demonstrate that this enhanced initialisation directly improves 3DGS performance, yielding an 9-point increase in VMAF and a 63% average reduction in training time required to reach baseline quality. The project page: https://sigmedia.tv/AV1-3DGS.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
13 of 24 references.
References · 13
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2020DISK: Learning local features with policy gradientcited by 312
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2020A Technical Overview of AV1cited by 47
- 2025AV1 Motion Vector Fidelity and Application for Efficient Optical Flowcited by 2
1 more
Built on by
Not cited yet.