SpatialQ: Understanding 3D Gaussian Splatting Scene Quality via Visual-based MLLM
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has emerged as an effective representation for novel view synthesis and 3D scene reconstruction, creating an increasing demand for reliable quality assessment. Unlike conventional image quality assessment (IQA), the quality of a 3DGS scene depends not only on the perceptual fidelity of rendered views, but also on scene-level factors such as spatial structure and cross-view consistency. Existing IQA methods are limited by their reliance on 2D perceptual cues, whereas general multimodal large language models (MLLMs) are not designed for stable quality regression and may produce unreliable judgments. To address these limitations, a multimodal quality assessment framework is developed for 3DGS scene understanding. First, a 3D-aware quality representation learning framework is introduced by augmenting a VGGT-based encoder with a dedicated quality head. Multi-view images are encoded into view-specific features and aggregated to capture cross-view consistency, while geometric cues are incorporated through joint modeling of depth and point-cloud-related structural information, enabling the learning of structure-aware quality representations beyond appearance-driven features. Second, a grounded multimodal reasoning mechanism is constructed by jointly feeding original images, depth maps, point cloud renderings, and camera parameters into a Qwen-based MLLM.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
30 of 46 references.
References · 30
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
18 more
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 127
- 2024Fast Feedforward 3D Gaussian Splatting Compressioncited by 49
- 2022MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessmentcited by 38
- 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
- 2024Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fieldscited by 22
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessmentcited by 18
- 2024A Benchmark for Gaussian Splatting Compression and Quality Assessment Studycited by 16
- 2024Explicit-NeRF-QA: A Quality Assessment Database for Explicit NeRF Model Compressioncited by 8
- 20253DGS-IEval-15K: A Large-scale Image Quality Evaluation Database for 3D Gaussian-Splattingcited by 6
- 2023NeRF-QA: Neural Radiance Fields Quality Assessment Databasecited by 5
- 2024Stochasticity-aware No-Reference Point Cloud Quality Assessmentcited by 3
- 2025Perceptual Quality Assessment of 3D Gaussian Splatting: A Subjective Dataset and Prediction Metriccited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20263DGSI-Assessor: A Large-Scale Dataset and An LMM-based Method for 3D Gaussian Splatting Image Quality Assessment
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
- 2026PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
- 2025ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Views
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
- 2025Visibility-Uncertainty-guided 3D Gaussian Inpainting via Scene Conceptional Learning