mlsanityData to 7 Oct 2026

Robust Mesh Saliency Ground Truth Acquisition in VR via View Cone Sampling and Manifold Diffusion

arXiv 2601.02721 ↗First posted 6 Jan 2026cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

As the complexity of 3D digital content grows exponentially, understanding human visual attention is critical for optimizing rendering and processing resources. Therefore, reliable 3D mesh saliency ground truth (GT) is essential for human-centric visual modeling in virtual reality (VR). However, existing VR eye-tracking frameworks are fundamentally bottlenecked by their underlying acquisition and generation mechanisms. The reliance on zero-area single ray sampling (SRS) fails to capture contextual features, leading to severe texture aliasing and discontinuous saliency signals. And the conventional application of Euclidean smoothing propagates saliency across disconnected physical gaps, resulting in semantic confusion on complex 3D manifolds. This paper proposes a robust framework to address these limitations. We first introduce a view cone sampling (VCS) strategy, which simulates the human foveal receptive field via Gaussian-distributed ray bundles to improve sampling robustness for complex topologies. Furthermore, a hybrid Manifold-Euclidean constrained diffusion (HCD) algorithm is developed, fusing manifold geodesic constraints with Euclidean scales to ensure topologically-consistent saliency propagation. We demonstrate the improvement in performance over baseline methods and the benefits for downstream tasks through subjective experiments and qualitative and quantitative methods. By mitigating "topological short-circuits" and aliasing, our framework provides a high-fidelity 3D attention acquisition paradigm that aligns with natural human perception, offering a more accurate and robust baseline for 3D mesh saliency research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 53 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

9 of 53 references.

References · 9

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  3. 2018MeshNet: Mesh Neural Network for 3D Shape Representationcited by 95
  4. 2022Confusing Image Quality Assessment: Towards Better Augmented Reality Experiencecited by 32
  5. 2025MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restorationcited by 12
  6. 2023Robust 3D Tracking with Quality-Aware Shape Completioncited by 7
  7. 2024How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Modelcited by 4
  8. 2024Textured Mesh Saliency: Bridging Geometry and Texture for Human Perception in 3D Graphicscited by 4
  9. 2025Quality Assessment and Distortion-aware Saliency Prediction for AI-Generated Omnidirectional Imagescited by 2

Built on by

Not cited yet.