mlsanityData to 14 Oct 2026

Contrastive Pre-Training with Multi-View Fusion for No-Reference Point Cloud Quality Assessment

arXiv 2403.10066 ↗First posted 15 Mar 2024cs.CV cs.MMcited by 14

Not on the map. Why?

Abstract (arXiv)

No-reference point cloud quality assessment (NR-PCQA) aims to automatically evaluate the perceptual quality of distorted point clouds without available reference, which have achieved tremendous improvements due to the utilization of deep neural networks. However, learning-based NR-PCQA methods suffer from the scarcity of labeled data and usually perform suboptimally in terms of generalization. To solve the problem, we propose a novel contrastive pre-training framework tailored for PCQA (CoPA), which enables the pre-trained model to learn quality-aware representations from unlabeled data. To obtain anchors in the representation space, we project point clouds with different distortions into images and randomly mix their local patches to form mixed images with multiple distortions. Utilizing the generated anchors, we constrain the pre-training process via a quality-aware contrastive loss following the philosophy that perceptual quality is closely related to both content and distortion. Furthermore, in the model fine-tuning stage, we propose a semantic-guided multi-view fusion module to effectively integrate the features of projected images from multiple perspectives. Extensive experiments show that our method outperforms the state-of-the-art PCQA methods on popular benchmarks. Further investigations demonstrate that CoPA can also benefit existing learning-based PCQA models.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 15 Mar 2024.

Builds on

25 of 44 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  8. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  9. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  10. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
  11. 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
  12. 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
13 more
  1. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  2. 2020Inferring Point Cloud Quality via Graph Similaritycited by 58
  3. 2020Point Cloud Quality Assessment: Dataset Construction and Learning-based No-Reference Metriccited by 53
  4. 2021No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Modelscited by 50
  5. 2021Perceptual Quality Assessment of Colored 3D Point Cloudscited by 49
  6. 2022MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessmentcited by 39
  7. 2021No-Reference Point Cloud Quality Assessment via Domain Adaptationcited by 38
  8. 2021MPED: Quantifying Point Cloud Distortion based on Multiscale Potential Energy Discrepancycited by 28
  9. 2022FedFM: Anchor-based Feature Matching for Data Heterogeneity in Federated Learningcited by 27
  10. 2022A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequencescited by 24
  11. 2022GPA-Net:No-Reference Point Cloud Quality Assessment with Multi-task Graph Convolutional Networkcited by 22
  12. 2022PCQA-GRAPHPOINT: Efficients Deep-Based Graph Metric For Point Cloud Quality Assessmentcited by 8
  13. 2022Blind Quality Assessment of 3D Dense Point Clouds with Structure Guided Resamplingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 7; 2026: 2.

14 papers.

Sort:

By area: