mlsanityData to 7 Oct 2026

Learning Disentangled Representations for Perceptual Point Cloud Quality Assessment via Mutual Information Minimization

arXiv 2411.07936 ↗First posted 12 Nov 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

No-Reference Point Cloud Quality Assessment (NR-PCQA) aims to objectively assess the human perceptual quality of point clouds without relying on pristine-quality point clouds for reference. It is becoming increasingly significant with the rapid advancement of immersive media applications such as virtual reality (VR) and augmented reality (AR). However, current NR-PCQA models attempt to indiscriminately learn point cloud content and distortion representations within a single network, overlooking their distinct contributions to quality information. To address this issue, we propose DisPA, a novel disentangled representation learning framework for NR-PCQA. The framework trains a dual-branch disentanglement network to minimize mutual information (MI) between representations of point cloud content and distortion. Specifically, to fully disentangle representations, the two branches adopt different philosophies: the content-aware encoder is pretrained by a masked auto-encoding strategy, which can allow the encoder to capture semantic information from rendered images of distorted point clouds; the distortion-aware encoder takes a mini-patch map as input, which forces the encoder to focus on low-level distortion patterns. Furthermore, we utilize an MI estimator to estimate the tight upper bound of the actual MI and further minimize it to achieve explicit representation disentanglement. Extensive experimental results demonstrate that DisPA outperforms state-of-the-art methods on multiple PCQA datasets.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 55 references that are in the map. First posted on arXiv 12 Nov 2024.

Builds on

34 of 55 references.

References · 34

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  6. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  7. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
  8. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  9. 2018MINE: Mutual Information Neural Estimationcited by 680
  10. 2018Disentangling by Factorisingcited by 614
  11. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
  12. 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 233
22 more
  1. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  2. 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
  3. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  4. 2021Image Quality Assessment using Contrastive Learningcited by 95
  5. 2020Inferring Point Cloud Quality via Graph Similaritycited by 57
  6. 2020Point Cloud Quality Assessment: Dataset Construction and Learning-based No-Reference Metriccited by 51
  7. 2021No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Modelscited by 49
  8. 2021Perceptual Quality Assessment of Colored 3D Point Cloudscited by 49
  9. 2022DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessmentcited by 41
  10. 2022MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessmentcited by 38
  11. 2021No-Reference Point Cloud Quality Assessment via Domain Adaptationcited by 37
  12. 2021Learning Bias-Invariant Representation by Cross-Sample Mutual Information Minimizationcited by 32
  13. 2023Conditional Mutual Information for Disentangled Representations in Reinforcement Learningcited by 27
  14. 2022Evaluating Point Cloud from Moving Camera Videos: A No-Reference Metriccited by 22
  15. 2022GPA-Net:No-Reference Point Cloud Quality Assessment with Multi-task Graph Convolutional Networkcited by 22
  16. 2023GMS-3DQA: Projection-based Grid Mini-patch Sampling for 3D Model Quality Assessmentcited by 20
  17. 2023Ada-DQA: Adaptive Diverse Quality-aware Feature Acquisition for Video Quality Assessmentcited by 20
  18. 2023Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessmentcited by 17
  19. 2024Contrastive Pre-Training with Multi-View Fusion for No-Reference Point Cloud Quality Assessmentcited by 14
  20. 2022PCQA-GRAPHPOINT: Efficients Deep-Based Graph Metric For Point Cloud Quality Assessmentcited by 8
  21. 2024QPT V2: Masked Image Modeling Advances Visual Scoringcited by 8
  22. 2024PAME: Self-Supervised Masked Autoencoder for No-Reference Point Cloud Quality Assessmentcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.