# The JPEG Pleno Learning-based Point Cloud Coding Standard: Serving Man and Machine

arXiv: https://arxiv.org/abs/2409.08130 · HTML: https://mlsanity.com/paper/2409.08130/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 66 references that are in the map.
- First posted on arXiv 12 Sep 2024.

## Builds on (most cited first, 22 of 22)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning](https://mlsanity.com/paper/1602.07261/) (2016)
- [3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation](https://mlsanity.com/paper/1606.06650/) (2016)
- [4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks](https://mlsanity.com/paper/1904.08755/) (2019)
- [Variational image compression with a scale hyperprior](https://mlsanity.com/paper/1802.01436/) (2018)
- [Joint Autoregressive and Hierarchical Priors for Learned Image Compression](https://mlsanity.com/paper/1809.02736/) (2018)
- [Variable Rate Image Compression with Recurrent Neural Networks](https://mlsanity.com/paper/1511.06085/) (2015)
- [Multiscale Point Cloud Geometry Compression](https://mlsanity.com/paper/2011.03799/) (2020)
- [Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compression](https://mlsanity.com/paper/2111.10633/) (2021)
- [Learned Point Cloud Geometry Compression](https://mlsanity.com/paper/1909.12037/) (2019)
- [Learning Convolutional Transforms for Lossy Point Cloud Geometry Compression](https://mlsanity.com/paper/1903.08548/) (2019)
- [Joint Global and Local Hierarchical Priors for Learned Image Compression](https://mlsanity.com/paper/2112.04487/) (2021)
- [Improved Deep Point Cloud Geometry Compression](https://mlsanity.com/paper/2006.09043/) (2020)
- [Sparse Tensor-based Point Cloud Attribute Compression](https://mlsanity.com/paper/2204.01023/) (2022)
- [Latent-space scalability for multi-task collaborative intelligence](https://mlsanity.com/paper/2105.10089/) (2021)
- [GRASP-Net: Geometric Residual Analysis and Synthesis for Point Cloud Compression](https://mlsanity.com/paper/2209.04401/) (2022)
- [Folding-based compression of point cloud attributes](https://mlsanity.com/paper/2002.04439/) (2020)
- [PIVOT-Net: Heterogeneous Point-Voxel-Tree-based Framework for Point Cloud Compression](https://mlsanity.com/paper/2402.07243/) (2024)
- [Quantized Decoder in Learned Image Compression for Deterministic Reconstruction](https://mlsanity.com/paper/2312.11209/) (2023)
- [Deep Learning-based Compressed Domain Multimedia for Man and Machine: A Taxonomy and Application to Point Cloud Classification](https://mlsanity.com/paper/2310.18849/) (2023)
- [Learned Point Cloud Compression for Classification](https://mlsanity.com/paper/2308.05959/) (2023)
- [Subjective performance evaluation of bitrate allocation strategies for MPEG and JPEG Pleno point cloud compression](https://mlsanity.com/paper/2402.04760/) (2024)

## Built on by (most cited first, 9 of 9)

- [Deep Learning-based Event Data Coding: A Joint Spatiotemporal and Polarity Solution](https://mlsanity.com/paper/2502.03285/) (2025)
- [AnyPcc: Compressing Any Point Cloud with a Single Universal Model](https://mlsanity.com/paper/2510.20331/) (2025)
- [UGAE: Unified Geometry and Attribute Enhancement for G-PCC Compressed Point Clouds](https://mlsanity.com/paper/2510.23009/) (2025)
- [DALD-PCAC: Density-Adaptive Learning Descriptor for Point Cloud Lossless Attribute Compression](https://mlsanity.com/paper/2601.12261/) (2026)
- [Overview and Comparison of AVS Point Cloud Compression Standard](https://mlsanity.com/paper/2602.08613/) (2026)
- [Point Cloud Geometry Scalable Coding Using a Resolution and Quality-conditioned Latents Probability Estimator](https://mlsanity.com/paper/2502.14099/) (2025)
- [SEDD-PCC: A Single Encoder-Dual Decoder Framework For End-To-End Learned Point Cloud Compression](https://mlsanity.com/paper/2505.16709/) (2025)
- [MEGA-PCC: A Mamba-based Efficient Approach for Joint Geometry and Attribute Point Cloud Compression](https://mlsanity.com/paper/2512.22463/) (2025)
- [TAFA-GSGC: Group-wise Scalable Point Cloud Geometry Compression with Progressive Residual Refinement](https://mlsanity.com/paper/2604.28045/) (2026)

## Abstract (arXiv)

Efficient point cloud coding has become increasingly critical for multiple applications such as virtual reality, autonomous driving, and digital twin systems, where rich and interactive 3D data representations may functionally make the difference. Deep learning has emerged as a powerful tool in this domain, offering advanced techniques for compressing point clouds more efficiently than conventional coding methods while also allowing effective computer vision tasks performed in the compressed domain thus, for the first time, making available a common compressed visual representation effective for both man and machine. Taking advantage of this potential, JPEG has recently finalized the JPEG Pleno Learning-based Point Cloud Coding (PCC) standard offering efficient lossy coding of static point clouds, targeting both human visualization and machine processing by leveraging deep learning models for geometry and color coding. The geometry is processed directly in its original 3D form using sparse convolutional neural networks, while the color data is projected onto 2D images and encoded using the also learning-based JPEG AI standard. The goal of this paper is to provide a complete technical description of the JPEG PCC standard, along with a thorough benchmarking of its performance against the state-of-the-art, while highlighting its main strengths and weaknesses. In terms of compression performance, JPEG PCC outperforms the conventional MPEG PCC standards, especially in geometry coding, achieving significant rate reductions. Color compression performance is less competitive but this is overcome by the power of a full learning-based coding framework for both geometry and color and the associated effective compressed domain processing.
