# Scalable Human-Machine Point Cloud Compression

arXiv: https://arxiv.org/abs/2402.12532 · HTML: https://mlsanity.com/paper/2402.12532/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 18 of its 28 references that are in the map.
- First posted on arXiv 19 Feb 2024.

## Builds on (most cited first, 18 of 18)

- [PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation](https://mlsanity.com/paper/1612.00593/) (2016)
- [PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space](https://mlsanity.com/paper/1706.02413/) (2017)
- [Variational image compression with a scale hyperprior](https://mlsanity.com/paper/1802.01436/) (2018)
- [OctNet: Learning Deep 3D Representations at High Resolutions](https://mlsanity.com/paper/1611.05009/) (2016)
- [CompressAI: a PyTorch library and evaluation platform for end-to-end compression research](https://mlsanity.com/paper/2011.03029/) (2020)
- [Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analytics](https://mlsanity.com/paper/2001.03569/) (2020)
- [Scalable Image Coding for Humans and Machines](https://mlsanity.com/paper/2107.08373/) (2021)
- [OctAttention: Octree-Based Large-Scale Contexts Model for Point Cloud Compression](https://mlsanity.com/paper/2202.06028/) (2022)
- [Learning Convolutional Transforms for Lossy Point Cloud Geometry Compression](https://mlsanity.com/paper/1903.08548/) (2019)
- [Image coding for machines: an end-to-end learned approach](https://mlsanity.com/paper/2108.09993/) (2021)
- [Density-preserving Deep Point Cloud Compression](https://mlsanity.com/paper/2204.12684/) (2022)
- [Towards Coding for Human and Machine Vision: A Scalable Image Coding Approach](https://mlsanity.com/paper/2001.02915/) (2020)
- [Deep AutoEncoder-based Lossy Geometry Compression for Point Clouds](https://mlsanity.com/paper/1905.03691/) (2019)
- [Collaborative Intelligence: Challenges and Opportunities](https://mlsanity.com/paper/2102.06841/) (2021)
- [Collaborative Inference for AI-Empowered IoT Devices](https://mlsanity.com/paper/2207.11664/) (2022)
- [IPDAE: Improved Patch-Based Deep Autoencoder for Lossy Point Cloud Geometry Compression](https://mlsanity.com/paper/2208.02519/) (2022)
- [Base Layer Efficiency in Scalable Human-Machine Coding](https://mlsanity.com/paper/2307.02430/) (2023)
- [Learned Point Cloud Compression for Classification](https://mlsanity.com/paper/2308.05959/) (2023)

## Built on by (most cited first, 1 of 1)

- [Point Cloud Geometry Scalable Coding Using a Resolution and Quality-conditioned Latents Probability Estimator](https://mlsanity.com/paper/2502.14099/) (2025)

## Abstract (arXiv)

Due to the limited computational capabilities of edge devices, deep learning inference can be quite expensive. One remedy is to compress and transmit point cloud data over the network for server-side processing. Unfortunately, this approach can be sensitive to network factors, including available bitrate. Luckily, the bitrate requirements can be reduced without sacrificing inference accuracy by using a machine task-specialized codec. In this paper, we present a scalable codec for point-cloud data that is specialized for the machine task of classification, while also providing a mechanism for human viewing. In the proposed scalable codec, the "base" bitstream supports the machine task, and an "enhancement" bitstream may be used for better input reconstruction performance for human viewing. We base our architecture on PointNet++, and test its efficacy on the ModelNet40 dataset. We show significant improvements over prior non-specialized codecs.
