# U-Motion: Learned Point Cloud Video Compression with U-Structured Temporal Context Generation

arXiv: https://arxiv.org/abs/2411.14501 · HTML: https://mlsanity.com/paper/2411.14501/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 34 references that are in the map.
- First posted on arXiv 21 Nov 2024.

## Builds on (most cited first, 20 of 20)

- [4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks](https://mlsanity.com/paper/1904.08755/) (2019)
- [Variational image compression with a scale hyperprior](https://mlsanity.com/paper/1802.01436/) (2018)
- [End-to-end Optimized Image Compression](https://mlsanity.com/paper/1611.01704/) (2016)
- [DVC: An End-to-end Deep Video Compression Framework](https://mlsanity.com/paper/1812.00101/) (2018)
- [Deep Contextual Video Compression](https://mlsanity.com/paper/2109.15047/) (2021)
- [Neural Video Compression with Diverse Contexts](https://mlsanity.com/paper/2302.14402/) (2023)
- [FVC: A New Framework towards Deep Video Compression in Feature Space](https://mlsanity.com/paper/2105.09600/) (2021)
- [Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compression](https://mlsanity.com/paper/2207.05894/) (2022)
- [Neural Video Compression with Feature Modulation](https://mlsanity.com/paper/2402.17414/) (2024)
- [Temporal Context Mining for Learned Video Compression](https://mlsanity.com/paper/2111.13850/) (2021)
- [Multiscale Point Cloud Geometry Compression](https://mlsanity.com/paper/2011.03799/) (2020)
- [Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compression](https://mlsanity.com/paper/2111.10633/) (2021)
- [Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Prediction](https://mlsanity.com/paper/2206.07460/) (2022)
- [3DAC: Learning Attribute Compression for Point Clouds](https://mlsanity.com/paper/2203.09931/) (2022)
- [Inter-Frame Compression for Dynamic Point Cloud Geometry Coding](https://mlsanity.com/paper/2207.12554/) (2022)
- [D-DPCC: Deep Dynamic Point Cloud Compression via 3D Motion Prediction](https://mlsanity.com/paper/2205.01135/) (2022)
- [Contrastive Pre-Training with Multi-View Fusion for No-Reference Point Cloud Quality Assessment](https://mlsanity.com/paper/2403.10066/) (2024)
- [Dynamic Point Cloud Geometry Compression Using Multiscale Inter Conditional Coding](https://mlsanity.com/paper/2301.12165/) (2023)
- [Learning Dynamic Point Cloud Compression via Hierarchical Inter-frame Block Matching](https://mlsanity.com/paper/2305.05356/) (2023)
- [Low Latency Point Cloud Rendering with Learned Splatting](https://mlsanity.com/paper/2409.16504/) (2024)

## Built on by (most cited first, 1 of 1)

- [Motion Estimation Techniques for Volumetric Video Attribute Compression](https://mlsanity.com/paper/2607.03576/) (2026)

## Abstract (arXiv)

Point cloud video (PCV) is a versatile 3D representation of dynamic scenes with emerging applications. This paper introduces U-Motion, a learning-based compression scheme for both PCV geometry and attributes. We propose a U-Structured inter-frame prediction framework, U-Inter, which performs explicit motion estimation and compensation (ME/MC) at different scales with varying levels of detail. It integrates Top-Down (Fine-to-Coarse) Motion Propagation, Bottom-Up Motion Predictive Coding and Multi-scale Group Motion Compensation to enable accurate motion estimation and efficient motion compression at each scale. In addition, we design a multi-scale spatial-temporal predictive coding module to capture the cross-scale spatial redundancy remaining after U-Inter prediction. We conduct experiments following the MPEG Common Test Condition for dense dynamic point clouds and demonstrate that U-Motion can achieve significant gains over MPEG G-PCC-GesTM v3.0 and recently published learning-based methods for both geometry and attribute compression.