# Light Field Compression with Disparity Guided Sparse Coding based on Structural Key Views

arXiv: https://arxiv.org/abs/1610.03684 · HTML: https://mlsanity.com/paper/1610.03684/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Oct 2016.

## Built on by (most cited first, 6 of 6)

- [Texture-enhanced Light Field Super-resolution with Spatio-Angular Decomposition Kernels](https://mlsanity.com/paper/2111.04069/) (2021)
- [Learning-Based Practical Light Field Image Compression Using A Disparity-Aware Model](https://mlsanity.com/paper/2106.11558/) (2021)
- [Learning Kernel-Modulated Neural Representation for Efficient Light Field Compression](https://mlsanity.com/paper/2307.06143/) (2023)
- [Deep Learning-Based Intra Mode Derivation for Versatile Video Coding](https://mlsanity.com/paper/2204.04059/) (2022)
- [A Learned Compact and Editable Light Field Representation](https://mlsanity.com/paper/2103.11314/) (2021)
- [View Sub-sampling and Reconstruction for Efficient Light Field Compression](https://mlsanity.com/paper/2208.06464/) (2022)

## Abstract (arXiv)

Recent imaging technologies are rapidly evolving for sampling richer and more immersive representations of the 3D world. And one of the emerging technologies are light field (LF) cameras based on micro-lens arrays. To record the directional information of the light rays, a much larger storage space and transmission bandwidth are required by a LF image as compared with a conventional 2D image of similar spatial dimension, and the compression of LF data becomes a vital part of its application. In this paper, we propose a LF codec that fully exploits the intrinsic geometry between the LF sub-views by first approximating the LF with disparity guided sparse coding over a perspective shifted light field dictionary. The sparse coding is only based on several optimized Structural Key Views (SKV); however the entire LF can be recovered from the coding coefficients. By keeping the approximation identical between encoder and decoder, only the residuals of the non-key views, disparity map and the SKVs need to be compressed into the bit stream. An optimized SKV selection method is proposed such that most LF spatial information could be preserved. And to achieve optimum dictionary efficiency, the LF is divided into several Coding Regions (CR), over which the reconstruction works individually. Experiments and comparisons have been carried out over benchmark LF dataset, which show that the proposed SC-SKV codec produces convincing compression results in terms of both rate-distortion performance and visual quality compared with High Efficiency Video Coding (HEVC): with 47.87% BD-rate reduction and 1.59 dB BD-PSNR improvement achieved on average, especially with up to 4 dB improvement for low bit rate scenarios.