# A Novel Hierarchical Light Field Coding Scheme Based on Hybrid Stacked Multiplicative Layers and Fourier Disparity Layers for Glasses-Free 3D Displays

arXiv: https://arxiv.org/abs/2108.12399 · HTML: https://mlsanity.com/paper/2108.12399/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 64 references that are in the map.
- First posted on arXiv 27 Aug 2021.

## Builds on (most cited first, 5 of 5)

- [Randomized Block Krylov Methods for Stronger and Faster Approximate Singular Value Decomposition](https://mlsanity.com/paper/1504.05477/) (2015)
- [Light Field Reconstruction Using Shearlet Transform](https://mlsanity.com/paper/1509.08969/) (2015)
- [A Fourier Disparity Layer representation for Light Fields](https://mlsanity.com/paper/1901.06919/) (2019)
- [Pseudo Sequence based 2-D hierarchical reference structure for Light-Field Image Compression](https://mlsanity.com/paper/1612.07309/) (2016)
- [A Hierarchical Coding Scheme for Glasses-free 3D Displays Based on Scalable Hybrid Layered Representation of Real-World Light Fields](https://mlsanity.com/paper/2104.09378/) (2021)

## Built on by (most cited first, 1 of 1)

- [A Novel Light Field Coding Scheme Based on Deep Belief Network & Weighted Binary Images for Additive Layered Displays](https://mlsanity.com/paper/2210.01447/) (2022)

## Abstract (arXiv)

This paper presents a novel hierarchical coding scheme for light fields based on transmittance patterns of low-rank multiplicative layers and Fourier disparity layers. The proposed scheme identifies multiplicative layers of light field view subsets optimized using a convolutional neural network for different scanning orders. Our approach exploits the hidden low-rank structure in the multiplicative layers obtained from the subsets of different scanning patterns. The spatial redundancies in the multiplicative layers can be efficiently removed by performing low-rank approximation at different ranks on the Krylov subspace. The intra-view and inter-view redundancies between approximated layers are further removed by HEVC encoding. Next, a Fourier disparity layer representation is constructed from the first subset of the approximated light field based on the chosen hierarchical order. Subsequent view subsets are synthesized by modeling the Fourier disparity layers that iteratively refine the representation with improved accuracy. The critical advantage of the proposed hybrid layered representation and coding scheme is that it utilizes not just spatial and temporal redundancies in light fields but efficiently exploits intrinsic similarities among neighboring sub-aperture images in both horizontal and vertical directions as specified by different predication orders. In addition, the scheme is flexible to realize a range of multiple bitrates at the decoder within a single integrated system. The compression performance of the proposed scheme is analyzed on real light fields. We achieved substantial bitrate savings and maintained good light field reconstruction quality.