# PlenoptiCam v1.0: A light-field imaging framework

arXiv: https://arxiv.org/abs/2010.11687 · HTML: https://mlsanity.com/paper/2010.11687/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Oct 2020.

## Built on by (most cited first, 7 of 7)

- [Diffusion-based Image Translation using Disentangled Style and Content Representation](https://mlsanity.com/paper/2209.15264/) (2022)
- [Color Conditional Generation with Sliced Wasserstein Guidance](https://mlsanity.com/paper/2503.19034/) (2025)
- [Physically Consistent Image Augmentation for Deep Learning in Mueller Matrix Polarimetry](https://mlsanity.com/paper/2411.07918/) (2024)
- [Single-Shot Metric Depth from Focused Plenoptic Cameras](https://mlsanity.com/paper/2412.02386/) (2024)
- [SoccerNet 2026 Challenges Results](https://mlsanity.com/paper/2607.07320/) (2026)
- [Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding](https://mlsanity.com/paper/2207.00522/) (2022)
- [Diagnosising Helicobacter pylori using AutoEncoders and Limited Annotations through Anomalous Staining Patterns in IHC Whole Slide Images](https://mlsanity.com/paper/2412.13857/) (2024)

## Abstract (arXiv)

Light-field cameras play a vital role for rich 3-D information retrieval in narrow range depth sensing applications. The key obstacle in composing light-fields from exposures taken by a plenoptic camera is to computationally calibrate, align and rearrange four-dimensional image data. Several attempts have been proposed to enhance the overall image quality by tailoring pipelines dedicated to particular plenoptic cameras and improving the consistency across viewpoints at the expense of high computational loads. The framework presented herein advances prior outcomes thanks to its novel micro image scale-space analysis for generic camera calibration independent of the lens specifications and its parallax-invariant, cost-effective viewpoint color equalization from optimal transport theory. Artifacts from the sensor and micro lens grid are compensated in an innovative way to enable superior quality in sub-aperture image extraction, computational refocusing and Scheimpflug rendering with sub-sampling capabilities. Benchmark comparisons using established image metrics suggest that our proposed pipeline outperforms state-of-the-art tool chains in the majority of cases. Results from a Wasserstein distance further show that our color transfer outdoes the existing transport methods. Our algorithms are released under an open-source license, offer cross-platform compatibility with few dependencies and different user interfaces. This makes the reproduction of results and experimentation with plenoptic camera technology convenient for peer researchers, developers, photographers, data scientists and others working in this field.
