# ChromaCorrect: Prescription Correction in Virtual Reality Headsets through Perceptual Guidance

arXiv: https://arxiv.org/abs/2212.04264 · HTML: https://mlsanity.com/paper/2212.04264/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 66 references that are in the map.
- First posted on arXiv 8 Dec 2022.

## Builds on (most cited first, 8 of 8)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Understanding SSIM](https://mlsanity.com/paper/2006.13846/) (2020)
- [Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution](https://mlsanity.com/paper/2104.03078/) (2021)
- [Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays](https://mlsanity.com/paper/2108.06192/) (2021)
- [Telelife: The Future of Remote Living](https://mlsanity.com/paper/2107.02965/) (2021)
- [Metameric Varifocal Holography](https://mlsanity.com/paper/2110.01981/) (2021)
- [Prescription AR: A Fully-Customized Prescription-Embedded Augmented Reality Display](https://mlsanity.com/paper/1907.04353/) (2019)

## Built on by (most cited first, 1 of 1)

- [Learned Single-Pass Multitasking Perceptual Graphics for Immersive Displays](https://mlsanity.com/paper/2408.07836/) (2024)

## Abstract (arXiv)

A large portion of today's world population suffer from vision impairments and wear prescription eyeglasses. However, eyeglasses causes additional bulk and discomfort when used with augmented and virtual reality headsets, thereby negatively impacting the viewer's visual experience. In this work, we remedy the usage of prescription eyeglasses in Virtual Reality (VR) headsets by shifting the optical complexity completely into software and propose a prescription-aware rendering approach for providing sharper and immersive VR imagery. To this end, we develop a differentiable display and visual perception model encapsulating display-specific parameters, color and visual acuity of human visual system and the user-specific refractive errors. Using this differentiable visual perception model, we optimize the rendered imagery in the display using stochastic gradient-descent solvers. This way, we provide prescription glasses-free sharper images for a person with vision impairments. We evaluate our approach on various displays, including desktops and VR headsets, and show significant quality and contrast improvements for users with vision impairments.