# Learning High-Quality Navigation and Zooming on Omnidirectional Images in Virtual Reality

arXiv: https://arxiv.org/abs/2405.00351 · HTML: https://mlsanity.com/paper/2405.00351/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 14 of its 47 references that are in the map.
- First posted on arXiv 1 May 2024.

## Builds on (most cited first, 14 of 14)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Enhanced Deep Residual Networks for Single Image Super-Resolution](https://mlsanity.com/paper/1707.02921/) (2017)
- [Image Super-Resolution Using Very Deep Residual Channel Attention Networks](https://mlsanity.com/paper/1807.02758/) (2018)
- [Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network](https://mlsanity.com/paper/1609.05158/) (2016)
- [Deep Learning for Omnidirectional Vision: A Survey and New Perspectives](https://mlsanity.com/paper/2205.10468/) (2022)
- [SphereSR: 360deg Image Super-Resolution with Arbitrary Projection via Continuous Spherical Image Representation](https://mlsanity.com/paper/2112.06536/) (2021)
- [OSRT: Omnidirectional Image Super-Resolution with Distortion-aware Transformer](https://mlsanity.com/paper/2302.03453/) (2023)
- [Super-resolution of Omnidirectional Images Using Adversarial Learning](https://mlsanity.com/paper/1908.04297/) (2019)
- [M"obius Convolutions for Spherical CNNs](https://mlsanity.com/paper/2201.12212/) (2022)
- [Data augmentation with Mobius transformations](https://mlsanity.com/paper/2002.02917/) (2020)
- [OPDN: Omnidirectional Position-aware Deformable Network for Omnidirectional Image Super-Resolution](https://mlsanity.com/paper/2304.13471/) (2023)
- [OmniZoomer: Learning to Move and Zoom in on Sphere at High-Resolution](https://mlsanity.com/paper/2308.08114/) (2023)
- [View-aware Salient Object Detection for 360deg Omnidirectional Image](https://mlsanity.com/paper/2209.13222/) (2022)
- [Squares that Look Round: Transforming Spherical Images](https://mlsanity.com/paper/1605.01396/) (2016)

## Built on by (most cited first, 1 of 1)

- [Towards Omnidirectional Reasoning with 360-R1: A Dataset, Benchmark, and GRPO-based Method](https://mlsanity.com/paper/2505.14197/) (2025)

## Abstract (arXiv)

Viewing omnidirectional images (ODIs) in virtual reality (VR) represents a novel form of media that provides immersive experiences for users to navigate and interact with digital content. Nonetheless, this sense of immersion can be greatly compromised by a blur effect that masks details and hampers the user's ability to engage with objects of interest. In this paper, we present a novel system, called OmniVR, designed to enhance visual clarity during VR navigation. Our system enables users to effortlessly locate and zoom in on the objects of interest in VR. It captures user commands for navigation and zoom, converting these inputs into parameters for the Mobius transformation matrix. Leveraging these parameters, the ODI is refined using a learning-based algorithm. The resultant ODI is presented within the VR media, effectively reducing blur and increasing user engagement. To verify the effectiveness of our system, we first evaluate our algorithm with state-of-the-art methods on public datasets, which achieves the best performance. Furthermore, we undertake a comprehensive user study to evaluate viewer experiences across diverse scenarios and to gather their qualitative feedback from multiple perspectives. The outcomes reveal that our system enhances user engagement by improving the viewers' recognition, reducing discomfort, and improving the overall immersive experience. Our system makes the navigation and zoom more user-friendly.
