# A Single Frame and Multi-Frame Joint Network for 360-degree Panorama Video Super-Resolution

arXiv: https://arxiv.org/abs/2008.10320 · HTML: https://mlsanity.com/paper/2008.10320/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Aug 2020.

## Built on by (most cited first, 10 of 10)

- [Deep Learning for Omnidirectional Vision: A Survey and New Perspectives](https://mlsanity.com/paper/2205.10468/) (2022)
- [SphereSR: 360deg Image Super-Resolution with Arbitrary Projection via Continuous Spherical Image Representation](https://mlsanity.com/paper/2112.06536/) (2021)
- [Large Motion Video Super-Resolution with Dual Subnet and Multi-Stage Communicated Upsampling](https://mlsanity.com/paper/2103.11744/) (2021)
- [EvTexture: Event-driven Texture Enhancement for Video Super-Resolution](https://mlsanity.com/paper/2406.13457/) (2024)
- [ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Images](https://mlsanity.com/paper/2404.16825/) (2024)
- [A Survey of Deep Learning Video Super-Resolution](https://mlsanity.com/paper/2506.03216/) (2025)
- [Spatio-Temporal Distortion Aware Omnidirectional Video Super-Resolution](https://mlsanity.com/paper/2410.11506/) (2024)
- [A Systematic Investigation on Deep Learning-Based Omnidirectional Image and Video Super-Resolution](https://mlsanity.com/paper/2506.06710/) (2025)
- [Omnidirectional Video Super-Resolution using Deep Learning](https://mlsanity.com/paper/2506.14803/) (2025)
- [EvTexture++: Event-Driven Texture Enhancement for Video Super-Resolution](https://mlsanity.com/paper/2606.13580/) (2026)

## Abstract (arXiv)

Spherical videos, also known as ang360 (panorama) videos, can be viewed with various virtual reality devices such as computers and head-mounted displays. They attract large amount of interest since awesome immersion can be experienced when watching spherical videos. However, capturing, storing and transmitting high-resolution spherical videos are extremely expensive. In this paper, we propose a novel single frame and multi-frame joint network (SMFN) for recovering high-resolution spherical videos from low-resolution inputs. To take advantage of pixel-level inter-frame consistency, deformable convolutions are used to eliminate the motion difference between feature maps of the target frame and its neighboring frames. A mixed attention mechanism is devised to enhance the feature representation capability. The dual learning strategy is exerted to constrain the space of solution so that a better solution can be found. A novel loss function based on the weighted mean square error is proposed to emphasize on the super-resolution of the equatorial regions. This is the first attempt to settle the super-resolution of spherical videos, and we collect a novel dataset from the Internet, MiG Panorama Video, which includes 204 videos. Experimental results on 4 representative video clips demonstrate the efficacy of the proposed method. The dataset and code are available at https://github.com/lovepiano/SMFNFor360VSR.
