mlsanityData to 14 Oct 2026

mathttM3VIR: A Large-Scale Multi-Modality Multi-View Synthesized Benchmark Dataset for Image Restoration and Content Creation

arXiv 2509.16873 ↗First posted 21 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The gaming and entertainment industry is rapidly evolving, driven by immersive experiences and the integration of generative AI (GAI) technologies. Training such models effectively requires large-scale datasets that capture the diversity and context of gaming environments. However, existing datasets are often limited to specific domains or rely on artificial degradations, which do not accurately capture the unique characteristics of gaming content. Moreover, benchmarks for controllable video generation remain absent. To address these limitations, we introduce mathttM3VIR, a large-scale, multi-modal, multi-view dataset specifically designed to overcome the shortcomings of current resources. Unlike existing datasets, mathttM3VIR provides diverse, high-fidelity gaming content rendered with Unreal Engine 5, offering authentic ground-truth LR-HR paired and multi-view frames across 80 scenes in 8 categories. It includes mathttM3VIRMR for super-resolution (SR), novel view synthesis (NVS), and combined NVS+SR tasks, and mathttM3VIRMS, the first multi-style, object-level ground-truth set enabling research on controlled video generation. Additionally, we benchmark several state-of-the-art SR and NVS methods to establish performance baselines. While no existing approaches directly handle controlled video generation, mathttM3VIR provides a benchmark for advancing this area. By releasing the dataset, we aim to facilitate research in AI-powered restoration, compression, and controllable content generation for next-generation cloud gaming and entertainment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 72 references that are in the map. First posted on arXiv 21 Sep 2025.

Builds on

38 of 72 references.

References · 38

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2022Video Diffusion Modelscited by 2,305
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  10. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  11. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  12. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
26 more
  1. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  2. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  3. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  4. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  5. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  6. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
  7. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  8. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  9. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  10. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  11. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  12. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
  13. 2016Generating Videos with Scene Dynamicscited by 376
  14. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
  15. 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 332
  16. 2020Deep Unfolding Network for Image Super-Resolutioncited by 254
  17. 2017Learning a Single Convolutional Super-Resolution Network for Multiple Degradationscited by 228
  18. 2019Blind Super-Resolution With Iterative Kernel Correctioncited by 203
  19. 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 153
  20. 2017Self-Supervised Visual Planning with Temporal Skip Connectionscited by 139
  21. 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
  22. 2022Rethinking Alignment in Video Super-Resolution Transformerscited by 71
  23. 2019Camera Lens Super-Resolutioncited by 56
  24. 2023Learning Image-Adaptive Codebooks for Class-Agnostic Image Restorationcited by 14
  25. 2022Image Super-Resolution with Deep Dictionarycited by 5
  26. 2024GameIR: A Large-Scale Synthesized Ground-Truth Dataset for Image Restoration over Gaming Contentcited by 2

Built on by

Not cited yet.