# Real Time GAZED: Online Shot Selection and Editing of Virtual Cameras from Wide-Angle Monocular Video Recordings

arXiv: https://arxiv.org/abs/2311.15581 · HTML: https://mlsanity.com/paper/2311.15581/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 23 references that are in the map.
- First posted on arXiv 27 Nov 2023.

## Builds on (most cited first, 7 of 7)

- [ByteTrack: Multi-Object Tracking by Associating Every Detection Box](https://mlsanity.com/paper/2110.06864/) (2021)
- [ViNet: Pushing the limits of Visual Modality for Audio-Visual Saliency Prediction](https://mlsanity.com/paper/2012.06170/) (2020)
- [GAZED- Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings](https://mlsanity.com/paper/2010.11886/) (2020)
- [Temporal and Contextual Transformer for Multi-Camera Editing of TV Shows](https://mlsanity.com/paper/2210.08737/) (2022)
- [Joint Stabilization and Direction of 360deg Videos](https://mlsanity.com/paper/1901.04161/) (2019)
- [Watch to Edit: Video Retargeting using Gaze](https://mlsanity.com/paper/1807.03125/) (2018)
- [CineFilter: Unsupervised Filtering for Real Time Autonomous Camera Systems](https://mlsanity.com/paper/1912.05636/) (2019)

## Built on by (most cited first, 3 of 3)

- [EditIQ: Automated Cinematic Editing of Static Wide-Angle Videos via Dialogue Interpretation and Saliency Cues](https://mlsanity.com/paper/2502.02172/) (2025)
- [A Dual-Transformer for Multi-Camera View Recommendation](https://mlsanity.com/paper/2608.25601/) (2026)
- [Marker-free eye-gaze estimation using a single image and depth from defocus](https://mlsanity.com/paper/2609.09610/) (2026)

## Abstract (arXiv)

Eliminating time-consuming post-production processes and delivering high-quality videos in today's fast-paced digital landscape are the key advantages of real-time approaches. To address these needs, we present Real Time GAZED: a real-time adaptation of the GAZED framework integrated with CineFilter, a novel real-time camera trajectory stabilization approach. It enables users to create professionally edited videos in real-time. Comparative evaluations against baseline methods, including the non-real-time GAZED, demonstrate that Real Time GAZED achieves similar editing results, ensuring high-quality video output. Furthermore, a user study confirms the aesthetic quality of the video edits produced by the Real Time GAZED approach. With these advancements in real-time camera trajectory optimization and video editing presented, the demand for immediate and dynamic content creation in industries such as live broadcasting, sports coverage, news reporting, and social media content creation can be met more efficiently.