# Sparse Video Representation Using Steered Mixture-of-Experts With Global Motion Compensation

arXiv: https://arxiv.org/abs/2209.05993 · HTML: https://mlsanity.com/paper/2209.05993/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts.
- Builds on 2 of its 16 references that are in the map.
- First posted on arXiv 13 Sep 2022.

## Placed in

- Mixture-of-experts / [Vision mixture-of-experts](https://mlsanity.com/moe/vision-mixture-of-experts/)

## Builds on (most cited first, 2 of 2)

- [RAFT: Recurrent All-Pairs Field Transforms for Optical Flow](https://mlsanity.com/paper/2003.12039/) (2020)
- [Edge-Aware Autoencoder Design for Real-Time Mixture-of-Experts Image Compression](https://mlsanity.com/paper/2207.12348/) (2022)

## Built on by (most cited first, 2 of 2)

- [Adaptive Segmentation-Based Initialization for Steered Mixture of Experts Image Regression](https://mlsanity.com/paper/2409.10101/) (2024)
- [Rasterized Steered Mixture of Experts for Efficient 2D Image Regression](https://mlsanity.com/paper/2510.05814/) (2025)

## Abstract (arXiv)

Steered-Mixtures-of Experts (SMoE) present a unified framework for sparse representation and compression of image data with arbitrary dimensionality. Recent work has shown great improvements in the performance of such models for image and light-field representation. However, for the case of videos the straight-forward application yields limited success as the SMoE framework leads to a piece-wise linear representation of the underlying imagery which is disrupted by nonlinear motion. We incorporate a global motion model into the SMoE framework which allows for higher temporal steering of the kernels. This drastically increases its capabilities to exploit correlations between adjacent frames by only adding 2 to 8 motion parameters per frame to the model but decreasing the required amount of kernels on average by 54.25%, respectively, while maintaining the same reconstruction quality yielding higher compression gains.