# Equivariant Filter for High Performance Image Tracking using an Event Camera

arXiv: https://arxiv.org/abs/2607.09103 · HTML: https://mlsanity.com/paper/2607.09103/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 9 of its 25 references that are in the map.
- First posted on arXiv 10 Jul 2026.

## Builds on (most cited first, 9 of 9)

- [Event-based Vision: A Survey](https://mlsanity.com/paper/1904.08405/) (2019)
- [Asynchronous Blob Tracker for Event Cameras](https://mlsanity.com/paper/2307.10593/) (2023)
- [ETAP: Event-based Tracking of Any Point](https://mlsanity.com/paper/2412.00133/) (2024)
- [Feature-based Recursive Observer Design for Homography Estimation](https://mlsanity.com/paper/1606.03021/) (2016)
- [A Practical Bias Estimation Algorithm for Multisensor--Multitarget Tracking](https://mlsanity.com/paper/1603.03449/) (2016)
- [Bayesian Filtering for Homography Estimation](https://mlsanity.com/paper/2310.10612/) (2023)
- [Equivariant Filter (EqF)](https://mlsanity.com/paper/2010.14666/) (2020)
- [Equivariant Systems Theory and Observer Design for Second Order Kinematic Systems on Matrix Lie Groups](https://mlsanity.com/paper/2105.04797/) (2021)
- [Optimal Linear Filtering for Discrete-Time Systems with Infinite-Dimensional Measurements](https://mlsanity.com/paper/2409.12368/) (2024)

## Abstract (arXiv)

Image tracking is the problem of estimating the transformation that relates a moving image of a scene to an original reference image. The problem is important in control of autonomous vehicles or robots, where the image encodes information about the motion of the camera or environment, as well as in pure computer vision applications. In this paper, we present an equivariant filter design for high performance tracking of planar image transformations using an event camera. The design exploits the Asynchronous Event Blob (AEB) tracker (Wang et al., 2024) to extract feature-position measurements from the raw event stream, and an equivariant filter to compute an affine image translation and rotation using the special Euclidean group symmetry. The equivariant filter incorporates an equivalent-measurement update step that de-correlates the (highly temporally correlated) feature-position measurements provided by the AEB tracker. We evaluate the design experimentally using two datasets involving general and fast rotational motion. We benchmark results against direct optimisation (estimating the relative transformation from the raw blob tracks), and a covariance intersection approach for overcoming data correlation. Our design provides smooth image tracking for features moving up to 7000 pixels per second on the image plane.