# A Neural Network Approach to Missing Marker Reconstruction in Human Motion Capture

arXiv: https://arxiv.org/abs/1803.02665 · HTML: https://mlsanity.com/paper/1803.02665/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Mar 2018.

## Built on by (most cited first, 2 of 2)

- [DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimation](https://mlsanity.com/paper/2203.08713/) (2022)
- [Nonlinear Methods for Analyzing Pose in Behavioral Research](https://mlsanity.com/paper/2604.01453/) (2026)

## Abstract (arXiv)

Optical motion capture systems have become a widely used technology in various fields, such as augmented reality, robotics, movie production, etc. Such systems use a large number of cameras to triangulate the position of optical markers.The marker positions are estimated with high accuracy. However, especially when tracking articulated bodies, a fraction of the markers in each timestep is missing from the reconstruction. In this paper, we propose to use a neural network approach to learn how human motion is temporally and spatially correlated, and reconstruct missing markers positions through this model. We experiment with two different models, one LSTM-based and one time-window-based. Both methods produce state-of-the-art results, while working online, as opposed to most of the alternative methods, which require the complete sequence to be known. The implementation is publicly available at https://github.com/Svito-zar/NN-for-Missing-Marker-Reconstruction .
