Soccer on Your Tabletop
Not on the map. Why?
Abstract (arXiv)
We present a system that transforms a monocular video of a soccer game into a moving 3D reconstruction, in which the players and field can be rendered interactively with a 3D viewer or through an Augmented Reality device. At the heart of our paper is an approach to estimate the depth map of each player, using a CNN that is trained on 3D player data extracted from soccer video games. We compare with state of the art body pose and depth estimation techniques, and show results on both synthetic ground truth benchmarks, and real YouTube soccer footage.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 3; 2023: 3; 2024: 1; 2025: 3; 2026: 1.
20 papers.
Sort:
By area:
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detectioncited by 66
- 2021Consistent Depth of Moving Objects in Videocited by 56
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videoscited by 40
- 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Datacited by 38
- 2021Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcastscited by 30
- 2022The One Where They Reconstructed 3D Humans and Environments in TV Showscited by 30
- 2023SportsPose -- A Dynamic 3D sports pose datasetcited by 26
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Modelscited by 23
- 2025WorldPose: A World Cup Dataset for Global 3D Human Pose Estimationcited by 13
- 2021UltraPose: Synthesizing Dense Pose with 1 Billion Points by Human-body Decoupling 3D Modelcited by 9
8 more
- 2023Self-supervised 3D Human Pose Estimation from a Single Imagecited by 8
- 20223D Human Pose Estimation Using M"obius Graph Convolutional Networkscited by 6
- 2021SuperCaustics: Real-time, open-source simulation of transparent objects for deep learning applicationscited by 5
- 2021Multi-view data capture for dynamic object reconstruction using handheld augmented reality mobilescited by 2
- 2023A Survey of Advanced Computer Vision Techniques for Sportscited by 2
- 2025Where Is The Ball: 3D Ball Trajectory Estimation From 2D Monocular Trackingcited by 2
- 2025DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimationcited by 2
- 2026TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streamingcited by 0
- 2026TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming2 Jul 2026
- 2025DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation12 Nov 2025
- 2025Where Is The Ball: 3D Ball Trajectory Estimation From 2D Monocular Tracking6 Jun 2025
- 2025WorldPose: A World Cup Dataset for Global 3D Human Pose Estimation6 Jan 2025
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models8 May 2024
- 2023Self-supervised 3D Human Pose Estimation from a Single Image5 Apr 2023
- 2023SportsPose -- A Dynamic 3D sports pose dataset4 Apr 2023
- 2023A Survey of Advanced Computer Vision Techniques for Sports18 Jan 2023
- 2022The One Where They Reconstructed 3D Humans and Environments in TV Shows28 Jul 2022
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detection21 Jul 2022
- 20223D Human Pose Estimation Using M"obius Graph Convolutional Networks20 Mar 2022
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation7 Nov 2021
8 more
- 2021UltraPose: Synthesizing Dense Pose with 1 Billion Points by Human-body Decoupling 3D Model28 Oct 2021
- 2021Consistent Depth of Moving Objects in Video2 Aug 2021
- 2021SuperCaustics: Real-time, open-source simulation of transparent objects for deep learning applications23 Jul 2021
- 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Data18 May 2021
- 2021SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videos23 Apr 2021
- 2021Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcasts14 Apr 2021
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detection31 Mar 2021
- 2021Multi-view data capture for dynamic object reconstruction using handheld augmented reality mobiles14 Mar 2021
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detectioncited by 66
- 2021Consistent Depth of Moving Objects in Videocited by 56
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videoscited by 40
- 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Datacited by 38
- 2021Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcastscited by 30
- 2022The One Where They Reconstructed 3D Humans and Environments in TV Showscited by 30
- 2023SportsPose -- A Dynamic 3D sports pose datasetcited by 26
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2025WorldPose: A World Cup Dataset for Global 3D Human Pose Estimationcited by 13
- 2021UltraPose: Synthesizing Dense Pose with 1 Billion Points by Human-body Decoupling 3D Modelcited by 9
- 2023Self-supervised 3D Human Pose Estimation from a Single Imagecited by 8
12 most cited of 19 All 19 (JSON)
- 2026TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming2 Jul 2026
- 2025DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation12 Nov 2025
- 2025Where Is The Ball: 3D Ball Trajectory Estimation From 2D Monocular Tracking6 Jun 2025
- 2025WorldPose: A World Cup Dataset for Global 3D Human Pose Estimation6 Jan 2025
- 2023Self-supervised 3D Human Pose Estimation from a Single Image5 Apr 2023
- 2023SportsPose -- A Dynamic 3D sports pose dataset4 Apr 2023
- 2023A Survey of Advanced Computer Vision Techniques for Sports18 Jan 2023
- 2022The One Where They Reconstructed 3D Humans and Environments in TV Shows28 Jul 2022
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detection21 Jul 2022
- 20223D Human Pose Estimation Using M"obius Graph Convolutional Networks20 Mar 2022
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation7 Nov 2021
- 2021UltraPose: Synthesizing Dense Pose with 1 Billion Points by Human-body Decoupling 3D Model28 Oct 2021
12 newest of 19 All 19 (JSON)