mlsanityData to 14 Oct 2026

Field Converter: Geometry-Initialized Temporal Residual Refinement for World-Grounded Player Pose Estimation from Soccer Broadcasts

arXiv 2609.10498 ↗First posted 9 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recovering 3D human pose from monocular sports broadcasts remains challenging when players must be localized in a shared metric world coordinate system rather than only reconstructed relative to their own body. We introduce Field Converter, a geometry-initialized temporal residual framework for world-grounded 3D player pose estimation from calibrated soccer broadcasts. Our method first uses camera and pitch geometry to initialize the player root through ray-ground intersection, then predicts a temporal residual correction from pose, image, camera, and geometric cues. On match-disjoint evaluation sequences, residual refinement reduces root error from 49cm with geometry alone to 14cm with a frame-wise MLP and 10cm with a TCN, while a Transformer achieves a comparable 11cm. The resulting world-space MPJPE reaches 13.2cm, and ablations show that residual prediction clearly outperforms direct global-root regression while temporal context matters more than the specific temporal backbone. Failure analysis further identifies airborne motion as the main limitation of the ground-based geometric initialization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

23 of 32 references.

References · 23

  1. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
  2. 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 403
  3. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
  4. 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 307
  5. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
  6. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
  7. 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 159
  8. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
  9. 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
  10. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
  11. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
  12. 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 101
11 more
  1. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 69
  2. 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 64
  3. 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 34
  4. 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localizationcited by 25
  5. 2022TVCalib: Camera Calibration for Sports Field Registration in Soccercited by 22
  6. 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movementscited by 15
  7. 2024PnLCalib: Sports Field Registration via Points and Lines Optimizationcited by 14
  8. 2025WorldPose: A World Cup Dataset for Global 3D Human Pose Estimationcited by 14
  9. 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movementscited by 14
  10. 2023Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registrationcited by 13
  11. 2023ProxyCap: Real-time Monocular Full-body Capture in World Space via Human-Centric Proxy-to-Motion Learningcited by 9

Built on by

Not cited yet.