GIFT: Generated Indoor video frames for Texture-less point tracking
Not on the map. Why?
Abstract (arXiv)
Point tracking is becoming a powerful solver for motion estimation and video editing. Compared to classical feature matching, point tracking methods have the key advantage of robustly tracking points under complex camera motion trajectories and over extended periods. However, despite certain improvements in methodologies, current point tracking methods still struggle to track any position in video frames, especially in areas that are texture-less or weakly textured. In this work, we first introduce metrics for evaluating the texture intensity of a 3D object. Using these metrics, we classify the 3D models in ShapeNet into three levels of texture intensity and create GIFT, a challenging synthetic benchmark comprising 1800 indoor video sequences with rich annotations. Unlike existing datasets that assign ground truth points arbitrarily, GIFT precisely anchors ground truth on classified target objects, ensuring that each video corresponds to a specific texture intensity level. Furthermore, we comprehensively evaluate current methods on GIFT to assess their performance across different texture intensity levels and analyze the impact of texture on point tracking.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 17 Mar 2025.
Builds on
34 of 42 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2022Kubric: A scalable dataset generatorcited by 373
22 more
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2023Tracking Everything Everywhere All at Oncecited by 190
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2021AutoFlow: Learning a Better Training Set for Optical Flowcited by 102
- 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2023Segment Anything Meets Point Trackingcited by 81
- 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 70
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2023MFT: Long-Term Tracking of Every Pixelcited by 61
- 2024Video Diffusion Models are Training-free Motion Interpreter and Controllercited by 60
- 2021Tracking Pedestrian Heads in Dense Crowdcited by 42
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 41
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objectscited by 32
- 2024Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion Inversioncited by 27
- 2020An Advert Creation System for 3D Product Placementscited by 4
Built on by
Not cited yet.