mlsanityData to 7 Oct 2026

SynthVerse: A Large-Scale Diverse Synthetic Dataset for Point Tracking

arXiv 2602.04441 ↗First posted 4 Feb 2026cs.CVcited by 2

On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data

Abstract (arXiv)

Point tracking aims to follow visual points through complex motion, occlusion, and viewpoint changes, and has advanced rapidly with modern foundation models. Yet progress toward general point tracking remains constrained by limited high-quality data, as existing datasets often provide insufficient diversity and imperfect trajectory annotations. To this end, we introduce SynthVerse, a large-scale, diverse synthetic dataset specifically designed for point tracking. SynthVerse includes several new domains and object types missing from existing synthetic datasets, such as animated-film-style content, embodied manipulation, scene navigation, and articulated objects. SynthVerse substantially expands dataset diversity by covering a broader range of object categories and providing high-quality dynamic motions and interactions, enabling more robust training and evaluation for general point tracking. In addition, we establish a highly diverse point tracking benchmark to systematically evaluate state-of-the-art methods under broader domain shifts. Extensive experiments and analyses demonstrate that training with SynthVerse yields consistent improvements in generalization and reveal limitations of existing trackers under diverse settings.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 31 of its 39 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

31 of 39 references.

References · 31

  1. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  2. 2023CoTracker: It is Better to Track Togethercited by 516
  3. 2022Kubric: A scalable dataset generatorcited by 373
  4. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  5. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
  6. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
  7. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
  8. 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
  9. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
  10. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  11. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
  12. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
19 more
  1. 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
  2. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
  3. 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 69
  4. 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 67
  5. 2025Sekai: A Video Dataset towards World Explorationcited by 64
  6. 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 62
  7. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
  8. 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
  9. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
  10. 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 46
  11. 2025AnyTop: Character Animation Diffusion with Any Topologycited by 37
  12. 2024SceneTracker: Long-term Scene Flow Estimation Networkcited by 25
  13. 2023DriveTrack: A Benchmark for Long-Range Point Tracking in Real-World Videoscited by 24
  14. 2025GENMANIP: LLM-driven Simulation for Generalizable Instruction-Following Manipulationcited by 18
  15. 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layoutscited by 18
  16. 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
  17. 2025Multi-View 3D Point Trackingcited by 17
  18. 2025DELTAv2: Accelerating Dense 3D Trackingcited by 9
  19. 2026From Frames to Sequences: Temporally Consistent Human-Centric Dense Predictioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Generative Point Tracking with Flow Matching
  2. 2026Track2View: 4D-Consistent Camera-Controlled Video Generation via Paired 3D Point Tracks
  3. 2025Online Long-term Point Tracking in the Foundation Model Era
  4. 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos
  5. 2025Probing and Leveraging Video Diffusion Transformer Features for Robust Point Tracking
  6. 2026PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics
  7. 2026DynaVid: Learning to Generate Highly Dynamic Videos using Synthetic Motion Data
  8. 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation