Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes
Not on the map. Why?
Abstract (arXiv)
Tracking the dynamics of non-canonical biological systems in microscopy videos remains a persistent challenge. Both classical and learning-based trackers depend on expert-reviewed data to be evaluated and adapted, yet exhaustive manual annotation rarely scales to the videos where these tools are needed most. We developed RIPPLE (Refinement Interpolation Platform for Point Location Estimation), which recasts annotation as sparse correction: a user clicks a starting point, RIPPLE proposes a full trajectory, and the user intervenes only where the trajectory drifts. We tested RIPPLE on five challenging microscopy datasets from our laboratories, four from the transparent jellyfish Clytia hemisphaerica and one tracking landmarks on rapidly moving sperm. Across these, RIPPLE matched the quality of exhaustive manual annotation while reducing manual clicks by 3 to 25 times across datasets. RIPPLE thereby fills a missing layer between manual annotation and fully automated tracking, enabling immediate quantification of biological dynamics, method benchmarking, and the production of the gold-standard data needed to adapt future automated microscopy trackers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 100 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
38 of 100 references.
References · 38
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
26 more
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
- 2018Cell Detection with Star-convex Polygonscited by 183
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2019Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimationcited by 131
- 2020MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Maskcited by 117
- 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
- 2022CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flowcited by 82
- 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
- 2024Local All-Pair Correspondence for Point Trackingcited by 80
- 2016Fast Optical Flow using Dense Inverse Searchcited by 71
- 2022Global Matching with Overlapping Attention for Optical Flow Estimationcited by 64
- 2022SKFlow: Learning Optical Flow with Super Kernelscited by 56
- 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
- 2021High-Resolution Optical Flow from 1D Attention and Correlationcited by 54
- 2020Displacement-Invariant Matching Cost Learning for Accurate Optical Flow Estimationcited by 49
- 2022DIP: Deep Inverse Patchmatch for High-Resolution Optical Flowcited by 40
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2021FastFlowNet: A Lightweight Network for Fast Optical Flow Estimationcited by 28
- 2020ScopeFlow: Dynamic Scene Scoping for Optical Flowcited by 24
- 2022CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Drivingcited by 16
- 2023CCMR: High Resolution Optical Flow Estimation via Coarse-to-Fine Context-Guided Motion Reasoningcited by 15
- 2020STaRFlow: A SpatioTemporal Recurrent Cell for Lightweight Multi-Frame Optical Flow Estimationcited by 12
- 2022High Resolution Multi-Scale RAFT (Robust Vision Challenge 2022)cited by 12
- 2023StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequencescited by 12
- 2024NeuFlow v2: Push High-Efficiency Optical Flow To the Limitcited by 5
- 2023LLA-FLOW: A Lightweight Local Aggregation on Cost Volume for Optical Flow Estimationcited by 2
Built on by
Not cited yet.