Object Discovery in Videos as Foreground Motion Clustering
Not on the map. Why?
Abstract (arXiv)
We consider the problem of providing dense segmentation masks for object discovery in videos. We formulate the object discovery problem as foreground motion clustering, where the goal is to cluster foreground pixels in videos into different objects. We introduce a novel pixel-trajectory recurrent neural network that learns feature embeddings of foreground pixel trajectories linked across time. By clustering the pixel trajectories using the learned feature embeddings, our method establishes correspondences between foreground object masks across video frames. To demonstrate the effectiveness of our framework for object discovery, we conduct experiments on commonly used datasets for motion segmentation, where we achieve state-of-the-art performance.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 10; 2024: 3; 2025: 1; 2026: 1.
32 papers.
Sort:
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
- 2022Deformable Sprites for Unsupervised Video Decompositioncited by 61
- 2021NeuralDiff: Segmenting 3D objects that move in egocentric videoscited by 57
- 2021Opening up Open-World Trackingcited by 50
- 2023Advances in Deep Concealed Scene Understandingcited by 47
- 2021Motion-aware Contrastive Video Representation Learning via Foreground-background Mergingcited by 45
- 2022Discovering Objects that Can Movecited by 44
- 2024A Survey of Camouflaged Object Detection and Beyondcited by 37
- 2021Unsupervised Object Learning via Common Fatecited by 29
20 more
- 2022Mean Shift Mask Transformer for Unseen Object Instance Segmentationcited by 19
- 2021Unknown Object Segmentation from Stereo Imagescited by 16
- 2023Multi-Object Discovery by Low-Dimensional Object Motioncited by 16
- 2021RICE: Refining Instance Masks in Cluttered Environments with Graph Neural Networkscited by 15
- 2022A Simple and Powerful Global Optimization for Unsupervised Video Object Segmentationcited by 15
- 2022Motion-inductive Self-supervised Object Discovery in Videoscited by 14
- 2021The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memorycited by 13
- 2023MovingParts: Motion-based 3D Part Discovery in Dynamic Radiance Fieldcited by 12
- 2023Appearance-Based Refinement for Object-Centric Motion Segmentationcited by 11
- 2023Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object Segmentationcited by 10
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehiclecited by 8
- 2023DEVIAS: Learning Disentangled Video Representations of Action and Scenecited by 7
- 2023Online Unsupervised Video Object Segmentation via Contrastive Motion Clusteringcited by 6
- 2024On Moving Object Segmentation from Monocular Video with Transformerscited by 6
- 2021A topological solution to object segmentation and trackingcited by 4
- 2021RiWNet: A moving object instance segmentation Network being Robust in adverse Weather conditionscited by 2
- 2024MOD-UV: Learning Mobile Object Detectors from Unlabeled Videoscited by 2
- 2023Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentationcited by 1
- 2025Layered Motion Fusion: Lifting Motion Segmentation to 3D in Egocentric Videoscited by 0
- 2026MotionBits: Video Segmentation through Motion-Level Analysis of Rigid Bodiescited by 0
- 2026MotionBits: Video Segmentation through Motion-Level Analysis of Rigid Bodies6 Mar 2026
- 2025Layered Motion Fusion: Lifting Motion Segmentation to 3D in Egocentric Videos5 Jun 2025
- 2024On Moving Object Segmentation from Monocular Video with Transformers28 Nov 2024
- 2024A Survey of Camouflaged Object Detection and Beyond26 Aug 2024
- 2024MOD-UV: Learning Mobile Object Detectors from Unlabeled Videos23 May 2024
- 2023Appearance-Based Refinement for Object-Centric Motion Segmentation18 Dec 2023
- 2023DEVIAS: Learning Disentangled Video Representations of Action and Scene30 Nov 2023
- 2023Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object Segmentation29 Nov 2023
- 2023Multi-Object Discovery by Low-Dimensional Object Motion16 Jul 2023
- 2023Online Unsupervised Video Object Segmentation via Contrastive Motion Clustering21 Jun 2023
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehicle28 Apr 2023
- 2023Advances in Deep Concealed Scene Understanding21 Apr 2023
20 more
- 2023MovingParts: Motion-based 3D Part Discovery in Dynamic Radiance Field10 Mar 2023
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition22 Feb 2023
- 2023Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentation29 Jan 2023
- 2022Mean Shift Mask Transformer for Unseen Object Instance Segmentation21 Nov 2022
- 2022Motion-inductive Self-supervised Object Discovery in Videos1 Oct 2022
- 2022A Simple and Powerful Global Optimization for Unsupervised Video Object Segmentation19 Sep 2022
- 2022Segmenting Moving Objects via an Object-Centric Layered Representation5 Jul 2022
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video31 May 2022
- 2022Deformable Sprites for Unsupervised Video Decomposition14 Apr 2022
- 2022Discovering Objects that Can Move18 Mar 2022
- 2021NeuralDiff: Segmenting 3D objects that move in egocentric videos19 Oct 2021
- 2021Unsupervised Object Learning via Common Fate13 Oct 2021
- 2021Motion-aware Contrastive Video Representation Learning via Foreground-background Merging30 Sep 2021
- 2021RiWNet: A moving object instance segmentation Network being Robust in adverse Weather conditions4 Sep 2021
- 2021A topological solution to object segmentation and tracking5 Jul 2021
- 2021RICE: Refining Instance Masks in Cluttered Environments with Graph Neural Networks29 Jun 2021
- 2021The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memory4 May 2021
- 2021Opening up Open-World Tracking22 Apr 2021
- 2021Self-supervised Video Object Segmentation by Motion Grouping15 Apr 2021
- 2021Unknown Object Segmentation from Stereo Images11 Mar 2021
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
- 2022Deformable Sprites for Unsupervised Video Decompositioncited by 61
- 2021NeuralDiff: Segmenting 3D objects that move in egocentric videoscited by 57
- 2021Opening up Open-World Trackingcited by 50
- 2023Advances in Deep Concealed Scene Understandingcited by 47
- 2021Motion-aware Contrastive Video Representation Learning via Foreground-background Mergingcited by 45
- 2022Discovering Objects that Can Movecited by 44
- 2024A Survey of Camouflaged Object Detection and Beyondcited by 37
- 2021Unsupervised Object Learning via Common Fatecited by 29
12 most cited of 32 All 32 (JSON)
- 2026MotionBits: Video Segmentation through Motion-Level Analysis of Rigid Bodies6 Mar 2026
- 2025Layered Motion Fusion: Lifting Motion Segmentation to 3D in Egocentric Videos5 Jun 2025
- 2024On Moving Object Segmentation from Monocular Video with Transformers28 Nov 2024
- 2024A Survey of Camouflaged Object Detection and Beyond26 Aug 2024
- 2024MOD-UV: Learning Mobile Object Detectors from Unlabeled Videos23 May 2024
- 2023Appearance-Based Refinement for Object-Centric Motion Segmentation18 Dec 2023
- 2023DEVIAS: Learning Disentangled Video Representations of Action and Scene30 Nov 2023
- 2023Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object Segmentation29 Nov 2023
- 2023Multi-Object Discovery by Low-Dimensional Object Motion16 Jul 2023
- 2023Online Unsupervised Video Object Segmentation via Contrastive Motion Clustering21 Jun 2023
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehicle28 Apr 2023
- 2023Advances in Deep Concealed Scene Understanding21 Apr 2023
12 newest of 32 All 32 (JSON)