Unsupervised Moving Object Detection via Contextual Information Separation
Not on the map. Why?
Abstract (arXiv)
We propose an adversarial contextual model for detecting moving objects in images. A deep neural network is trained to predict the optical flow in a region using information from everywhere else but that region (context), while another network attempts to make such context as uninformative as possible. The result is a model where hypotheses naturally compete with no need for explicit regularization or hyper-parameter tuning. Although our method requires no supervision whatsoever, it outperforms several methods that are pre-trained on large annotated datasets. Our model can be thought of as a generalization of classical variational generative region-based segmentation, but in a way that avoids explicit regularization or solution of partial differential equations at run-time.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 22; 2023: 20; 2024: 5; 2025: 8; 2026: 5.
72 papers.
Sort:
By area:
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
- 2022NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenescited by 71
- 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
- 2022Deformable Sprites for Unsupervised Video Decompositioncited by 61
- 2022Breaking the "Object" in Video Object Segmentationcited by 48
- 2021The Emergence of Objectness: Learning Zero-Shot Segmentation from Videoscited by 45
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motioncited by 42
38 more
- 2023VideoCutLER: Surprisingly Simple Unsupervised Video Instance Segmentationcited by 36
- 2025Segment Any Motion in Videoscited by 34
- 2022EM-driven unsupervised learning for efficient motion segmentationcited by 33
- 2021Unsupervised Object Learning via Common Fatecited by 29
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2022OGC: Unsupervised 3D Object Segmentation from Rigid Dynamics of Point Cloudscited by 24
- 2021Learning Representational Invariances for Data-Efficient Action Recognitioncited by 22
- 2022Unsupervised Multi-View Object Segmentation Using Radiance Field Propagationcited by 22
- 2021Learning Semantic-Aware Dynamics for Video Predictioncited by 21
- 2022FUN-SIS: a Fully UNsupervised approach for Surgical Instrument Segmentationcited by 20
- 2022MOVE: Unsupervised Movable Object Segmentation and Detectioncited by 20
- 2023Semantics Meets Temporal Correspondence: Self-supervised Object-centric Learning in Videoscited by 20
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2022Unsupervised Multi-object Segmentation by Predicting Probable Motion Patternscited by 19
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
- 2023Multi-Object Discovery by Low-Dimensional Object Motioncited by 16
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Surveycited by 16
- 2022A Simple and Powerful Global Optimization for Unsupervised Video Object Segmentationcited by 15
- 2023Bootstrapping Objectness from Videos by Relaxed Common Fate and Visual Groupingcited by 15
- 2022Motion-inductive Self-supervised Object Discovery in Videoscited by 14
- 2023UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything Modelcited by 14
- 2025Learning segmentation from point trajectoriescited by 14
- 2024DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentationcited by 13
- 2021Flow-Guided Video Inpainting with Scene Templatescited by 12
- 2023Appearance-Based Refinement for Object-Centric Motion Segmentationcited by 11
- 2023JacobiNeRF: NeRF Shaping with Mutual Information Gradientscited by 10
- 2023Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object Segmentationcited by 10
- 2022The Right Spin: Learning Object Motion from Rotation-Compensated Flow Fieldscited by 8
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehiclecited by 8
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-trainingcited by 8
- 2022In-N-Out Generative Learning for Dense Unsupervised Video Segmentationcited by 7
- 2023PaintSeg: Training-free Segmentation via Paintingcited by 7
- 2023Un-EVIMO: Unsupervised Event-Based Independent Motion Segmentationcited by 7
- 2023Online Unsupervised Video Object Segmentation via Contrastive Motion Clusteringcited by 6
- 2024On Moving Object Segmentation from Monocular Video with Transformerscited by 6
- 2023Dynamic Object Removal for Effective Slamcited by 3
- 2023FODVid: Flow-guided Object Discovery in Videoscited by 3
- 2023Segmenting the motion components of a video: A long-term unsupervised modelcited by 2
50 most cited of 72 All 72 (JSON)
- 2026Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision30 Sep 2026
- 2026Object Concepts Emerge from Motion3 Sep 2026
- 2026SUMO: Segment and Track Any Motion with Nonlinear State Space Models29 Jun 2026
- 2026GMOS: Grounding Moving Object Segmentation in 3D Space and Time28 May 2026
- 2026VVitCutLER: Towards Unsupervised Object Detection and Segmentation in Videos11 May 2026
- 2025Dialectics for Artificial Intelligence19 Dec 2025
- 2025Boosting Unsupervised Video Instance Segmentation with Automatic Quality-Guided Self-Training7 Dec 2025
- 2025The Dynamic Prior: Understanding 3D Structures for Casual Dynamic Videos5 Dec 2025
- 2025Moving Object Detection from Moving Camera Using Focus of Expansion Likelihood and Segmentation18 Jul 2025
- 2025EV-LayerSegNet: Self-supervised Motion Segmentation using Event Cameras7 Jun 2025
- 2025Object Concepts Emerge from Motion27 May 2025
- 2025Segment Any Motion in Videos28 Mar 2025
38 more
- 2025Learning segmentation from point trajectories21 Jan 2025
- 2024Video Decomposition Prior: A Methodology to Decompose Videos into Layers6 Dec 2024
- 2024On Moving Object Segmentation from Monocular Video with Transformers28 Nov 2024
- 2024Unsupervised Part Discovery via Dual Representation Alignment15 Aug 2024
- 2024FADE: A Dataset for Detecting Falling Objects around Buildings in Video11 Aug 2024
- 2024DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentation3 Jun 2024
- 2023Appearance-Based Refinement for Object-Centric Motion Segmentation18 Dec 2023
- 2023Un-EVIMO: Unsupervised Event-Based Independent Motion Segmentation30 Nov 2023
- 2023Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object Segmentation29 Nov 2023
- 2023Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey19 Oct 2023
- 2023Co-Learning Semantic-aware Unsupervised Segmentation for Pathological Image Registration17 Oct 2023
- 2023Segmenting the motion components of a video: A long-term unsupervised model2 Oct 2023
- 2023VideoCutLER: Surprisingly Simple Unsupervised Video Instance Segmentation28 Aug 2023
- 2023LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training22 Aug 2023
- 2023Semantics Meets Temporal Correspondence: Self-supervised Object-centric Learning in Videos19 Aug 2023
- 2023Multi-Object Discovery by Low-Dimensional Object Motion16 Jul 2023
- 2023FODVid: Flow-guided Object Discovery in Videos10 Jul 2023
- 2023Online Unsupervised Video Object Segmentation via Contrastive Motion Clustering21 Jun 2023
- 2023PaintSeg: Training-free Segmentation via Painting30 May 2023
- 2023UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything Model22 May 2023
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehicle28 Apr 2023
- 2023HabitatDyn Dataset: Dynamic Object Detection to Kinematics Estimation21 Apr 2023
- 2023Bootstrapping Objectness from Videos by Relaxed Common Fate and Visual Grouping17 Apr 2023
- 2023Divided Attention: Unsupervised Multi-Object Discovery with Contextually Separated Slots4 Apr 2023
- 2023JacobiNeRF: NeRF Shaping with Mutual Information Gradients1 Apr 2023
- 2023Dynamic Object Removal for Effective Slam20 Mar 2023
- 2022Improving Unsupervised Video Object Segmentation with Motion-Appearance Synergy17 Dec 2022
- 2022Breaking the "Object" in Video Object Segmentation12 Dec 2022
- 2022β-Multivariational Autoencoder for Entangled Representation Learning in Video Frames22 Nov 2022
- 2022Unsupervised Multi-object Segmentation by Predicting Probable Motion Patterns21 Oct 2022
- 2022MOVE: Unsupervised Movable Object Segmentation and Detection14 Oct 2022
- 2022OGC: Unsupervised 3D Object Segmentation from Rigid Dynamics of Point Clouds10 Oct 2022
- 2022Unsupervised Multi-View Object Segmentation Using Radiance Field Propagation2 Oct 2022
- 2022Motion-inductive Self-supervised Object Discovery in Videos1 Oct 2022
- 2022A Simple and Powerful Global Optimization for Unsupervised Video Object Segmentation19 Sep 2022
- 2022NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes19 Sep 2022
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut1 Sep 2022
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wild19 Jul 2022
50 newest of 72 All 72 (JSON)
- 2021Unsupervised Semantic Segmentation by Contrasting Object Mask Proposalscited by 190
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2022Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videoscited by 139
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
- 2022NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenescited by 71
- 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
- 2022Deformable Sprites for Unsupervised Video Decompositioncited by 61
- 2022Breaking the "Object" in Video Object Segmentationcited by 48
- 2021The Emergence of Objectness: Learning Zero-Shot Segmentation from Videoscited by 45
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motioncited by 42
12 most cited of 71 All 71 (JSON)
- 2026Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision30 Sep 2026
- 2026Object Concepts Emerge from Motion3 Sep 2026
- 2026SUMO: Segment and Track Any Motion with Nonlinear State Space Models29 Jun 2026
- 2026GMOS: Grounding Moving Object Segmentation in 3D Space and Time28 May 2026
- 2026VVitCutLER: Towards Unsupervised Object Detection and Segmentation in Videos11 May 2026
- 2025Dialectics for Artificial Intelligence19 Dec 2025
- 2025Boosting Unsupervised Video Instance Segmentation with Automatic Quality-Guided Self-Training7 Dec 2025
- 2025The Dynamic Prior: Understanding 3D Structures for Casual Dynamic Videos5 Dec 2025
- 2025Moving Object Detection from Moving Camera Using Focus of Expansion Likelihood and Segmentation18 Jul 2025
- 2025EV-LayerSegNet: Self-supervised Motion Segmentation using Event Cameras7 Jun 2025
- 2025Object Concepts Emerge from Motion27 May 2025
- 2025Segment Any Motion in Videos28 Mar 2025
12 newest of 71 All 71 (JSON)