TransFlow: Motion Knowledge Transfer from Video Diffusion Models to Video Salient Object Detection
On the map: Diffusion models → Video generation
Abstract (arXiv)
Video salient object detection (SOD) relies on motion cues to distinguish salient objects from backgrounds, but training such models is limited by scarce video datasets compared to abundant image datasets. Existing approaches that use spatial transformations to create video sequences from static images fail for motion-guided tasks, as these transformations produce unrealistic optical flows that lack semantic understanding of motion. We present TransFlow, which transfers motion knowledge from pre-trained video diffusion models to generate realistic training data for video SOD. Video diffusion models have learned rich semantic motion priors from large-scale video data, understanding how different objects naturally move in real scenes. TransFlow leverages this knowledge to generate semantically-aware optical flows from static images, where objects exhibit natural motion patterns while preserving spatial boundaries and temporal coherence. Our method achieves improved performance across multiple benchmarks, demonstrating effective motion knowledge transfer.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 44 of its 67 references that are in the map. First posted on arXiv 26 Jul 2025.
Builds on
44 of 67 references.
Closest ancestors · 3
Same direction, newest first
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models28 Nov
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models7 Nov
Other references · 41
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
29 more
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2019Video Object Segmentation using Space-Time Memory Networkscited by 438
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
- 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
- 2016Learning Video Object Segmentation from Static Imagescited by 151
- 2020Suppress and Balance: A Simple Gated Network for Salient Object Detectioncited by 126
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2020STEm-Seg: Spatio-temporal Embeddings for Instance Segmentation in Videoscited by 121
- 2020Kernelized Memory Network for Video Object Segmentationcited by 111
- 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
- 2019Motion Guided Attention for Video Salient Object Detectioncited by 72
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2020Making a Case for 3D Convolutions for Object Segmentation in Videoscited by 56
- 2022A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detectioncited by 51
- 2017Video Salient Object Detection via Fully Convolutional Networkscited by 46
- 2022Hierarchical Feature Alignment Network for Unsupervised Video Object Segmentationcited by 37
- 2020Learning Discriminative Feature with CRF for Unsupervised Video Object Segmentationcited by 36
- 2022Treating Motion as Option to Reduce Motion Dependency in Unsupervised Video Object Segmentationcited by 35
- 2022Unsupervised Video Object Segmentation via Prototype Memory Networkcited by 30
- 2023Guided Slot Attention for Unsupervised Video Object Segmentationcited by 19
- 2022Dual Prototype Attention for Unsupervised Video Object Segmentationcited by 14
- 2021Video Salient Object Detection via Contrastive Features and Attention Modulescited by 13
- 2023SimulFlow: Simultaneously Extracting Feature and Identifying Target for Unsupervised Video Object Segmentationcited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Transforming Static Images Using Generative Models for Video Salient Object Detection
- 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models
- 2025MotionFlow:Learning Implicit Motion Flow for Complex Camera Trajectory Control in Video Generation
- 2026Interpretable Motion-Attentive Maps: Spatio-Temporally Localizing Concepts in Video Diffusion Transformers
- 2026Moaw: Unleashing Motion Awareness for Video Diffusion Models
- 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer
- 2026MotionAdapter: Video Motion Transfer via Content-Aware Attention Customization
- 2024Animate Your Motion: Turning Still Images into Dynamic Videos