mlsanityData to 7 Oct 2026

DensFiLM: Density-Conditioned Video Saliency for Crowd Scenes

arXiv 2607.25465 ↗First posted 28 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video saliency models typically apply a single fixation strategy across crowd scenes, despite systematic changes in attention with crowd density. Sparse scenes encourage tracking individuals, whereas dense scenes shift attention toward collective motion and scene-level landmarks. We introduce DensFiLM, a density-conditioned video saliency model that inserts a lightweight Feature-wise Linear Modulation layer at the bottleneck of a Video Swin Transformer. A learned density embedding produces channel-wise scale and shift parameters, allowing the decoder to reconstruct saliency from features selected for each density regime. The module adds only ~100K parameters and can use either CrowdFix density labels or the model's own density prediction. On CrowdFix, DensFiLM achieves mean NSS 1.434 and CC 0.517 over four seeds, improving over ACLNet by 14.7% and 14.9%, respectively, while predicted-density conditioning matches oracle-label performance. Ablations show that explicit RAFT optical flow and larger temporal and social-force extensions provide no further improvement in this setting. In a centre-prior-subtraction diagnostic, density conditioning yields an NSS gain of 0.462 over the unconditioned backbone, compared with 0.124 under standard evaluation. These results show that lightweight bottleneck conditioning provides a more effective inductive bias than increasing model capacity for crowd-video saliency. Our code is available at https://github.com/aniskhan25/crowdfix-saliency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

13 of 21 references.

References · 13

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
  6. 2018CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenescited by 267
  7. 2016What do different evaluation metrics tell us about saliency models?cited by 184
  8. 2016Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Modelcited by 91
  9. 2018Revisiting Video Saliency: A Large-scale Benchmark and a New Modelcited by 66
  10. 2019TASED-Net: Temporally-Aggregating Spatial Encoder-Decoder Network for Video Saliency Detectioncited by 58
  11. 2024SalFoM: Dynamic Saliency Prediction with Video Foundation Modelscited by 9
  12. 2022GASP: Gated Attention For Saliency Predictioncited by 2
1 more
  1. 2019CrowdFix: An Eyetracking Dataset of Real Life Crowd Videoscited by 1

Built on by

Not cited yet.