mlsanityData to 14 Oct 2026

Visual Objectification in Films: Towards a New AI Task for Video Interpretation

arXiv 2401.13296 ↗First posted 24 Jan 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

In film gender studies, the concept of 'male gaze' refers to the way the characters are portrayed on-screen as objects of desire rather than subjects. In this article, we introduce a novel video-interpretation task, to detect character objectification in films. The purpose is to reveal and quantify the usage of complex temporal patterns operated in cinema to produce the cognitive perception of objectification. We introduce the ObyGaze12 dataset, made of 1914 movie clips densely annotated by experts for objectification concepts identified in film studies and psychology. We evaluate recent vision models, show the feasibility of the task and where the challenges remain with concept bottleneck models. Our new dataset and code are made available to the community.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 43 of its 68 references that are in the map. First posted on arXiv 24 Jan 2024.

Builds on

43 of 68 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  3. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  4. 2021ViViT: A Video Vision Transformercited by 1,620
  5. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  6. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  7. 2020Concept Bottleneck Modelscited by 1,032
  8. 2022MaPLe: Multi-modal Prompt Learningcited by 687
  9. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
  10. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
  11. 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 321
  12. 2022Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classificationcited by 312
31 more
  1. 2022Post-hoc Concept Bottleneck Modelscited by 293
  2. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
  3. 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 274
  4. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
  5. 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
  6. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
  7. 2016Movie Descriptioncited by 181
  8. 2023Visual Prompt Multi-Modal Trackingcited by 142
  9. 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
  10. 2019Fine-Grained Analysis of Propaganda in News Articlescited by 133
  11. 2022CLIP is Also an Efficient Segmenter: A Text-Driven Approach for Weakly Supervised Semantic Segmentationcited by 118
  12. 2021MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptionscited by 108
  13. 2020Condensed Movies: Story Based Retrieval with Contextual Embeddingscited by 95
  14. 2022PromptCAL: Contrastive Affinity Learning via Auxiliary Prompts for Generalized Novel Category Discoverycited by 87
  15. 2021A Survey on Bias in Visual Datasetscited by 84
  16. 2017Automatic Understanding of Image and Video Advertisementscited by 68
  17. 2017MovieGraphs: Towards Understanding Human-Centric Situations from Videoscited by 67
  18. 2022Concept Embedding Models: Beyond the Accuracy-Explainability Trade-Offcited by 61
  19. 2023AutoAD: Movie Description in Contextcited by 50
  20. 2023AutoAD II: The Sequel -- Who, When, and What in Movie Audio Descriptioncited by 49
  21. 2020"Call me sexist, but...": Revisiting Sexism Detection Using Psychological Scales and Adversarial Samplescited by 48
  22. 2023SkinCon: A skin disease dataset densely annotated by domain experts for fine-grained model debugging and analysiscited by 44
  23. 2022VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrievalcited by 36
  24. 2022To Aggregate or Not? Learning with Separate Noisy Labelscited by 29
  25. 2021MovieCuts: A New Dataset and Benchmark for Cut Type Recognitioncited by 26
  26. 2020Learning Interactions and Relationships between Movie Characterscited by 22
  27. 2022MovieCLIP: Visual Scene Recognition in Moviescited by 16
  28. 2023Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Moviescited by 4
  29. 2020Computational appraisal of gender representativeness in popular moviescited by 3
  30. 2021TrUMAn: Trope Understanding in Movies and Animationscited by 3
  31. 2022Symbolic image detection using scene and knowledge graphscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

  1. 2025Looking Beyond the Obvious: A Survey on Abstract Concept Recognition for Video Understandingcited by 3
  2. 2024For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archivescited by 1
  3. 2025MObyGaze: a film dataset of multimodal objectification densely annotated by expertscited by 1
  4. 2025Leveraging multimodal explanatory annotations for video interpretation with Modality Specific Datasetcited by 0