mlsanityData to 7 Oct 2026

An Audio-Visual Dataset and Deep Learning Frameworks for Crowded Scene Classification

arXiv 2112.09172 ↗First posted 16 Dec 2021cs.CV cs.LG eess.IVcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper presents a task of audio-visual scene classification (SC) where input videos are classified into one of five real-life crowded scenes: 'Riot', 'Noise-Street', 'Firework-Event', 'Music-Event', and 'Sport-Atmosphere'. To this end, we firstly collect an audio-visual dataset (videos) of these five crowded contexts from Youtube (in-the-wild scenes). Then, a wide range of deep learning frameworks are proposed to deploy either audio or visual input data independently. Finally, results obtained from high-performed deep learning frameworks are fused to achieve the best accuracy score. Our experimental results indicate that audio and visual input factors independently contribute to the SC task's performance. Significantly, an ensemble of deep learning frameworks exploring either audio or visual input data can achieve the best accuracy of 95.7%.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 16 Dec 2021.

Builds on

13 of 29 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  6. 2018Real-world Anomaly Detection in Surveillance Videoscited by 570
  7. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 235
  8. 2017Learning from Between-class Examples for Deep Sound Recognitioncited by 53
  9. 2020Robust Acoustic Scene Classification using a Multi-Spectrogram Encoder-Decoder Frameworkcited by 8
  10. 2021Multi-view Audio and Music Classificationcited by 8
  11. 2020Deep Feature Embedding and Hierarchical Classification for Audio Scene Classificationcited by 6
  12. 2020Sound Context Classification Basing on Join Learning Model and Multi-Spectrogram Featurescited by 5
1 more
  1. 2021A Low-Compexity Deep Learning Framework For Acoustic Scene Classificationcited by 3

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 1; 2024: 1.

5 papers.

  1. 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
  2. 2022Wider or Deeper Neural Network Architecture for Acoustic Scene Classification with Mismatched Recording Devicescited by 7
  3. 2022Remote Sensing Image Classification using Transfer Learning and Attention Based Deep Neural Networkcited by 1
  4. 2022Robust, General, and Low Complexity Acoustic Scene Classification Systems and An Effective Visualization for Presenting a Sound Scene Contextcited by 1
  5. 2024A Toolchain for Comprehensive Audio/Video Analysis Using Deep Learning Based Multimodal Approach (A use case of riot or violent context detection)cited by 0