Naver at ActivityNet Challenge 2019 -- Task B Active Speaker Detection (AVA)
Not on the map. Why?
Abstract (arXiv)
This report describes our submission to the ActivityNet Challenge at CVPR 2019. We use a 3D convolutional neural network (CNN) based front-end and an ensemble of temporal convolution and LSTM classifiers to predict whether a visible person is speaking or not. Our results show significant improvements over the baseline on the AVA-ActiveSpeaker dataset.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 11; 2023: 2; 2024: 4.
26 papers.
Sort:
- 2021Sub-word Level Lip Reading With Visual Attentioncited by 63
- 2021MAAS: Multi-modal Assignation for Active Speaker Detectioncited by 36
- 2021How to Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wildcited by 31
- 2022Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detectioncited by 30
- 2021UniCon: Unified Context Network for Robust Active Speaker Detectioncited by 28
- 2022End-to-End Active Speaker Detectioncited by 25
- 2021Look Who's Talking: Active Speaker Detection in the Wildcited by 21
- 2022Look&Listen: Multi-Modal Correlation Learning for Active Speaker Detection and Speech Enhancementcited by 20
- 2022Rethinking Audio-visual Synchronization for Active Speaker Detectioncited by 9
- 2022Using Active Speaker Faces for Diarization in TV showscited by 7
- 2022LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videoscited by 6
- 2023WASD: A Wilder Active Speaker Detection Datasetcited by 6
14 more
- 2024BIAS: A Body-based Interpretable Active Speaker Approachcited by 5
- 2024ASDnB: Merging Face with Body Cues For Robust Active Speaker Detectioncited by 5
- 2021FaVoA: Face-Voice Association Favours Ambiguous Speaker Detectioncited by 4
- 2021Learning Spatial-Temporal Graphs for Active Speaker Detectioncited by 4
- 2022Audio-Visual Activity Guided Cross-Modal Identity Association for Active Speaker Detectioncited by 4
- 2021Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-based Multimodal Fusioncited by 3
- 2022Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detectioncited by 3
- 2021PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilitiescited by 2
- 2022UniCon+: ICTCAS-UCAS Submission to the AVA-ActiveSpeaker Task at ActivityNet Challenge 2022cited by 2
- 2022End-To-End Audiovisual Feature Fusion for Active Speaker Detectioncited by 1
- 2022Unsupervised active speaker detection in media content using cross-modal informationcited by 1
- 2023Leveraging Visual Supervision for Array-based Active Speaker Detection and Localizationcited by 1
- 2024Audio-Visual Talker Localization in Video for Spatial Sound Reproductioncited by 0
- 2024FabuLight-ASD: Unveiling Speech Activity via Body Languagecited by 0
- 2024ASDnB: Merging Face with Body Cues For Robust Active Speaker Detection11 Dec 2024
- 2024BIAS: A Body-based Interpretable Active Speaker Approach6 Dec 2024
- 2024FabuLight-ASD: Unveiling Speech Activity via Body Language20 Nov 2024
- 2024Audio-Visual Talker Localization in Video for Spatial Sound Reproduction1 Jun 2024
- 2023Leveraging Visual Supervision for Array-based Active Speaker Detection and Localization21 Dec 2023
- 2023WASD: A Wilder Active Speaker Detection Dataset9 Mar 2023
- 2022Audio-Visual Activity Guided Cross-Modal Identity Association for Active Speaker Detection1 Dec 2022
- 2022LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos12 Oct 2022
- 2022Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection3 Oct 2022
- 2022Unsupervised active speaker detection in media content using cross-modal information24 Sep 2022
- 2022End-To-End Audiovisual Feature Fusion for Active Speaker Detection27 Jul 2022
- 2022Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection15 Jul 2022
14 more
- 2022UniCon+: ICTCAS-UCAS Submission to the AVA-ActiveSpeaker Task at ActivityNet Challenge 202222 Jun 2022
- 2022Rethinking Audio-visual Synchronization for Active Speaker Detection21 Jun 2022
- 2022Using Active Speaker Faces for Diarization in TV shows30 Mar 2022
- 2022End-to-End Active Speaker Detection27 Mar 2022
- 2022Look&Listen: Multi-Modal Correlation Learning for Active Speaker Detection and Speech Enhancement4 Mar 2022
- 2021Learning Spatial-Temporal Graphs for Active Speaker Detection2 Dec 2021
- 2021Sub-word Level Lip Reading With Visual Attention14 Oct 2021
- 2021PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilities27 Sep 2021
- 2021FaVoA: Face-Voice Association Favours Ambiguous Speaker Detection1 Sep 2021
- 2021Look Who's Talking: Active Speaker Detection in the Wild17 Aug 2021
- 2021UniCon: Unified Context Network for Robust Active Speaker Detection5 Aug 2021
- 2021How to Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wild7 Jun 2021
- 2021Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-based Multimodal Fusion7 Jun 2021
- 2021MAAS: Multi-modal Assignation for Active Speaker Detection11 Jan 2021
- 2021Sub-word Level Lip Reading With Visual Attentioncited by 63
- 2021MAAS: Multi-modal Assignation for Active Speaker Detectioncited by 36
- 2021How to Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wildcited by 31
- 2022Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detectioncited by 30
- 2021UniCon: Unified Context Network for Robust Active Speaker Detectioncited by 28
- 2022End-to-End Active Speaker Detectioncited by 25
- 2021Look Who's Talking: Active Speaker Detection in the Wildcited by 21
- 2022Look&Listen: Multi-Modal Correlation Learning for Active Speaker Detection and Speech Enhancementcited by 20
- 2022Rethinking Audio-visual Synchronization for Active Speaker Detectioncited by 9
- 2022Using Active Speaker Faces for Diarization in TV showscited by 7
- 2022LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videoscited by 6
- 2023WASD: A Wilder Active Speaker Detection Datasetcited by 6
12 most cited of 26 All 26 (JSON)
- 2024ASDnB: Merging Face with Body Cues For Robust Active Speaker Detection11 Dec 2024
- 2024BIAS: A Body-based Interpretable Active Speaker Approach6 Dec 2024
- 2024FabuLight-ASD: Unveiling Speech Activity via Body Language20 Nov 2024
- 2024Audio-Visual Talker Localization in Video for Spatial Sound Reproduction1 Jun 2024
- 2023Leveraging Visual Supervision for Array-based Active Speaker Detection and Localization21 Dec 2023
- 2023WASD: A Wilder Active Speaker Detection Dataset9 Mar 2023
- 2022Audio-Visual Activity Guided Cross-Modal Identity Association for Active Speaker Detection1 Dec 2022
- 2022LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos12 Oct 2022
- 2022Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection3 Oct 2022
- 2022Unsupervised active speaker detection in media content using cross-modal information24 Sep 2022
- 2022End-To-End Audiovisual Feature Fusion for Active Speaker Detection27 Jul 2022
- 2022Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection15 Jul 2022
12 newest of 26 All 26 (JSON)