WSLLN: Weakly Supervised Natural Language Localization Networks
Not on the map. Why?
Abstract (arXiv)
We propose weakly supervised language localization networks (WSLLN) to detect events in long, untrimmed videos given language queries. To learn the correspondence between visual segments and texts, most previous methods require temporal coordinates (start and end times) of events for training, which leads to high costs of annotation. WSLLN relieves the annotation burden by training with only video-sentence pairs without accessing to temporal locations of events. With a simple end-to-end structure, WSLLN measures segment-text consistency and conducts segment selection (conditioned on the text) simultaneously. Results from both are merged and optimized as a video-sentence matching problem. Experiments on ActivityNet Captions and DiDeMo demonstrate that WSLLN achieves state-of-the-art performance.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 11; 2024: 2; 2025: 1; 2026: 5.
36 papers.
Sort:
By area:
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 133
- 2021A Closer Look at Temporal Sentence Grounding in Videos: Dataset and Metriccited by 42
- 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisationcited by 39
- 2021Weakly Supervised Temporal Adjacent Network for Language Groundingcited by 37
- 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
- 2021Zero-shot Natural Language Video Localizationcited by 34
- 2021A Survey on Temporal Sentence Grounding in Videoscited by 29
- 2022Language-free Training for Zero-shot Video Groundingcited by 22
- 2022Video Moment Retrieval from Text Queries via Single Frame Annotationcited by 19
- 2023Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal Groundingcited by 19
- 2023A Survey on Video Moment Localizationcited by 18
- 2023Grounding-Prompter: Prompting LLM with Multimodal Information for Temporal Sentence Grounding in Long Videoscited by 14
24 more
- 2023SCANet: Scene Complexity Aware Network for Weakly-Supervised Video Moment Retrievalcited by 13
- 2021Towards Debiasing Temporal Sentence Grounding in Videocited by 11
- 2022A Closer Look at Debiased Temporal Sentence Grounding in Videos: Dataset, Metric, and Approachcited by 11
- 2022Weakly-Supervised Temporal Article Groundingcited by 11
- 2021Video and Text Matching with Conditioned Embeddingscited by 10
- 2023D3G: Exploring Gaussian Prior for Temporal Sentence Grounding with Glance Annotationcited by 8
- 2026Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspectivecited by 8
- 2021Self-supervised Learning for Semi-supervised Temporal Language Groundingcited by 7
- 2023Counterfactual Cross-modality Reasoning for Weakly Supervised Video Moment Localizationcited by 7
- 2021A Survey on Natural Language Video Localizationcited by 6
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2023Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Momentcited by 4
- 2023EtC: Temporal Boundary Expand then Clarify for Weakly Supervised Video Grounding with Multimodal Large Language Modelcited by 4
- 2023Commonsense for Zero-Shot Natural Language Video Localizationcited by 4
- 2022Fine-grained Semantic Alignment Network for Weakly Supervised Temporal Language Groundingcited by 3
- 2021Multi-scale 2D Representation Learning for weakly-supervised moment retrievalcited by 2
- 2025Weakly Supervised Temporal Sentence Grounding via Positive Sample Miningcited by 2
- 2022Multi-Scale Self-Contrastive Learning with Hard Negative Mining for Weakly-Supervised Query-based Video Groundingcited by 1
- 2024Hybrid-Learning Video Moment Retrieval across Multi-Domain Labelscited by 1
- 2026DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Groundingcited by 1
- 2023Focusing On Targets For Improving Weakly Supervised Visual Groundingcited by 0
- 2024AutoTVG: A New Vision-language Pre-training Paradigm for Temporal Video Groundingcited by 0
- 2026Multi-proposal Collaboration and Multi-task Training for Weakly-supervised Video Moment Retrievalcited by 0
- 2026What You Ask is What You Ground: Bridging Question Intent to Temporal Evidence for Grounded VideoQAcited by 0
- 2026What You Ask is What You Ground: Bridging Question Intent to Temporal Evidence for Grounded VideoQA16 Aug 2026
- 2026DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding1 Jul 2026
- 2026Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective26 May 2026
- 2026Multi-proposal Collaboration and Multi-task Training for Weakly-supervised Video Moment Retrieval14 May 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2025Weakly Supervised Temporal Sentence Grounding via Positive Sample Mining10 May 2025
- 2024AutoTVG: A New Vision-language Pre-training Paradigm for Temporal Video Grounding11 Jun 2024
- 2024Hybrid-Learning Video Moment Retrieval across Multi-Domain Labels3 Jun 2024
- 2023Commonsense for Zero-Shot Natural Language Video Localization29 Dec 2023
- 2023Grounding-Prompter: Prompting LLM with Multimodal Information for Temporal Sentence Grounding in Long Videos28 Dec 2023
- 2023EtC: Temporal Boundary Expand then Clarify for Weakly Supervised Video Grounding with Multimodal Large Language Model5 Dec 2023
- 2023SCANet: Scene Complexity Aware Network for Weakly-Supervised Video Moment Retrieval8 Oct 2023
24 more
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answering4 Sep 2023
- 2023Counterfactual Cross-modality Reasoning for Weakly Supervised Video Moment Localization10 Aug 2023
- 2023D3G: Exploring Gaussian Prior for Temporal Sentence Grounding with Glance Annotation8 Aug 2023
- 2023Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Moment5 Jul 2023
- 2023A Survey on Video Moment Localization13 Jun 2023
- 2023Focusing On Targets For Improving Weakly Supervised Visual Grounding22 Feb 2023
- 2023Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal Grounding22 Jan 2023
- 2022Language-free Training for Zero-shot Video Grounding24 Oct 2022
- 2022Weakly-Supervised Temporal Article Grounding22 Oct 2022
- 2022Fine-grained Semantic Alignment Network for Weakly Supervised Temporal Language Grounding21 Oct 2022
- 2022Video Moment Retrieval from Text Queries via Single Frame Annotation20 Apr 2022
- 2022A Closer Look at Debiased Temporal Sentence Grounding in Videos: Dataset, Metric, and Approach10 Mar 2022
- 2022Multi-Scale Self-Contrastive Learning with Hard Negative Mining for Weakly-Supervised Query-based Video Grounding8 Mar 2022
- 2022Temporal Sentence Grounding in Videos: A Survey and Future Directions20 Jan 2022
- 2021Towards Debiasing Temporal Sentence Grounding in Video8 Nov 2021
- 2021Multi-scale 2D Representation Learning for weakly-supervised moment retrieval4 Nov 2021
- 2021Video and Text Matching with Conditioned Embeddings21 Oct 2021
- 2021Self-supervised Learning for Semi-supervised Temporal Language Grounding23 Sep 2021
- 2021A Survey on Temporal Sentence Grounding in Videos16 Sep 2021
- 2021Zero-shot Natural Language Video Localization29 Aug 2021
- 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisation23 Jul 2021
- 2021Weakly Supervised Temporal Adjacent Network for Language Grounding30 Jun 2021
- 2021A Survey on Natural Language Video Localization1 Apr 2021
- 2021A Closer Look at Temporal Sentence Grounding in Videos: Dataset and Metric22 Jan 2021
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 133
- 2021A Closer Look at Temporal Sentence Grounding in Videos: Dataset and Metriccited by 42
- 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisationcited by 39
- 2021Weakly Supervised Temporal Adjacent Network for Language Groundingcited by 37
- 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
- 2021Zero-shot Natural Language Video Localizationcited by 34
- 2021A Survey on Temporal Sentence Grounding in Videoscited by 29
- 2022Language-free Training for Zero-shot Video Groundingcited by 22
- 2022Video Moment Retrieval from Text Queries via Single Frame Annotationcited by 19
- 2023Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal Groundingcited by 19
- 2023A Survey on Video Moment Localizationcited by 18
- 2023SCANet: Scene Complexity Aware Network for Weakly-Supervised Video Moment Retrievalcited by 13
12 most cited of 33 All 33 (JSON)
- 2026What You Ask is What You Ground: Bridging Question Intent to Temporal Evidence for Grounded VideoQA16 Aug 2026
- 2026DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding1 Jul 2026
- 2026Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective26 May 2026
- 2026Multi-proposal Collaboration and Multi-task Training for Weakly-supervised Video Moment Retrieval14 May 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2025Weakly Supervised Temporal Sentence Grounding via Positive Sample Mining10 May 2025
- 2024Hybrid-Learning Video Moment Retrieval across Multi-Domain Labels3 Jun 2024
- 2023Commonsense for Zero-Shot Natural Language Video Localization29 Dec 2023
- 2023SCANet: Scene Complexity Aware Network for Weakly-Supervised Video Moment Retrieval8 Oct 2023
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answering4 Sep 2023
- 2023Counterfactual Cross-modality Reasoning for Weakly Supervised Video Moment Localization10 Aug 2023
- 2023D3G: Exploring Gaussian Prior for Temporal Sentence Grounding with Glance Annotation8 Aug 2023
12 newest of 33 All 33 (JSON)