Fine-grained Activity Recognition in Baseball Videos
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce a challenging new dataset, MLB-YouTube, designed for fine-grained activity detection. The dataset contains two settings: segmented video classification as well as activity detection in continuous videos. We experimentally compare various recognition approaches capturing temporal structure in activity videos, by classifying segmented videos and extending those approaches to continuous videos. We also compare models on the extremely difficult task of predicting pitch speed and pitch type from broadcast baseball videos. We find that learning temporal structure is valuable for fine-grained activity recognition.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 3; 2024: 3; 2025: 4; 2026: 1.
20 papers.
Sort:
By area:
- 2024FineParser: A Fine-grained Spatio-temporal Action Parser for Human-centric Action Quality Assessmentcited by 25
- 2021Recognizing Actions in Videos from Unseen Viewpointscited by 18
- 2022Exploring Fine-Grained Audiovisual Categorization with the SSW60 Datasetcited by 12
- 2023Tubelet-Contrastive Self-Supervision for Video-Efficient Generalizationcited by 12
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2025SoccerMaster: A Vision Foundation Model for Soccer Understandingcited by 10
- 2022Automatic Concept Extraction for Concept Bottleneck-based Video Classificationcited by 8
- 2022Weakly-Supervised Temporal Action Detection for Fine-Grained Videos with Hierarchical Atomic Actionscited by 8
- 2021Few-Shot Fine-Grained Action Recognition via Bidirectional Attention and Contrastive Meta-Learningcited by 7
- 20243D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approachcited by 7
- 2022Fine-grained Activities of People Worldwidecited by 4
- 2024LocoMotion: Learning Motion-Focused Video-Language Representationscited by 4
8 more
- 2023Fine-grained Action Analysis: A Multi-modality and Multi-task Dataset of Figure Skatingcited by 3
- 2025EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgerycited by 3
- 2021Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understandingcited by 2
- 2022Recent Trends in 2D Object Detection and Applications in Video Event Recognitioncited by 0
- 2022How Do You Do It? Fine-Grained Action Understanding with Pseudo-Adverbscited by 0
- 2025VIFSS: View-Invariant and Figure Skating-Specific Pose Representation Learning for Temporal Action Segmentationcited by 0
- 2025Focus on What Matters: Constraining Spatial-Temporal Attention via Action-Units for Noise-Resilient AQAcited by 0
- 2026Event-based Batting Impact Estimationcited by 0
- 2026Event-based Batting Impact Estimation25 May 2026
- 2025SoccerMaster: A Vision Foundation Model for Soccer Understanding11 Dec 2025
- 2025Focus on What Matters: Constraining Spatial-Temporal Attention via Action-Units for Noise-Resilient AQA6 Nov 2025
- 2025EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgery19 Sep 2025
- 2025VIFSS: View-Invariant and Figure Skating-Specific Pose Representation Learning for Temporal Action Segmentation14 Aug 2025
- 2024LocoMotion: Learning Motion-Focused Video-Language Representations15 Oct 2024
- 20243D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach29 Aug 2024
- 2024FineParser: A Fine-grained Spatio-temporal Action Parser for Human-centric Action Quality Assessment11 May 2024
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decision7 Jul 2023
- 2023Fine-grained Action Analysis: A Multi-modality and Multi-task Dataset of Figure Skating6 Jul 2023
- 2023Tubelet-Contrastive Self-Supervision for Video-Efficient Generalization20 Mar 2023
- 2022Weakly-Supervised Temporal Action Detection for Fine-Grained Videos with Hierarchical Atomic Actions24 Jul 2022
8 more
- 2022Exploring Fine-Grained Audiovisual Categorization with the SSW60 Dataset21 Jul 2022
- 2022Fine-grained Activities of People Worldwide11 Jul 2022
- 2022Automatic Concept Extraction for Concept Bottleneck-based Video Classification21 Jun 2022
- 2022How Do You Do It? Fine-Grained Action Understanding with Pseudo-Adverbs23 Mar 2022
- 2022Recent Trends in 2D Object Detection and Applications in Video Event Recognition7 Feb 2022
- 2021Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understanding31 Oct 2021
- 2021Few-Shot Fine-Grained Action Recognition via Bidirectional Attention and Contrastive Meta-Learning15 Aug 2021
- 2021Recognizing Actions in Videos from Unseen Viewpoints30 Mar 2021
- 2024FineParser: A Fine-grained Spatio-temporal Action Parser for Human-centric Action Quality Assessmentcited by 25
- 2021Recognizing Actions in Videos from Unseen Viewpointscited by 18
- 2022Exploring Fine-Grained Audiovisual Categorization with the SSW60 Datasetcited by 12
- 2023Tubelet-Contrastive Self-Supervision for Video-Efficient Generalizationcited by 12
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2025SoccerMaster: A Vision Foundation Model for Soccer Understandingcited by 10
- 2022Automatic Concept Extraction for Concept Bottleneck-based Video Classificationcited by 8
- 2022Weakly-Supervised Temporal Action Detection for Fine-Grained Videos with Hierarchical Atomic Actionscited by 8
- 2021Few-Shot Fine-Grained Action Recognition via Bidirectional Attention and Contrastive Meta-Learningcited by 7
- 20243D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approachcited by 7
- 2022Fine-grained Activities of People Worldwidecited by 4
- 2024LocoMotion: Learning Motion-Focused Video-Language Representationscited by 4
12 most cited of 19 All 19 (JSON)
- 2026Event-based Batting Impact Estimation25 May 2026
- 2025SoccerMaster: A Vision Foundation Model for Soccer Understanding11 Dec 2025
- 2025Focus on What Matters: Constraining Spatial-Temporal Attention via Action-Units for Noise-Resilient AQA6 Nov 2025
- 2025VIFSS: View-Invariant and Figure Skating-Specific Pose Representation Learning for Temporal Action Segmentation14 Aug 2025
- 2024LocoMotion: Learning Motion-Focused Video-Language Representations15 Oct 2024
- 20243D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach29 Aug 2024
- 2024FineParser: A Fine-grained Spatio-temporal Action Parser for Human-centric Action Quality Assessment11 May 2024
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decision7 Jul 2023
- 2023Fine-grained Action Analysis: A Multi-modality and Multi-task Dataset of Figure Skating6 Jul 2023
- 2023Tubelet-Contrastive Self-Supervision for Video-Efficient Generalization20 Mar 2023
- 2022Weakly-Supervised Temporal Action Detection for Fine-Grained Videos with Hierarchical Atomic Actions24 Jul 2022
- 2022Exploring Fine-Grained Audiovisual Categorization with the SSW60 Dataset21 Jul 2022
12 newest of 19 All 19 (JSON)