Parameter-Efficient Multi-View Proficiency Estimation: From Discriminative Classification to Generative Feedback
Not on the map. Why?
Abstract (arXiv)
Estimating how well a person performs an action, rather than which action is performed, is central to coaching, rehabilitation, and talent identification. This task is challenging because proficiency is encoded in subtle differences in timing, balance, body mechanics, and execution, often distributed across multiple views and short temporal events. We discuss three recent contributions to multi-view proficiency estimation on Ego-Exo4D. SkillFormer introduces a parameter-efficient discriminative architecture for selective multi-view fusion; PATS improves temporal sampling by preserving locally dense excerpts of fundamental movements; and ProfVLM reformulates proficiency estimation as conditional language generation, producing both a proficiency label and expert-style feedback through a gated cross-view projector and a compact language backbone. Together, these methods achieve state-of-the-art accuracy on Ego-Exo4D with up to 20x fewer trainable parameters and up to 3x fewer training epochs than video-transformer baselines, while moving from closed-set classification toward interpretable feedback generation. These results highlight a shift toward efficient, multi-view systems that combine selective fusion, proficiency-aware sampling, and actionable generative feedback.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
15 of 19 references.
References · 15
- 2023Visual Instruction Tuningcited by 7,869
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 335
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
- 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
- 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmarkcited by 20
- 2024Narrative Action Evaluation with Prompt-Guided Multimodal Interactioncited by 19
- 2025BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimationcited by 17
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Taskscited by 11
- 2025SkillFormer: Unified Multi-View Video Understanding for Proficiency Estimationcited by 6
- 2025PATS: Proficiency-Aware Temporal Sampling for Multi-View Sports Skill Assessmentcited by 5
Built on by
Not cited yet.