mlsanityData to 14 Oct 2026

Parameter-Efficient Multi-View Proficiency Estimation: From Discriminative Classification to Generative Feedback

arXiv 2605.03848 ↗First posted 5 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating how well a person performs an action, rather than which action is performed, is central to coaching, rehabilitation, and talent identification. This task is challenging because proficiency is encoded in subtle differences in timing, balance, body mechanics, and execution, often distributed across multiple views and short temporal events. We discuss three recent contributions to multi-view proficiency estimation on Ego-Exo4D. SkillFormer introduces a parameter-efficient discriminative architecture for selective multi-view fusion; PATS improves temporal sampling by preserving locally dense excerpts of fundamental movements; and ProfVLM reformulates proficiency estimation as conditional language generation, producing both a proficiency label and expert-style feedback through a gated cross-view projector and a compact language backbone. Together, these methods achieve state-of-the-art accuracy on Ego-Exo4D with up to 20x fewer trainable parameters and up to 3x fewer training epochs than video-transformer baselines, while moving from closed-set classification toward interpretable feedback generation. These results highlight a shift toward efficient, multi-view systems that combine selective fusion, proficiency-aware sampling, and actionable generative feedback.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

15 of 19 references.

References · 15

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  3. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  4. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 335
  5. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
  6. 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
  7. 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmarkcited by 20
  8. 2024Narrative Action Evaluation with Prompt-Guided Multimodal Interactioncited by 19
  9. 2025BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimationcited by 17
  10. 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Taskscited by 11
  11. 2025SkillFormer: Unified Multi-View Video Understanding for Proficiency Estimationcited by 6
  12. 2025PATS: Proficiency-Aware Temporal Sampling for Multi-View Sports Skill Assessmentcited by 5
3 more
  1. 2025Gate-Shift-Pose: Enhancing Action Recognition in Sports with Skeleton Informationcited by 4
  2. 2025ProfVLM: A lightweight video-language model for multi-view proficiency estimationcited by 4
  3. 2025TacticExpert: Spatial-Temporal Graph Language Model for Basketball Tacticscited by 3

Built on by

Not cited yet.