mlsanityData to 7 Oct 2026

RICA2: Rubric-Informed, Calibrated Assessment of Actions

arXiv 2408.02138 ↗First posted 4 Aug 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

The ability to quantify how well an action is carried out, also known as action quality assessment (AQA), has attracted recent interest in the vision community. Unfortunately, prior methods often ignore the score rubric used by human experts and fall short of quantifying the uncertainty of the model prediction. To bridge the gap, we present RICA^2 - a deep probabilistic model that integrates score rubric and accounts for prediction uncertainty for AQA. Central to our method lies in stochastic embeddings of action steps, defined on a graph structure that encodes the score rubric. The embeddings spread probabilistic density in the latent space and allow our method to represent model uncertainty. The graph encodes the scoring criteria, based on which the quality scores can be decoded. We demonstrate that our method establishes new state of the art on public benchmarks, including FineDiving, MTL-AQA, and JIGSAWS, with superior performance in score prediction and uncertainty calibration. Our code is available at https://abrarmajeedi.github.io/rica2_aqa/

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 35 of its 57 references that are in the map. First posted on arXiv 4 Aug 2024.

Builds on

35 of 57 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017On Calibration of Modern Neural Networkscited by 4,860
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  6. 2018SlowFast Networks for Video Recognitioncited by 1,862
  7. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  8. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  9. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
  10. 2016Deep Variational Information Bottleneckcited by 915
  11. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
  12. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
23 more
  1. 2017A simple neural network module for relational reasoningcited by 345
  2. 2016Top-down Neural Attention by Excitation Backpropcited by 318
  3. 2019Probabilistic Face Embeddingscited by 171
  4. 2019What Can Neural Networks Reason About?cited by 155
  5. 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 150
  6. 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 106
  7. 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
  8. 2014Word Representations via Gaussian Embeddingcited by 96
  9. 2016Learning To Score Olympic Eventscited by 87
  10. 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
  11. 2021Group-aware Contrastive Regression for Action Quality Assessmentcited by 75
  12. 2018Learning to score the figure skating sports videoscited by 72
  13. 2021Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regressioncited by 58
  14. 2021Towards Unified Surgical Skill Assessmentcited by 49
  15. 2019View-Invariant Probabilistic Embedding for Human Posecited by 47
  16. 2017Weakly-supervised Visual Grounding of Phrases with Linguistic Structurescited by 40
  17. 2022TSA-Net: Tube Self-Attention Network for Action Quality Assessmentcited by 36
  18. 2015Efficient Non-parametric Estimation of Multiple Embeddings per Word in Vector Spacecited by 35
  19. 2022Action Quality Assessment with Temporal Parsing Transformercited by 31
  20. 2017Soft Proposal Networks for Weakly Supervised Object Localizationcited by 21
  21. 2021Auto-Encoding Score Distribution Regression for Action Quality Assessmentcited by 18
  22. 2023IRIS: Interpretable Rubric-Informed Segmentation for Action Quality Assessmentcited by 9
  23. 2022Uncertainty-Driven Action Quality Assessmentcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 7.

13 papers.

Sort:

By area:

  1. 2025Action Quality Assessment via Hierarchical Pose-guided Multi-stage Contrastive Regressioncited by 21
  2. 2025BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimationcited by 17
  3. 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoningcited by 13
  4. 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directionscited by 7
  5. 2024TechCoach: Towards Technical-Point-Aware Descriptive Action Coachingcited by 6
  6. 2025SkillSight: Efficient First-Person Skill Assessment with Gazecited by 4
  7. 2026ExpertEdit: Learning Skill-Aware Motion Editing from Expert Videoscited by 1
  8. 2026SurgFusion-Net: Diversified Adaptive Multimodal Fusion Network for Surgical Skill Assessmentcited by 0
  9. 2026MLCR: Multi-Level Cue Refinement for Long-Term Multimodal Action Quality Assessmentcited by 0
  10. 2026Latent Visual Diffusion Reasoning with Monte Carlo Tree Searchcited by 0
  11. 2026Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessmentcited by 0
  12. 2026MoAKE: Toward Unified All-in-One Action Quality Assessment via Mixture of Action Knowledge Expertscited by 0
1 more
  1. 2026MyoMechanix: Biomechanically-Grounded Compositional Skilled Activity Understanding and Coachingcited by 0