mlsanityData to 14 Oct 2026

MLCR: Multi-Level Cue Refinement for Long-Term Multimodal Action Quality Assessment

arXiv 2605.08945 ↗First posted 9 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-term multimodal action quality assessment (AQA) evaluates action execution in several-minute audiovisual sequences by mining discriminative quality cues for score prediction. Existing multimodal methods usually model entire sequences with a single temporal encoder and fuse modality features by direct alignment or concatenation, causing key cues to be obscured by global trends, weakened by modal redundancy, and distorted during one-shot score mapping. To address this issue, we reformulate long-term multimodal AQA as a quality cue organization problem and propose MLCR, a multi-level cue refinement framework. MLCR organizes quality evidence at three levels: intra-modal representation, cross-modal interaction, and stage-wise aggregation. Specifically, the intra-modal decoupling encoder (IMDE) preserves modality identity while refining global temporal context and local frequency details. The cross-modal dynamic complementarity-aware retrieval (CMDCR) module retrieves incremental evidence conditioned on the evolving fused state and suppresses redundant responses. The stage-wise multimodal integration (SMI) block progressively accumulates intra-modal and cross-modal cues to refine the fused representation. Experiments on the Rhythmic Gymnastics and Fis-V datasets show that MLCR achieves the best or second-best performance in both Spearman correlation and prediction error, demonstrating its effectiveness and robustness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 54 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

29 of 54 references.

References · 29

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  2. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  3. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  4. 2021Video Swin Transformercited by 1,091
  5. 2021AST: Audio Spectrogram Transformercited by 643
  6. 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
  7. 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 107
  8. 2019What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessmentcited by 100
  9. 2016Learning To Score Olympic Eventscited by 88
  10. 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
  11. 2018Action Quality Assessment Across Multiple Actionscited by 79
  12. 2021Group-aware Contrastive Regression for Action Quality Assessmentcited by 75
17 more
  1. 2018Learning to score the figure skating sports videoscited by 73
  2. 2018The Pros and Cons: Rank-aware Temporal Attention for Skill Determination in Long Videoscited by 69
  3. 2022TSA-Net: Tube Self-Attention Network for Action Quality Assessmentcited by 36
  4. 2022Action Quality Assessment with Temporal Parsing Transformercited by 31
  5. 2020MSAF: Multimodal Split Attention Fusioncited by 23
  6. 2022Skating-Mixer: Long-Term Sport Audio-Visual Modeling with MLPscited by 20
  7. 2024Multimodal Action Quality Assessmentcited by 20
  8. 2024Narrative Action Evaluation with Prompt-Guided Multimodal Interactioncited by 19
  9. 2024CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction Alignmentcited by 17
  10. 2024RICA2: Rubric-Informed, Calibrated Assessment of Actionscited by 13
  11. 2025PHI: Bridging Domain Shift in Long-Term Action Quality Assessment via Progressive Hierarchical Instructioncited by 10
  12. 2023Learning Sparse Temporal Video Mapping for Action Quality Assessment in Floor Gymnasticscited by 9
  13. 2023IRIS: Interpretable Rubric-Informed Segmentation for Action Quality Assessmentcited by 9
  14. 2025A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directionscited by 7
  15. 2025MCMoE: Completing Missing Modalities with Mixture of Experts for Incomplete Multimodal Action Quality Assessmentcited by 7
  16. 2025Attention-Driven Multimodal Alignment for Long-term Action Quality Assessmentcited by 2
  17. 2025Learning Long-Range Action Representation by Two-Stream Mamba Pyramid Network for Figure Skating Assessmentcited by 2

Built on by

Not cited yet.