mlsanityData to 7 Oct 2026

AIDE: Automated Instruction via Distilled Expertise for Reference-Free Motor Skill Coaching

arXiv 2608.03047 ↗First posted 4 Aug 2026cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating natural-language coaching feedback on motor skills can accelerate learning, yet expert coaches are scarce and expensive. Existing reference-based methods require expert demonstrations at both training and inference time, limiting practical deployment. We propose AIDE (Automated Instruction via Distilled Expertise), a framework that exploits expert references only during training and generates feedback from a learner's pose sequence alone at inference. A teacher model first learns to generate feedback from paired learner-expert poses via a frozen language model, producing separate learner tokens and difference tokens that encode the learner-expert difference. A student model then inherits the teacher's encoder and weight initialization, replacing the explicit expert comparison with an auxiliary module that produces complementary tokens from the learner's pose alone. On the ExpertAF dataset, AIDE outperforms reference-free baselines on most metrics and performs comparably to methods requiring expert demonstrations at both training and inference, with LLM-based evaluation supporting these findings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 50 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

28 of 50 references.

References · 28

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  8. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  9. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  10. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  11. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  12. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
16 more
  1. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  2. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  3. 2019Relational Knowledge Distillationcited by 873
  4. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  5. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  6. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
  7. 2015Unifying distillation and privileged informationcited by 218
  8. 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 106
  9. 2018Modality Distillation with Multiple Stream Networks for Action Recognitioncited by 83
  10. 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
  11. 2018Action Quality Assessment Across Multiple Actionscited by 78
  12. 2021Group-aware Contrastive Regression for Action Quality Assessmentcited by 75
  13. 2018Deep Learning under Privileged Information Using Heteroscedastic Dropoutcited by 26
  14. 2024ExpertAF: Expert Actionable Feedback from Videocited by 17
  15. 2022Transfer and Marginalize: Explaining Away Label Noise with Privileged Informationcited by 15
  16. 2025CoachMe: Decoding Sport Elements with a Reference-Based Coaching Instruction Generation Modelcited by 4

Built on by

Not cited yet.