Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictor
Not on the map. Why?
Abstract (arXiv)
To facilitate the application of motion prediction in practice, recently, the few-shot motion prediction task has attracted increasing research attention. Yet, in existing few-shot motion prediction works, a specific model that is dedicatedly trained over human motions is generally required. In this work, rather than tackling this task through training a specific human motion prediction model, we instead propose a novel FMP-OC framework. In FMP-OC, in a totally training-free manner, we enable Few-shot Motion Prediction, which is a non-language task, to be performed directly via utilizing the Off-the-shelf language model ChatGPT. Specifically, to lead ChatGPT as a language model to become an accurate motion predictor, in FMP-OC, we first introduce several novel designs to facilitate extracting implicit knowledge from ChatGPT. Moreover, we also incorporate our framework with a motion-in-context learning mechanism. Extensive experiments demonstrate the efficacy of our proposed framework.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
25 of 48 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 160
- 2023Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learningcited by 149
- 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 100
13 more
- 2021Space-Time-Separable Graph Convolutional Network for Pose Forecastingcited by 84
- 2023LLM-grounded Video Diffusion Modelscited by 83
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2022Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Predictioncited by 66
- 2021Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformerscited by 46
- 2022Skeleton-Parted Graph Scattering Networks for 3D Human Motion Predictioncited by 29
- 2023IDEAL: Influence-Driven Selective Annotations Empower In-Context Learners in Large Language Modelscited by 27
- 2023Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Predictioncited by 20
- 2023LMC: Large Model Collaboration with Cross-assessment for Training-Free Open-Set Object Recognitioncited by 10
- 2022Few-Shot Forecasting of Time-Series with Heterogeneous Channelscited by 7
- 2024MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answeringcited by 7
- 2022Few-shot human motion prediction for heterogeneous sensorscited by 2
Built on by
Citing papers per year: 2024: 1.
1 paper.