Few-Shot Optimization for Sensor Data Using Large Language Models: A Case Study on Fatigue Detection
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel few-shot optimization with HED-LM (Hybrid Euclidean Distance with Large Language Models) to improve example selection for sensor-based classification tasks. While few-shot prompting enables efficient inference with limited labeled data, its performance largely depends on the quality of selected examples. HED-LM addresses this challenge through a hybrid selection pipeline that filters candidate examples based on Euclidean distance and re-ranks them using contextual relevance scored by large language models (LLMs). To validate its effectiveness, we apply HED-LM to a fatigue detection task using accelerometer data characterized by overlapping patterns and high inter-subject variability. Unlike simpler tasks such as activity recognition, fatigue detection demands more nuanced example selection due to subtle differences in physiological signals. Our experiments show that HED-LM achieves a mean macro F1-score of 69.13±10.71%, outperforming both random selection (59.30±10.13%) and distance-only filtering (67.61±11.39%). These represent relative improvements of 16.6% and 2.3%, respectively. The results confirm that combining numerical similarity with contextual relevance improves the robustness of few-shot prompting. Overall, HED-LM offers a practical solution to improve performance in real-world sensor-based learning tasks and shows potential for broader applications in healthcare monitoring, human activity recognition, and industrial safety scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 24 May 2025.
Builds on
27 of 46 references.
References · 27
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
- 2021True Few-Shot Learning with Language Modelscited by 343
- 2021Few-shot Learning with Multilingual Language Modelscited by 278
- 2021Noisy Channel Language Model Prompting for Few-Shot Text Classificationcited by 163
15 more
- 2023Large Language Models are Few-Shot Health Learnerscited by 115
- 2021A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Modelscited by 101
- 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
- 2023Active Learning Principles for In-Context Learning with Large Language Modelscited by 53
- 2023Skill-Based Few-Shot Selection for In-Context Learningcited by 46
- 2024SensorLLM: Aligning Large Language Models with Motion Sensors for Human Activity Recognitioncited by 35
- 2023The first step is the hardest: Pitfalls of Representing and Tokenizing Temporal Data for Large Language Modelscited by 34
- 2021On Training Instance Selection for Few-Shot Neural Text Generationcited by 25
- 2024Evaluating Large Language Models as Virtual Annotators for Time-series Physical Sensing Datacited by 17
- 2019Few-Shot Learning-Based Human Activity Recognitioncited by 11
- 2024Use Random Selection for Now: Investigation of Few-Shot Selection Strategies in LLM-based Text Augmentation for Classificationcited by 7
- 2022Knowledge Prompting for Few-shot Action Recognitioncited by 6
- 2024Automatic Combination of Sample Selection Strategies for Few-Shot Learningcited by 4
- 2024Designing Informative Metrics for Few-Shot Example Selectioncited by 2
- 2023Selecting Shots for Demographic Fairness in Few-Shot Learning with Large Language Modelscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.