mlsanityData to 7 Oct 2026

Evaluating Zero-Shot and One-Shot Adaptation of Small Language Models in Leader-Follower Interaction

arXiv 2602.23312 ↗First posted 26 Feb 2026cs.HC cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Leader-follower interaction is an important paradigm in human-robot interaction (HRI). Yet, assigning roles in real time remains challenging for resource-constrained mobile and assistive robots. While large language models (LLMs) have shown promise for natural communication, their size and latency limit on-device deployment. Small language models (SLMs) offer a potential alternative, but their effectiveness for role classification in HRI has not been systematically evaluated. In this paper, we present a benchmark of SLMs for leader-follower communication, introducing a novel dataset derived from a published database and augmented with synthetic samples to capture interaction-specific dynamics. We investigate two adaptation strategies: prompt engineering and fine-tuning, studied under zero-shot and one-shot interaction modes, compared with an untrained baseline. Experiments with Qwen2.5-0.5B reveal that zero-shot fine-tuning achieves robust classification performance (86.66% accuracy) while maintaining low latency (22.2 ms per sample), significantly outperforming baseline and prompt-engineered approaches. However, results also indicate a performance degradation in one-shot modes, where increased context length challenges the model's architectural capacity. These findings demonstrate that fine-tuned SLMs provide an effective solution for direct role assignment, while highlighting critical trade-offs between dialogue complexity and classification reliability on the edge.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 26 Feb 2026.

Builds on

23 of 42 references.

References · 23

  1. 2024Qwen2.5 Technical Reportcited by 4,713
  2. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  3. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  4. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  5. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  6. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  7. 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
  8. 2023Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extractioncited by 89
  9. 2024LLM-based NLG Evaluation: Current Status and Challengescited by 71
  10. 2023EdgeMoE: Empowering Sparse Large Language Models on Mobile Devicescited by 65
  11. 2024The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunitiescited by 63
  12. 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Codecited by 61
11 more
  1. 2021RAFT: A Real-World Few-Shot Text Classification Benchmarkcited by 44
  2. 2020Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learningcited by 25
  3. 2024LaMI: Large Language Models for Multi-Modal Human-Robot Interactioncited by 21
  4. 2023Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluationcited by 19
  5. 2023An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processingcited by 19
  6. 2024Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Artcited by 17
  7. 2025Few-shot LLM Synthetic Data with Distribution Matchingcited by 9
  8. 2024Multilingual Prompts in LLM-Based Recommenders: Performance Across Languagescited by 4
  9. 2025Are We There Yet? A Measurement Study of Efficiency for LLM Applications on Mobile Devicescited by 4
  10. 2024Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Modelscited by 3
  11. 2024Human Leading or Following Preferences: Effects on Human Perception of the Robot and the Human-Robot Collaborationcited by 1

Built on by

Not cited yet.