Word Synchronization Challenge: A Benchmark for Word Association Responses for Large Language Models
Not on the map. Why?
Abstract (arXiv)
This paper introduces the Word Synchronization Challenge, a novel benchmark to evaluate large language models (LLMs) in Human-Computer Interaction (HCI). This benchmark uses a dynamic game-like framework to test LLMs ability to mimic human cognitive processes through word associations. By simulating complex human interactions, it assesses how LLMs interpret and align with human thought patterns during conversational exchanges, which are essential for effective social partnerships in HCI. Initial findings highlight the influence of model sophistication on performance, offering insights into the models capabilities to engage in meaningful social interactions and adapt behaviors in human-like ways. This research advances the understanding of LLMs potential to replicate or diverge from human cognitive functions, paving the way for more nuanced and empathetic human-machine collaborations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 21 references that are in the map. First posted on arXiv 12 Feb 2025.
Builds on
5 of 21 references.
References · 5
- 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 144
- 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
- 2024Understanding Large-Language Model (LLM)-powered Human-Robot Interactioncited by 43
- 2021How much pretraining data do language models need to learn syntax?cited by 21
- 2024LLM Theory of Mind and Alignment: Opportunities and Riskscited by 18
Built on by
Not cited yet.