mlsanityData to 14 Oct 2026

S-DAT: A Multilingual, GenAI-Driven Framework for Automated Divergent Thinking Assessment

arXiv 2505.09068 ↗First posted 14 May 2025cs.CL cs.HCcited by 3

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

This paper introduces S-DAT (Synthetic-Divergent Association Task), a scalable, multilingual framework for automated assessment of divergent thinking (DT) -a core component of human creativity. Traditional creativity assessments are often labor-intensive, language-specific, and reliant on subjective human ratings, limiting their scalability and cross-cultural applicability. In contrast, S-DAT leverages large language models and advanced multilingual embeddings to compute semantic distance -- a language-agnostic proxy for DT. We evaluate S-DAT across eleven diverse languages, including English, Spanish, German, Russian, Hindi, and Japanese (Kanji, Hiragana, Katakana), demonstrating robust and consistent scoring across linguistic contexts. Unlike prior DAT approaches, the S-DAT shows convergent validity with other DT measures and correct discriminant validity with convergent thinking. This cross-linguistic flexibility allows for more inclusive, global-scale creativity research, addressing key limitations of earlier approaches. S-DAT provides a powerful tool for fairer, more comprehensive evaluation of cognitive flexibility in diverse populations and can be freely assessed online: https://sdat.iol.zib.de/.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 12 of its 46 references that are in the map. First posted on arXiv 14 May 2025.

Builds on

12 of 46 references.

References · 12

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  2. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  3. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  4. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
  5. 2023Improving Text Embeddings with Large Language Modelscited by 303
  6. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
  7. 2023Emergent autonomous scientific research capabilities of large language modelscited by 132
  8. 2024Tokenization Is More Than Compressioncited by 89
  9. 2024Arctic-Embed: Scalable, Efficient, and Accurate Text Embedding Modelscited by 61
  10. 2024Arctic-Embed 2.0: Multilingual Retrieval Without Compromisecited by 58
  11. 2024Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical Problemscited by 11
  12. 2025Granite Embedding Modelscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativity
  2. 2023Automatic Assessment of Divergent Thinking in Chinese Language with TransDis: A Transformer-Based Language Model Approach
  3. 2026CreativityNeuro: Steering Language Model Weights to Improve Divergent Thinking and Reduce Mode Collapse
  4. 2025Rethinking Creativity Evaluation: A Critical Analysis of Existing Creativity Evaluations
  5. 2023Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativity
  6. 2026AGC-Bench: Measuring Artificial General Creativity
  7. 2026Large Language Models Align with the Human Brain during Creative Thinking
  8. 2025CreBench: Human-Aligned Creativity Evaluation from Idea to Process to Product