mlsanityData to 7 Oct 2026

The slurk Interaction Server Framework: Better Data for Better Dialog Models

arXiv 2202.01155 ↗First posted 2 Feb 2022cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

This paper presents the slurk software, a lightweight interaction server for setting up dialog data collections and running experiments. Slurk enables a multitude of settings including text-based, speech and video interaction between two or more humans or humans and bots, and a multimodal display area for presenting shared or private interactive context. The software is implemented in Python with an HTML and JS frontend that can easily be adapted to individual needs. It also provides a setup for pairing participants on common crowdworking platforms such as Amazon Mechanical Turk and some example bot scripts for common interaction scenarios.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 2 Feb 2022.

Builds on

10 of 25 references.

References · 10

  1. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  2. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  3. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  4. 2016Visual Dialogcited by 377
  5. 2019What makes a good conversation? How controllable attributes affect human judgmentscited by 140
  6. 2017ParlAI: A Dialog Research Software Platformcited by 139
  7. 2019CraftAssist: A Framework for Dialogue-enabled Interactive Agentscited by 27
  8. 2019MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environmentcited by 19
  9. 2020A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Modelscited by 8
  10. 2020CRWIZ: A Framework for Crowdsourcing Real-Time Wizard-of-Oz Dialoguescited by 2

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 2; 2025: 2.

7 papers.

  1. 2023Clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agentscited by 52
  2. 2023Dialogue Games for Benchmarking Language Understanding: Motivation, Taxonomy, Strategycited by 12
  3. 2023CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verificationcited by 11
  4. 2024A Dialogue Game for Eliciting Balanced Collaborationcited by 4
  5. 2025A Third Paradigm for LLM Evaluation: Dialogue Game-Based Evaluation using clembenchcited by 3
  6. 2024Towards No-Code Programming of Cobots: Experiments with Code Synthesis by Large Code Models for Conversational Programmingcited by 2
  7. 2025Collaborative Problem-Solving in an Optimization Gamecited by 1