PerSHOP -- A Persian dataset for shopping dialogue systems modeling
Not on the map. Why?
Abstract (arXiv)
Nowadays, dialogue systems are used in many fields of industry and research. There are successful instances of these systems, such as Apple Siri, Google Assistant, and IBM Watson. Task-oriented dialogue system is a category of these, that are used in specific tasks. They can perform tasks such as booking plane tickets or making restaurant reservations. Shopping is one of the most popular areas on these systems. The bot replaces the human salesperson and interacts with the customers by speaking. To train the models behind the scenes of these systems, annotated data is needed. In this paper, we developed a dataset of dialogues in the Persian language through crowd-sourcing. We annotated these dialogues to train a model. This dataset contains nearly 22k utterances in 15 different domains and 1061 dialogues. This is the largest Persian dataset in this field, which is provided freely so that future researchers can use it. Also, we proposed some baseline models for natural language understanding (NLU) tasks. These models perform two tasks for NLU: intent classification and entity extraction. The F-1 score metric obtained for intent classification is around 91% and for entity extraction is around 93%, which can be a baseline for future research.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 1 Jan 2024.
Builds on
16 of 20 references.
References · 16
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 426
- 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
- 2020ParsBERT: Transformer-based Model for Persian Language Understandingcited by 92
- 2017Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systemscited by 84
- 2018Building a Conversational Agent Overnight with Dialogue Self-Playcited by 70
- 2020CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Datasetcited by 66
- 2020Recent Neural Methods on Slot Filling and Intent Classification for Task-Oriented Dialogue Systems: A Surveycited by 51
- 2020RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz Dataset with Rich Semantic Annotations for Task-Oriented Dialogue Modelingcited by 40
- 2020DIET: Lightweight Language Understanding for Dialogue Systemscited by 35
- 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streamingcited by 27
4 more
- 2022Cross-Lingual Dialogue Dataset Creation via Outline-Based Generationcited by 23
- 2023X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agentscited by 12
- 2019CASA-NLU: Context-Aware Self-Attentive Natural Language Understanding for Task-Oriented Chatbotscited by 10
- 2021End-to-End Conversational Search for Online Shopping with Utterance Transfercited by 7
Built on by
Citing papers per year: 2025: 2.
2 papers.