mlsanityData to 7 Oct 2026

MFAQ: a Multilingual FAQ Dataset

arXiv 2109.12870 ↗First posted 27 Sep 2021cs.CLcited by 16

Not on the map. Why?

Abstract (arXiv)

In this paper, we present the first multilingual FAQ dataset publicly available. We collected around 6M FAQ pairs from the web, in 21 different languages. Although this is significantly larger than existing FAQ retrieval datasets, it comes with its own challenges: duplication of content and uneven distribution of topics. We adopt a similar setup as Dense Passage Retrieval (DPR) and test various bi-encoders on this dataset. Our experiments reveal that a multilingual model based on XLM-RoBERTa achieves the best results, except for English. Lower resources languages seem to learn from one another as a multilingual model achieves a higher MRR than language-specific ones. Our qualitative analysis reveals the brittleness of the model on simple word changes. We publicly release our dataset, model and training script.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 21 of its 55 references that are in the map. First posted on arXiv 27 Sep 2021.

Builds on

21 of 55 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  6. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  7. 2021Deduplicating Training Data Makes Language Models Bettercited by 705
  8. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  9. 2018Universal Sentence Encodercited by 485
  10. 2021Internet-Augmented Dialogue Generationcited by 217
  11. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 198
  12. 2020A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languagescited by 131
9 more
  1. 2019ConveRT: Efficient and Accurate Conversational Representations from Transformerscited by 95
  2. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  3. 2021Domain-matched Pre-training Tasks for Dense Retrievalcited by 53
  4. 2015Applying Deep Learning to Answer Selection: A Study and An Open Taskcited by 24
  5. 2019FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevancecited by 24
  6. 2019SemEval-2015 Task 3: Answer Selection in Community Question Answeringcited by 10
  7. 2020orgFAQ: A New Dataset and Analysis on Organizational FAQs and User Questionscited by 2
  8. 2019FAQ-based Question Answering via Knowledge Anchorscited by 1
  9. 2021ConveRT for FAQ Answeringcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 6; 2025: 2; 2026: 3.

16 papers.

Sort:

By area:

  1. 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoningcited by 49
  2. 2023Towards a Robust Detection of Language Model Generated Text: Is ChatGPT that Easy to Detect?cited by 23
  3. 2024Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddingscited by 20
  4. 2024PIRB: A Comprehensive Benchmark of Polish Dense and Hybrid Text Retrieval Methodscited by 14
  5. 2023MAUPQA: Massive Automatically-created Polish Question Answering Datasetcited by 11
  6. 2024A Practical Examination of AI-Generated Text Detectors for Large Language Modelscited by 11
  7. 2023Detecting ChatGPT: A Survey of the State of Detecting ChatGPT-Generated Textcited by 10
  8. 2026F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual Worldcited by 10
  9. 2025Gaperon: A Peppered English-French Generative Language Model Suitecited by 8
  10. 2025On The Role of Pretrained Language Models in General-Purpose Text Embeddings: A Surveycited by 3
  11. 2023Interpreting Indirect Answers to Yes-No Questions in Multiple Languagescited by 2
  12. 2024New Textual Corpora for Serbian Language Modelingcited by 1
4 more
  1. 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrievalcited by 1
  2. 2024WarCov -- Large multilabel and multimodal dataset from social platformcited by 0
  3. 2026Nepali Passport Question Answering: A Low-Resource Dataset for Public Service Applicationscited by 0
  4. 2026SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptationcited by 0