mlsanityData to 7 Oct 2026

BiRdQA: A Bilingual Dataset for Question Answering on Tricky Riddles

arXiv 2109.11087 ↗First posted 23 Sep 2021cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

A riddle is a question or statement with double or veiled meanings, followed by an unexpected answer. Solving riddle is a challenging task for both machine and human, testing the capability of understanding figurative, creative natural language and reasoning with commonsense knowledge. We introduce BiRdQA, a bilingual multiple-choice question answering dataset with 6614 English riddles and 8751 Chinese riddles. For each riddle-answer pair, we provide four distractors with additional information from Wikipedia. The distractors are automatically generated at scale with minimal bias. Existing monolingual and multilingual QA models fail to perform well on our dataset, indicating that there is a long way to go before machine can beat human on solving tricky riddles. The dataset has been released to the community.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 37 of its 59 references that are in the map. First posted on arXiv 23 Sep 2021.

Builds on

37 of 59 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  8. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  9. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  10. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  11. 2018Annotation Artifacts in Natural Language Inference Datacited by 656
  12. 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
25 more
  1. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
  2. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 553
  3. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  4. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  5. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  6. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
  7. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  8. 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
  9. 2018Hypothesis Only Baselines in Natural Language Inferencecited by 291
  10. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
  11. 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
  12. 2020Retrieve, Program, Repeat: Complex Knowledge Base Question Answering via Alternate Meta-learningcited by 216
  13. 2020An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Modelscited by 133
  14. 2019Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answeringcited by 68
  15. 2021RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledgecited by 60
  16. 2021Zero-shot Fact Verification by Claim Generationcited by 42
  17. 2019What does BERT Learn from Multiple-Choice Reading Comprehension Datasets?cited by 30
  18. 2021DAGN: Discourse-Aware Graph Network for Logical Reasoningcited by 28
  19. 2020Automatic Distractor Generation for Multiple Choice Questions in Standard Testscited by 26
  20. 2018Generating Distractors for Reading Comprehension Questions from Real Examinationscited by 24
  21. 2021Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoningcited by 23
  22. 2020RikiNet: Reading Wikipedia Pages for Natural Question Answeringcited by 21
  23. 2015sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddingscited by 20
  24. 2019BiPaR: A Bilingual Parallel Dataset for Multilingual and Cross-lingual Reading Comprehension on Novelscited by 17
  25. 2020Counterfactual Variable Control for Robust and Interpretable Question Answeringcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 1; 2024: 3; 2025: 3; 2026: 2.

10 papers.

  1. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  2. 2024Puzzle Solving using Reasoning of Large Language Models: A Surveycited by 44
  3. 2025A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Modelscited by 10
  4. 2023Long-Tailed Question Answering in an Open Worldcited by 7
  5. 2022CC-Riddle: A Question Answering Dataset of Chinese Character Riddlescited by 6
  6. 2024RISCORE: Enhancing In-Context Riddle Solving in Language Models through Context-Reconstructed Example Augmentationcited by 3
  7. 2025Adaptive Originality Filtering: Rejection Based Prompting and RiddleScore for Culturally Grounded Multilingual Riddle Generationcited by 1
  8. 2025BengaliFig: A Low-Resource Challenge for Figurative and Culturally Grounded Reasoning in Bengalicited by 1
  9. 2026RespondeoQA: a Benchmark for Bilingual Latin-English Question Answeringcited by 0
  10. 2026NSMQ Riddles: A Benchmark of Scientific and Mathematical Riddles for Quizzing Large Language Modelscited by 0