ChID: A Large-scale Chinese IDiom Dataset for Cloze Test
Not on the map. Why?
Abstract (arXiv)
Cloze-style reading comprehension in Chinese is still limited due to the lack of various corpora. In this paper we propose a large-scale Chinese cloze test dataset ChID, which studies the comprehension of idiom, a unique language phenomenon in Chinese. In this corpus, the idioms in a passage are replaced by blank symbols and the correct answer needs to be chosen from well-designed candidate idioms. We carefully study how the design of candidate idioms and the representation of idioms affect the performance of state-of-the-art models. Results show that the machine accuracy is substantially worse than that of human, indicating a large space for further research.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 4; 2023: 9; 2024: 17; 2025: 11; 2026: 10.
65 papers.
Sort:
By area:
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2024ShortGPT: Layers in Large Language Models are More Redundant Than You Expectcited by 369
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
- 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
- 2021PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computationcited by 134
- 2024LaCo: Large Language Model Pruning via Layer Collapsecited by 124
- 2024Evaluating Quantized Large Language Modelscited by 75
- 2025AdaMuon: Adaptive Muon Optimizercited by 59
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
38 more
- 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
- 2021ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 45
- 2021FewCLUE: A Chinese Few-shot Learning Evaluation Benchmarkcited by 41
- 2024KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharingcited by 38
- 2021Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learningcited by 35
- 2021NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Predictioncited by 23
- 2023Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Modelscited by 23
- 2024Wings: Learning Multimodal LLMs without Text-only Forgettingcited by 23
- 2022WeLM: A Well-Read Pre-trained Language Model for Chinesecited by 19
- 2024TeleChat Technical Reportcited by 15
- 2021ePiC: Employing Proverbs in Context as a Benchmark for Abstract Language Understandingcited by 14
- 2023CLEVA: Chinese Language Models EVAluation Platformcited by 13
- 2024Tele-FLM Technical Reportcited by 12
- 2024SUTRA: Scalable Multilingual Language Model Architecturecited by 11
- 2022PETCI: A Parallel English Translation Dataset of Chinese Idiomscited by 10
- 2023WYWEB: A NLP Evaluation Benchmark For Classical Chinesecited by 10
- 2023Disco-Bench: A Discourse-Aware Evaluation Benchmark for Language Modellingcited by 10
- 2025ReplaceMe: Network Simplification via Depth Pruning and Transformer Block Linearizationcited by 10
- 2024OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safetycited by 9
- 2021Continuity of Topic, Interaction, and Query: Learning to Quote in Online Conversationscited by 8
- 2025Chengyu-Bench: Benchmarking Large Language Models for Chinese Idiom Understanding and Usecited by 8
- 2021Sub-Character Tokenization for Chinese Pretrained Language Modelscited by 7
- 2023OpenBA: An Open-sourced 15B Bilingual Asymmetric seq2seq Model Pre-trained from Scratchcited by 7
- 2025Memorization or Reasoning? Exploring the Idiom Understanding of LLMscited by 7
- 2025Are Large Language Models Chronically Online Surfers? A Dataset for Chinese Internet Meme Explanationcited by 6
- 2026Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluationcited by 6
- 2022Chinese Idiom Paraphrasingcited by 5
- 2024InternLM-Law: An Open Source Chinese Legal Large Language Modelcited by 5
- 2025LESA: Learnable LLM Layer Scaling-Upcited by 5
- 2021IBERT: Idiom Cloze-style reading comprehension with Attentioncited by 4
- 2023ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Modelscited by 4
- 2021Cross-lingual Transferring of Pre-trained Contextualized Language Modelscited by 3
- 2021Extract, Integrate, Compete: Towards Verification Style Reading Comprehensioncited by 3
- 2024GRASP: Replace Redundant Layers with Adaptive Singular Parameters for Efficient Model Compressioncited by 3
- 2025GPTailor: Large Language Model Pruning Through Layer Cutting and Stitchingcited by 3
- 2026RouteMoA: Dynamic Routing without Pre-Inference Boosts Efficient Mixture-of-Agentscited by 3
- 2021Native Chinese Reader: A Dataset Towards Native-Level Chinese Machine Reading Comprehensioncited by 2
- 2024Predictable Emergent Abilities of LLMs: Proxy Tasks Are All You Needcited by 2
50 most cited of 65 All 65 (JSON)
- 2026Chinese-Jev: Bringing System One Model to Chinese-Language Tasks29 Sep 2026
- 2026CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords18 Sep 2026
- 2026Reasoning or Memorization: Can LLMs Understand and Generate Chinese Xiehouyu Riddles?26 Jul 2026
- 2026Zeta: Dual Whitening for Matrix Optimization via Coordinate-Adaptive Preconditioning12 Jun 2026
- 2026SiNFluD: Creating and Evaluating Figurative Language Dataset for Sindhi2 May 2026
- 2026GradMAP: Faster Layer Pruning with Gradient Metric and Projection Compensation16 Feb 2026
- 2026DataChef: Cooking Up Optimal Data Recipes for LLM Adaptation via Reinforcement Learning11 Feb 2026
- 2026SinFoS: A Parallel Dataset for Translating Sinhala Figures of Speech9 Feb 2026
- 2026RouteMoA: Dynamic Routing without Pre-Inference Boosts Efficient Mixture-of-Agents26 Jan 2026
- 2026Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation12 Jan 2026
- 2025Idiom Understanding as a Tool to Measure the Dialect Gap6 Oct 2025
- 2025Are Large Language Models Chronically Online Surfers? A Dataset for Chinese Internet Meme Explanation1 Oct 2025
38 more
- 2025A Survey of Idiom Datasets for Psycholinguistic and Computational Research15 Aug 2025
- 2025Evaluating LLMs on Chinese Idiom Translation14 Aug 2025
- 2025AdaMuon: Adaptive Muon Optimizer15 Jul 2025
- 2025GPTailor: Large Language Model Pruning Through Layer Cutting and Stitching25 Jun 2025
- 2025Chengyu-Bench: Benchmarking Large Language Models for Chinese Idiom Understanding and Use22 Jun 2025
- 2025Memorization or Reasoning? Exploring the Idiom Understanding of LLMs22 May 2025
- 2025ReplaceMe: Network Simplification via Depth Pruning and Transformer Block Linearization5 May 2025
- 2025Can the capability of Large Language Models be described by human ability? A Meta Study13 Apr 2025
- 2025LESA: Learnable LLM Layer Scaling-Up19 Feb 2025
- 2024GRASP: Replace Redundant Layers with Adaptive Singular Parameters for Efficient Model Compression31 Dec 2024
- 2024Predictable Emergent Abilities of LLMs: Proxy Tasks Are All You Need10 Dec 2024
- 2024KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing24 Oct 2024
- 2024InternLM-Law: An Open Source Chinese Legal Large Language Model21 Jun 2024
- 2024Benchmark Data Contamination of Large Language Models: A Survey6 Jun 2024
- 2024Wings: Learning Multimodal LLMs without Text-only Forgetting5 Jun 2024
- 2024SUTRA: Scalable Multilingual Language Model Architecture7 May 2024
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model7 May 2024
- 2024Tele-FLM Technical Report25 Apr 2024
- 2024Chinese Sequence Labeling with Semi-Supervised Boundary-Aware Language Model Pre-training8 Apr 2024
- 2024OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety18 Mar 2024
- 2024ShortGPT: Layers in Large Language Models are More Redundant Than You Expect6 Mar 2024
- 2024Evaluating Quantized Large Language Models28 Feb 2024
- 2024LaCo: Large Language Model Pruning via Layer Collapse17 Feb 2024
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models11 Jan 2024
- 2024TeleChat Technical Report8 Jan 2024
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermism5 Jan 2024
- 2023Generating Continuations in Multilingual Idiomatic Contexts31 Oct 2023
- 2023OpenBA: An Open-sourced 15B Bilingual Asymmetric seq2seq Model Pre-trained from Scratch19 Sep 2023
- 2023ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models28 Aug 2023
- 2023Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Models26 Aug 2023
- 2023CLEVA: Chinese Language Models EVAluation Platform9 Aug 2023
- 2023Disco-Bench: A Discourse-Aware Evaluation Benchmark for Language Modelling16 Jul 2023
- 2023A Comprehensive Overview of Large Language Models12 Jul 2023
- 2023WYWEB: A NLP Evaluation Benchmark For Classical Chinese23 May 2023
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing20 Mar 2023
- 2022InDEX: Indonesian Idiom and Expression Dataset for Cloze Test24 Nov 2022
- 2022WeLM: A Well-Read Pre-trained Language Model for Chinese21 Sep 2022
- 2022Chinese Idiom Paraphrasing15 Apr 2022
50 newest of 65 All 65 (JSON)
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2024KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharingcited by 38
- 2024SUTRA: Scalable Multilingual Language Model Architecturecited by 11
- 2025Memorization or Reasoning? Exploring the Idiom Understanding of LLMscited by 7
- 2026GradMAP: Faster Layer Pruning with Gradient Metric and Projection Compensationcited by 0
- 2026Reasoning or Memorization: Can LLMs Understand and Generate Chinese Xiehouyu Riddles?cited by 0
- 2026Reasoning or Memorization: Can LLMs Understand and Generate Chinese Xiehouyu Riddles?26 Jul 2026
- 2026GradMAP: Faster Layer Pruning with Gradient Metric and Projection Compensation16 Feb 2026
- 2025Memorization or Reasoning? Exploring the Idiom Understanding of LLMs22 May 2025
- 2024KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing24 Oct 2024
- 2024SUTRA: Scalable Multilingual Language Model Architecture7 May 2024
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermism5 Jan 2024
- 2024Wings: Learning Multimodal LLMs without Text-only Forgettingcited by 23
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2024ShortGPT: Layers in Large Language Models are More Redundant Than You Expectcited by 369
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
- 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
- 2021PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computationcited by 134
- 2024LaCo: Large Language Model Pruning via Layer Collapsecited by 124
- 2024Evaluating Quantized Large Language Modelscited by 75
- 2025AdaMuon: Adaptive Muon Optimizercited by 59
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
- 2021ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 45
- 2021FewCLUE: A Chinese Few-shot Learning Evaluation Benchmarkcited by 41
12 most cited of 55 All 55 (JSON)
- 2026Chinese-Jev: Bringing System One Model to Chinese-Language Tasks29 Sep 2026
- 2026CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords18 Sep 2026
- 2026Zeta: Dual Whitening for Matrix Optimization via Coordinate-Adaptive Preconditioning12 Jun 2026
- 2026SiNFluD: Creating and Evaluating Figurative Language Dataset for Sindhi2 May 2026
- 2026DataChef: Cooking Up Optimal Data Recipes for LLM Adaptation via Reinforcement Learning11 Feb 2026
- 2026SinFoS: A Parallel Dataset for Translating Sinhala Figures of Speech9 Feb 2026
- 2026Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation12 Jan 2026
- 2025Idiom Understanding as a Tool to Measure the Dialect Gap6 Oct 2025
- 2025Are Large Language Models Chronically Online Surfers? A Dataset for Chinese Internet Meme Explanation1 Oct 2025
- 2025A Survey of Idiom Datasets for Psycholinguistic and Computational Research15 Aug 2025
- 2025Evaluating LLMs on Chinese Idiom Translation14 Aug 2025
- 2025AdaMuon: Adaptive Muon Optimizer15 Jul 2025
12 newest of 55 All 55 (JSON)