mlsanityData to 13 Oct 2026

Snowman: A Million-scale Chinese Commonsense Knowledge Graph Distilled from Foundation Model

arXiv 2306.10241 ↗First posted 17 Jun 2023cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Constructing commonsense knowledge graphs (CKGs) has attracted wide research attention due to its significant importance in cognitive intelligence. Nevertheless, existing CKGs are typically oriented to English, limiting the research in non-English languages. Meanwhile, the emergence of foundation models like ChatGPT and GPT-4 has shown promising intelligence with the help of reinforcement learning from human feedback. Under the background, in this paper, we utilize foundation models to construct a Chinese CKG, named Snowman. Specifically, we distill different types of commonsense head items from ChatGPT, and continue to use it to collect tail items with respect to the head items and pre-defined relations. Based on the preliminary analysis, we find the negative commonsense knowledge distilled by ChatGPT achieves lower human acceptance compared to other knowledge. Therefore, we design a simple yet effective self-instruct filtering strategy to filter out invalid negative commonsense. Overall, the constructed Snowman covers more than ten million Chinese commonsense triples, making it the largest Chinese CKG. Moreover, human studies show the acceptance of Snowman achieves 90.6%, indicating the high-quality triples distilled by the cutting-edge foundation model. We also conduct experiments on commonsense knowledge models to show the usability and effectiveness of our Snowman.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 34 of its 47 references that are in the map. First posted on arXiv 17 Jun 2023.

Builds on

34 of 47 references.

References · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,320
  2. 2023GPT-4 Technical Reportcited by 18,278
  3. 2017Proximal Policy Optimization Algorithmscited by 14,592
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,765
  7. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,586
  8. 2020Learning to summarize from human feedbackcited by 2,575
  9. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,815
  10. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  11. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  12. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 421
22 more
  1. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  2. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  3. 2020GLUCOSE: GeneraLized and COntextualized Story Explanationscited by 86
  4. 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
  5. 2022An Analysis of Negation in Natural Language Understanding Corporacited by 39
  6. 2020Automated Storytelling via Causal, Commonsense Plot Orderingcited by 38
  7. 2022A Survey on Cross-Lingual Summarizationcited by 38
  8. 2023Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledgecited by 32
  9. 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
  10. 2022ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarizationcited by 25
  11. 2022Beyond Counting Datasets: A Survey of Multilingual Dataset Construction and Necessary Resourcescited by 25
  12. 2020Advanced Semantics for Commonsense Knowledge Extractioncited by 24
  13. 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
  14. 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarizationcited by 15
  15. 2022Understanding Translationese in Cross-Lingual Summarizationcited by 14
  16. 2022Summary-Oriented Vision Modeling for Multimodal Abstractive Summarizationcited by 14
  17. 2020Emotional Conversation Generation with Heterogeneous Graph Neural Networkcited by 9
  18. 2021Knowledge Enhanced Sports Game Summarizationcited by 9
  19. 2022C3KG: A Chinese Commonsense Conversation Knowledge Graphcited by 8
  20. 2022Incorporating Commonsense Knowledge into Story Ending Generation via Heterogeneous Graph Networkscited by 6
  21. 2023Can large language models generate salient negative statements?cited by 3
  22. 2023D2TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarizationcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning
  2. 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models
  3. 2026BrainBench: Exposing the Commonsense Reasoning Gap in Large Language Models
  4. 2025Benchmarking Chinese Commonsense Reasoning with a Multi-hop Reasoning Perspective
  5. 2023CORECODE: A Common Sense Annotated Dialogue Dataset with Benchmark Tasks for Chinese Large Language Models
  6. 2024G-SAP: Graph-based Structure-Aware Prompt Learning over Heterogeneous Knowledge for Commonsense Reasoning
  7. 2025Com2: A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models
  8. 2025Towards Quantifying Commonsense Reasoning with Mechanistic Insights