mlsanityData to 14 Oct 2026

IEKG: A Commonsense Knowledge Graph for Idiomatic Expressions

arXiv 2312.06053 ↗First posted 11 Dec 2023cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Idiomatic expression (IE) processing and comprehension have challenged pre-trained language models (PTLMs) because their meanings are non-compositional. Unlike prior works that enable IE comprehension through fine-tuning PTLMs with sentences containing IEs, in this work, we construct IEKG, a commonsense knowledge graph for figurative interpretations of IEs. This extends the established ATOMIC2020 graph, converting PTLMs into knowledge models (KMs) that encode and infer commonsense knowledge related to IE use. Experiments show that various PTLMs can be converted into KMs with IEKG. We verify the quality of IEKG and the ability of the trained KMs with automatic and human evaluation. Through applications in natural language understanding, we show that a PTLM injected with knowledge from IEKG exhibits improved IE comprehension ability and can generalize to IEs unseen during training.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 63 references that are in the map. First posted on arXiv 11 Dec 2023.

Builds on

30 of 63 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  6. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  7. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  8. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  9. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  10. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
  11. 2018Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Taskscited by 215
  12. 2021CEM: Commonsense-aware Empathetic Response Generationcited by 89
18 more
  1. 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
  2. 2021MERMAID: Metaphor Generation with Symbolism and Discriminative Decodingcited by 49
  3. 2020CSKG: The CommonSense Knowledge Graphcited by 45
  4. 2021It's not Rocket Science : Interpreting Figurative Language in Narrativescited by 39
  5. 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
  6. 2018Examining the Tip of the Iceberg: A Data Set for Idiom Translationcited by 34
  7. 2020Towards an Atlas of Cultural Commonsense for Machine Reasoningcited by 29
  8. 2021ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualitiescited by 28
  9. 2021AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Modelscited by 27
  10. 2021Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Taskscited by 24
  11. 2013Sentiment Analysis in the Newscited by 20
  12. 2021Investigating Robustness of Dialog Models to Popular Figurative Language Constructscited by 19
  13. 2021Idiomatic Expression Identification using Semantic Compatibilitycited by 19
  14. 2021Rethinking Why Intermediate-Task Fine-Tuning Workscited by 18
  15. 2018Classifying Idiomatic and Literal Expressions Using Topic Models and Intensity of Emotionscited by 13
  16. 2020MICE: Mining Idioms with Contextual Embeddingscited by 7
  17. 2021Idiomatic Expression Paraphrasing without Strong Supervisioncited by 7
  18. 2022Are Sample-Efficient NLP Models More Robust?cited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.