mlsanityData to 7 Oct 2026

Enriching BERT with Knowledge Graph Embeddings for Document Classification

arXiv 1909.08402 ↗First posted 18 Sep 2019cs.CL cs.IR cs.LGcited by 22

Not on the map. Why?

Abstract (arXiv)

In this paper, we focus on the classification of books using short descriptive texts (cover blurbs) and additional metadata. Building upon BERT, a deep neural language model, we demonstrate how to combine text representations with metadata and knowledge graph embeddings, which encode author information. Compared to the standard BERT approach we achieve considerably better results for the classification task. For a more coarse-grained classification using eight labels we achieve an F1- score of 87.20, while a detailed classification using 343 labels yields an F1-score of 64.70. We make the source code and trained models of our experiments publicly available

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 6; 2022: 4; 2023: 6; 2024: 5; 2025: 1.

22 papers.

Sort:

  1. 2021Knowledge Enhanced Pretrained Language Models: A Compreshensive Surveycited by 33
  2. 2022Relational Memory Augmented Language Modelscited by 24
  3. 2022KCD: Knowledge Walks and Textual Cues Enhanced Political Perspective Detection in News Mediacited by 20
  4. 2023Graph Neural Networks for Text Classification: A Surveycited by 15
  5. 2021Knowledge Graph informed Fake News Classification via Heterogeneous Representation Ensemblescited by 14
  6. 2021Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognitioncited by 10
  7. 2023Few-shot Learning for Cross-Target Stance Detection by Aggregating Multimodal Embeddingscited by 9
  8. 2024Leveraging Large Language Models for Semantic Query Processing in a Scholarly Knowledge Graphcited by 5
  9. 2021Evaluating Document Representations for Content-based Legal Literature Recommendationscited by 4
  10. 2022Applying Automatic Text Summarization for Fake News Detectioncited by 4
  11. 2022KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classificationcited by 4
  12. 2021Focusing Knowledge-based Graph Argument Mining via Topic Modelingcited by 3
10 more
  1. 2024AutoML-guided Fusion of Entity and LLM-based Representations for Document Classificationcited by 3
  2. 2021A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classificationcited by 2
  3. 2023Enriching language models with graph-based context information to better understand textual datacited by 1
  4. 2024SocialPET: Socially Informed Pattern Exploiting Training for Few-Shot Stance Detection in Social Mediacited by 1
  5. 2024Enriched BERT Embeddings for Scholarly Publication Classificationcited by 1
  6. 2023MessageNet: Message Classification using Natural Language Processing and Meta-datacited by 0
  7. 2023Leveraging Knowledge Graph Embeddings to Enhance Contextual Representations for Relation Extractioncited by 0
  8. 2023Leveraging Pre-trained Language Models for Time Interval Prediction in Text-Enhanced Temporal Knowledge Graphscited by 0
  9. 2024Relational Graph Convolutional Networks for Sentiment Analysiscited by 0
  10. 2025FuDoBa: Fusing Document and Knowledge Graph-based Representations with Bayesian Optimisationcited by 0