mlsanityData to 7 Oct 2026

LG4AV: Combining Language Models and Graph Neural Networks for Author Verification

arXiv 2109.01479 ↗First posted 3 Sep 2021cs.LG cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

The automatic verification of document authorships is important in various settings. Researchers are for example judged and compared by the amount and impact of their publications and public figures are confronted by their posts on social media platforms. Therefore, it is important that authorship information in frequently used web services and platforms is correct. The question whether a given document is written by a given author is commonly referred to as authorship verification (AV). While AV is a widely investigated problem in general, only few works consider settings where the documents are short and written in a rather uniform style. This makes most approaches unpractical for online databases and knowledge graphs in the scholarly domain. Here, authorships of scientific publications have to be verified, often with just abstracts and titles available. To this point, we present our novel approach LG4AV which combines language models and graph neural networks for authorship verification. By directly feeding the available texts in a pre-trained transformer architecture, our model does not need any hand-crafted stylometric features that are not meaningful in scenarios where the writing style is, at least to some extent, standardized. By the incorporation of a graph neural network structure, our model can benefit from relations between authors that are meaningful with respect to the verification process. For example, scientific authors are more likely to write about topics that are addressed by their co-authors and twitter users tend to post about the same subjects as people they follow. We experimentally evaluate our model and study to which extent the inclusion of co-authorships enhances verification decisions in bibliometric environments.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 45 references that are in the map. First posted on arXiv 3 Sep 2021.

Builds on

19 of 45 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2019Simplifying Graph Convolutional Networkscited by 1,470
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  7. 2014Distributed Representations of Sentences and Documentscited by 677
  8. 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 540
  9. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  10. 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
  11. 2020On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinescited by 254
  12. 2020Revisiting Few-sample BERT Fine-tuningcited by 237
7 more
  1. 2018Construction of the Literature Graph in Semantic Scholarcited by 118
  2. 2014Growth rates of modern science: A bibliometric analysis based on the number of publications and cited referencescited by 63
  3. 2019Explainable Authorship Verification in Social Media via Attention-based Similarity Learningcited by 36
  4. 2015Author Identification using Multi-headed Recurrent Neural Networkscited by 13
  5. 2019Assessing the Applicability of Authorship Verification Methodscited by 11
  6. 2019Similarity Learning for Authorship Verification in Social Mediacited by 11
  7. 2019UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMscited by 7

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.