mlsanityData to 14 Oct 2026

Contrastive Learning for Authorship Verification

arXiv 2609.28471 ↗First posted 23 Sep 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Our results show that contrastive learning outperforms a classification-based approach to authorship verification under the tested settings. We identify loss function, batch size, training duration, pre-trained model, input context length, and random text span data augmentation as important factors of model performance. Based on these considerations, we develop a ModernBERT Bi-Encoder model that achieves 98.4% accuracy on the PAN21 authorship verification task.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

27 of 44 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2020Supervised Contrastive Learningcited by 2,829
  7. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  8. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
  9. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  10. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  11. 2019On Variational Bounds of Mutual Informationcited by 559
  12. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
15 more
  1. 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 403
  2. 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
  3. 2020A Metric Learning Reality Checkcited by 321
  4. 2022Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfercited by 288
  5. 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
  6. 2019SoftTriple Loss: Deep Metric Learning Without Triplet Samplingcited by 163
  7. 2021Scaling Deep Contrastive Learning Batch Size under Memory Limited Setupcited by 127
  8. 2019BERT for Coreference Resolution: Baselines and Analysiscited by 125
  9. 2019Improved Embeddings with Easy Positive Triplet Miningcited by 67
  10. 2020PyTorch Metric Learningcited by 57
  11. 2019Explainable Authorship Verification in Social Media via Attention-based Similarity Learningcited by 37
  12. 2025Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMscited by 35
  13. 2025Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Durationcited by 27
  14. 2021O2D2: Out-Of-Distribution Detector to Capture Undecidable Trials in Authorship Verificationcited by 6
  15. 2024Addressing Topic Leakage in Cross-Topic Evaluation for Authorship Verificationcited by 2

Built on by

Not cited yet.