mlsanityData to 14 Oct 2026

Same Author or Just Same Topic? Towards Content-Independent Style Representations

arXiv 2204.04907 ↗First posted 11 Apr 2022cs.CLcited by 86

Not on the map. Why?

Abstract (arXiv)

Linguistic style is an integral component of language. Recent advances in the development of style representations have increasingly used training objectives from authorship verification (AV): Do two texts have the same author? The assumption underlying the AV training task (same author approximates same writing style) enables self-supervised and, thus, extensive training. However, a good performance on the AV task does not ensure good "general-purpose" style representations. For example, as the same author might typically write about certain topics, representations trained on AV might also encode content information instead of style alone. We introduce a variation of the AV training task that controls for content using conversation or domain labels. We evaluate whether known style dimensions are represented and preferred over content information through an original variation to the recently proposed STEL framework. We find that representations trained by controlling for conversation are better than representations trained with domain or no content control at representing style independent from content.

Key facts. Cited by 86 papers in the map (data through 14 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 11 Apr 2022.

Builds on

22 of 45 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  5. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  6. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
  7. 2018Hypothesis Only Baselines in Natural Language Inferencecited by 295
  8. 2018SentEval: An Evaluation Toolkit for Universal Sentence Representationscited by 294
  9. 2020The Pushshift Reddit Datasetcited by 292
  10. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  11. 2017Controlling Linguistic Style Aspects in Neural Language Generationcited by 149
  12. 2020ConvoKit: A Toolkit for the Analysis of Conversationscited by 72
10 more
  1. 2016Personalized Machine Translation: Preserving Original Author Traitscited by 47
  2. 2018Learning Semantic Textual Similarity from Conversationscited by 41
  3. 2019Explainable Authorship Verification in Social Media via Attention-based Similarity Learningcited by 37
  4. 2021DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddingscited by 19
  5. 2020The Importance of Suppressing Domain Style in Authorship Analysiscited by 18
  6. 2021Idiosyncratic but not Arbitrary: Learning Idiolects in Online Registers Reveals Distinctive yet Consistent Individual Stylescited by 18
  7. 2021Does It Capture STEL? A Modular, Similarity-based Linguistic Style Evaluation Frameworkcited by 17
  8. 2019Siamese Networks for Large-Scale Author Identificationcited by 12
  9. 2019Similarity Learning for Authorship Verification in Social Mediacited by 11
  10. 2021DeepStyle: User Style Embedding for Authorship Attribution of Short Textscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 12; 2024: 19; 2025: 28; 2026: 24.

86 papers.

Sort:

By area:

  1. 2024Can Large Language Models Identify Authorship?cited by 41
  2. 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 41
  3. 2024Few-Shot Detection of Machine-Generated Text using Style Representationscited by 40
  4. 2025Modifying Large Language Model Post-Training for Diverse Creative Writingcited by 40
  5. 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 35
  6. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
  7. 2024CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Followingcited by 33
  8. 2023Learning Interpretable Style Embeddings via Prompting LLMscited by 30
  9. 2023RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generationcited by 25
  10. 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Textscited by 23
  11. 2023ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfercited by 18
  12. 2023Can Authorship Representation Learning Capture Stylistic Features?cited by 17
38 more
  1. 2024TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddingscited by 17
  2. 2022PART: Pre-trained Authorship Representation Transformercited by 13
  3. 2025Tokenization is Sensitive to Language Variationcited by 13
  4. 2023Understanding writing style in social media with a supervised contrastively pre-trained transformercited by 12
  5. 2022VeriDark: A Large-Scale Benchmark for Authorship Verification on the Dark Webcited by 10
  6. 2022Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?cited by 9
  7. 2023Learning to Generate Text in Arbitrary Writing Stylescited by 9
  8. 2025Leveraging Multilingual Training for Authorship Representation: Enhancing Generalization across Languages and Domainscited by 8
  9. 2023Can Authorship Attribution Models Distinguish Speakers in Speech Transcripts?cited by 7
  10. 2024Customizing Large Language Model Generation Style using Parameter-Efficient Finetuningcited by 7
  11. 2024Latent Space Interpretation for Stylistic Analysis and Explainable Authorship Attributioncited by 7
  12. 2023ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfercited by 5
  13. 2025Steering Large Language Models with Register Analysis for Arbitrary Style Transfercited by 5
  14. 2024Distinguishing Fictional Voices: a Study of Authorship Verification Models for Quotation Attributioncited by 4
  15. 2024Grammar as a Behavioral Biometric: Using Cognitively Motivated Grammar Models for Authorship Verificationcited by 4
  16. 2024Speaker Verification in Agent-Generated Conversationscited by 4
  17. 2025Decoding Human Preferences in Alignment: An Improved Approach to Inverse Constitutional AIcited by 4
  18. 2025Tuning-Free Personalized Alignment via Trial-Error-Explain In-Context Learningcited by 4
  19. 2025Residualized Similarity for Faithfully Explainable Authorship Verificationcited by 4
  20. 2023VendorLink: An NLP approach for Identifying & Linking Vendor Migrants & Potential Aliases on Darknet Marketscited by 3
  21. 2023IDTraffickers: An Authorship Attribution Dataset to link and connect Potential Human-Trafficking Operations on Text Escort Advertisementscited by 3
  22. 2024Improving Quotation Attribution with Fictional Character Embeddingscited by 3
  23. 2024CAVE: Controllable Authorship Verification Explanationscited by 3
  24. 2024StyEmp: Stylizing Empathetic Response Generation via Multi-Grained Prefix Encoder and Personality Reinforcementcited by 3
  25. 2025Evaluating Style-Personalized Text Generation: Challenges and Directionscited by 3
  26. 2025Content Anonymization for Privacy in Long-form Audiocited by 3
  27. 2024WordDecipher: Enhancing Digital Workspace Communication with Explainable AI for Non-native English Speakerscited by 2
  28. 2024Addressing Topic Leakage in Cross-Topic Evaluation for Authorship Verificationcited by 2
  29. 2025Layered Insights: Generalizable Analysis of Authorial Style by Leveraging All Transformer Layerscited by 2
  30. 2025We Need to Measure Data Diversity in NLP -- Better and Broadercited by 2
  31. 2025The Impact of Automatic Speech Transcription on Speaker Attributioncited by 2
  32. 2025Latent Traits and Cross-Task Transfer: Deconstructing Dataset Interactions in LLM Fine-tuningcited by 2
  33. 2025A stylometric analysis of speaker attribution from speech transcriptscited by 2
  34. 2026Rewarding Creativity: A Human-Aligned Generative Reward Model for Reinforcement Learning in Storytellingcited by 2
  35. 2026IDIOLEX: Unified and Continuous Representations for Idiolectal and Stylistic Variationcited by 2
  36. 2026MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignmentcited by 2
  37. 2023Authorship identification under domain shift: a survey of stylistic measures and learned author representationscited by 1
  38. 2024Misinformation is not about Bad Facts: An Analysis of the Production and Consumption of Fringe Contentcited by 1

50 most cited of 86 All 86 (JSON)