How Large Language Models are Transforming Machine-Paraphrased Plagiarism
Not on the map. Why?
Abstract (arXiv)
The recent success of large language models for text generation poses a severe threat to academic integrity, as plagiarists can generate realistic paraphrases indistinguishable from original work. However, the role of large autoregressive transformers in generating machine-paraphrased plagiarism and their detection is still developing in the literature. This work explores T5 and GPT-3 for machine-paraphrase generation on scientific articles from arXiv, student theses, and Wikipedia. We evaluate the detection performance of six automated solutions and one commercial plagiarism detection software and perform a human study with 105 participants regarding their detection performance and the quality of generated examples. Our results suggest that large models can rewrite text humans have difficulty identifying as machine-paraphrased (53% mean acc.). Human experts rate the quality of paraphrases generated by GPT-3 as high as original texts (clarity 4.0/5, fluency 4.2/5, coherence 3.8/5). The best-performing detection model (GPT-3) achieves a 66% F1-score in detecting paraphrases.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 25 of its 54 references that are in the map. First posted on arXiv 7 Oct 2022.
Builds on
25 of 54 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2019Defending Against Neural Fake Newscited by 553
- 2018Universal Sentence Encodercited by 485
- 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
13 more
- 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
- 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
- 2020With Little Power Comes Great Responsibilitycited by 138
- 2016Neural Paraphrase Generation with Stacked Residual LSTM Networkscited by 52
- 2019Paraphrasing with Large Language Modelscited by 35
- 2016Neural Machine Translation with Reconstructioncited by 28
- 2021Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detectioncited by 17
- 2021Identifying Machine-Paraphrased Plagiarismcited by 16
- 2020Testing of Support Tools for Plagiarism Detectioncited by 11
- 2022D3: A Massive Dataset of Scholarly Metadata for Analyzing the State of Computer Science Researchcited by 11
- 2018Bi-Directional Differentiable Input Reconstruction for Low-Resource Neural Machine Translationcited by 4
- 2021Analyzing Non-Textual Content Elements to Detect Academic Plagiarismcited by 2
Built on by
Citing papers per year: 2023: 13; 2024: 11; 2025: 7; 2026: 7.
38 papers.
Sort:
By area:
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
- 2023Challenges and Applications of Large Language Modelscited by 251
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
- 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Textscited by 23
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2024Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Textcited by 16
- 2024Paraphrase Types Elicit Prompt Engineering Capabilitiescited by 15
- 2023Paraphrase Detection: Human vs. Machine Contentcited by 12
- 2023IMGTB: A Framework for Machine-Generated Text Detection Benchmarkingcited by 12
- 2024Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Bettercited by 11
26 more
- 2024Improving Black-box Robustness with In-Context Rewritingcited by 8
- 2023Academic Writing with GPT-3.5: Reflections on Practices, Efficacy and Transparencycited by 6
- 2023Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Modelscited by 6
- 2025mdok of KInIT: Robustly Fine-tuned LLM for Binary and Multiclass AI-Generated Text Detectioncited by 6
- 2023Reducing Sequence Length by Predicting Edit Operations with Large Language Modelscited by 5
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
- 2023Paraphrase Types for Generation and Detectioncited by 4
- 2024KInIT at SemEval-2024 Task 8: Fine-tuned LLMs for Multilingual Machine-Generated Text Detectioncited by 4
- 2025Detection of LLM-Paraphrased Code and Identification of the Responsible LLM Using Coding Style Featurescited by 4
- 2024FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism for Language Modelscited by 3
- 2024PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detectioncited by 3
- 2026Loci Similes: A Benchmark for Extracting Intertextualities in Latin Literaturecited by 3
- 2026Object Hallucination-Free Reinforcement Unlearning for Vision-Language Modelscited by 3
- 2024Towards Human Understanding of Paraphrase Types in Large Language Modelscited by 2
- 2025Overview of the Plagiarism Detection Task at PAN 2025cited by 2
- 2023Paraphrase Acquisition from Image Captionscited by 1
- 2024Task-Oriented Paraphrase Analyticscited by 1
- 2025Pub-Guard-LLM: Detecting Retracted Biomedical Articles with Reliable Explanationscited by 1
- 2025SPADE: Structured Prompting Augmentation for Dialogue Enhancement in Machine-Generated Text Detectioncited by 1
- 2025Affect, Body, Cognition, Demographics, and Emotion: The ABCDE of Text Features for Computational Affective Sciencecited by 1
- 2026On the Robustness of Machine Unlearning for Vision-Language Modelscited by 1
- 2025Teaching and Critiquing Conceptualization and Operationalization in NLPcited by 0
- 2026LLM or Human? Perceptions of Trust and Information Quality in Research Summariescited by 0
- 2026Variation is the Key: A Variation-Based Framework for LLM-Generated Text Detectioncited by 0
- 2026Beyond Representational Similarity: Source-Conditioned Description-Length Gain for Generative Plagiarism Detection and Candidate Source Rerankingcited by 0
- 2026Evaluating the Semantic-to-Geometric Gap in Adversarial Defenses Against Vision-Language Model-Based Plagiarismcited by 0
- 2026Evaluating the Semantic-to-Geometric Gap in Adversarial Defenses Against Vision-Language Model-Based Plagiarism22 Sep 2026
- 2026Beyond Representational Similarity: Source-Conditioned Description-Length Gain for Generative Plagiarism Detection and Candidate Source Reranking4 Aug 2026
- 2026On the Robustness of Machine Unlearning for Vision-Language Models26 May 2026
- 2026Object Hallucination-Free Reinforcement Unlearning for Vision-Language Models8 May 2026
- 2026Variation is the Key: A Variation-Based Framework for LLM-Generated Text Detection27 Jan 2026
- 2026LLM or Human? Perceptions of Trust and Information Quality in Research Summaries22 Jan 2026
- 2026Loci Similes: A Benchmark for Extracting Intertextualities in Latin Literature12 Jan 2026
- 2025Teaching and Critiquing Conceptualization and Operationalization in NLP20 Dec 2025
- 2025Affect, Body, Cognition, Demographics, and Emotion: The ABCDE of Text Features for Computational Affective Science19 Dec 2025
- 2025Overview of the Plagiarism Detection Task at PAN 20258 Oct 2025
- 2025mdok of KInIT: Robustly Fine-tuned LLM for Binary and Multiclass AI-Generated Text Detection2 Jun 2025
- 2025SPADE: Structured Prompting Augmentation for Dialogue Enhancement in Machine-Generated Text Detection19 Mar 2025
26 more
- 2025Detection of LLM-Paraphrased Code and Identification of the Responsible LLM Using Coding Style Features25 Feb 2025
- 2025Pub-Guard-LLM: Detecting Retracted Biomedical Articles with Reliable Explanations21 Feb 2025
- 2024Towards Human Understanding of Paraphrase Types in Large Language Models2 Jul 2024
- 2024Paraphrase Types Elicit Prompt Engineering Capabilities28 Jun 2024
- 2024PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection24 Jun 2024
- 2024FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism for Language Models2 Jun 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Text21 May 2024
- 2024Task-Oriented Paraphrase Analytics26 Mar 2024
- 2024KInIT at SemEval-2024 Task 8: Fine-tuned LLMs for Multilingual Machine-Generated Text Detection21 Feb 2024
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fields19 Feb 2024
- 2024Improving Black-box Robustness with In-Context Rewriting13 Feb 2024
- 2024Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better1 Feb 2024
- 2023IMGTB: A Framework for Machine-Generated Text Detection Benchmarking21 Nov 2023
- 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Texts14 Nov 2023
- 2023Paraphrase Types for Generation and Detection23 Oct 2023
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-44 Oct 2023
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment10 Aug 2023
- 2023Challenges and Applications of Large Language Models19 Jul 2023
- 2023Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Models15 Jun 2023
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing26 May 2023
- 2023Reducing Sequence Length by Predicting Edit Operations with Large Language Models19 May 2023
- 2023Paraphrase Detection: Human vs. Machine Content24 Mar 2023
- 2023Language Model Behavior: A Comprehensive Survey20 Mar 2023
- 2023Academic Writing with GPT-3.5: Reflections on Practices, Efficacy and Transparency12 Feb 2023
- 2023Paraphrase Acquisition from Image Captions26 Jan 2023
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
- 2023Challenges and Applications of Large Language Modelscited by 251
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
- 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Textscited by 23
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2024Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Textcited by 16
- 2024Paraphrase Types Elicit Prompt Engineering Capabilitiescited by 15
- 2023Paraphrase Detection: Human vs. Machine Contentcited by 12
- 2023IMGTB: A Framework for Machine-Generated Text Detection Benchmarkingcited by 12
- 2024Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Bettercited by 11
12 most cited of 34 All 34 (JSON)
- 2026Beyond Representational Similarity: Source-Conditioned Description-Length Gain for Generative Plagiarism Detection and Candidate Source Reranking4 Aug 2026
- 2026Variation is the Key: A Variation-Based Framework for LLM-Generated Text Detection27 Jan 2026
- 2026LLM or Human? Perceptions of Trust and Information Quality in Research Summaries22 Jan 2026
- 2026Loci Similes: A Benchmark for Extracting Intertextualities in Latin Literature12 Jan 2026
- 2025Teaching and Critiquing Conceptualization and Operationalization in NLP20 Dec 2025
- 2025Affect, Body, Cognition, Demographics, and Emotion: The ABCDE of Text Features for Computational Affective Science19 Dec 2025
- 2025Overview of the Plagiarism Detection Task at PAN 20258 Oct 2025
- 2025mdok of KInIT: Robustly Fine-tuned LLM for Binary and Multiclass AI-Generated Text Detection2 Jun 2025
- 2025SPADE: Structured Prompting Augmentation for Dialogue Enhancement in Machine-Generated Text Detection19 Mar 2025
- 2025Detection of LLM-Paraphrased Code and Identification of the Responsible LLM Using Coding Style Features25 Feb 2025
- 2025Pub-Guard-LLM: Detecting Retracted Biomedical Articles with Reliable Explanations21 Feb 2025
- 2024Paraphrase Types Elicit Prompt Engineering Capabilities28 Jun 2024
12 newest of 34 All 34 (JSON)