Frankentext: Stitching random text fragments into long-form narratives
Not on the map. Why?
Abstract (arXiv)
We introduce Frankentexts, a long-form narrative generation paradigm that treats an LLM as a composer of existing texts rather than as an author. Given a writing prompt and thousands of randomly sampled human-written snippets, the model is asked to produce a narrative under the extreme constraint that most tokens (e.g., 90%) must be copied verbatim from the provided paragraphs. This task is effectively intractable for humans: selecting and ordering snippets yields a combinatorial search space that an LLM implicitly explores, before minimally editing and stitching together selected fragments into a coherent long-form story. Despite the extreme challenge of the task, we observe through extensive automatic and human evaluation that Frankentexts significantly improve over vanilla LLM generations in terms of writing quality, diversity, and originality while remaining coherent and relevant to the prompt. Furthermore, Frankentexts pose a fundamental challenge to detectors of AI-generated text: 72% of Frankentexts produced by our best Gemini 2.5 Pro configuration are misclassified as human-written by Pangram, a state-of-the-art detector. Human annotators praise Frankentexts for their inventive premises, vivid descriptions, and dry humor; on the other hand, they identify issues with abrupt tonal shifts and uneven grammar across segments, particularly in longer pieces. The emergence of high-quality Frankentexts raises serious questions about authorship and copyright: when humans provide the raw materials and LLMs orchestrate them into new narratives, who truly owns the result?
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 71 of its 131 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
71 of 131 references.
References · 71
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2023A Watermark for Large Language Modelscited by 725
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
38 more
- 2023Can AI-Generated Text be Reliably Detected?cited by 386
- 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
- 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 234
- 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 144
- 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
- 2019Strategies for Structuring Story Generationcited by 124
- 2023Skywork: A More Open Bilingual Foundation Modelcited by 112
- 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 105
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
- 2023OUTFOX: LLM-Generated Essay Detection Through In-Context Learning with Adversarially Generated Examplescited by 80
- 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 80
- 2022Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writingcited by 71
- 2022Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writerscited by 69
- 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
- 2022Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Textcited by 63
- 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
- 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
- 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
- 2023Red Teaming Language Model Detectors with Language Modelscited by 55
- 2024LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?cited by 49
- 2024LongGenBench: Benchmarking Long-Form Generation in Long Context LLMscited by 47
- 2023Large Language Models can be Guided to Evade AI-Generated Text Detectioncited by 44
- 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 42
- 2025People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated textcited by 40
- 2024Technical Report on the Pangram AI-Generated Text Classifiercited by 34
- 2024Suri: Multi-constraint Instruction Following for Long-form Text Generationcited by 34
- 2024PostMark: A Robust Blackbox Watermark for Large Language Modelscited by 29
- 2024Beemo: Benchmark of Expert-edited Machine-generated Outputscited by 27
- 2024CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysiscited by 26
- 2024LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detectioncited by 25
- 2025AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computationcited by 25
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026GPTZero: Robust Detection of LLM-Generated Textscited by 11
- 2026StoryScope: Investigating idiosyncrasies in AI fictioncited by 9
- 2026LLMs Exhibit Significantly Lower Uncertainty in Creative Writing Than Professional Writerscited by 4
- 2026Spoiler Alert: Narrative Forecasting as a Metric for Tension in LLM Storytellingcited by 1
- 2026Which course? Discourse! Teaching Discourse and Generation in the Era of LLMscited by 0
- 2026GENIE: A Fine-Grained Measure for Noveltycited by 0
- 2026Agents Can Use Base Models to Evade AI Detectioncited by 0
- 2026Scaling Long-Form Story Generation via Narrative State Trackingcited by 0
- 2026Scaling Long-Form Story Generation via Narrative State Tracking28 Sep 2026
- 2026Agents Can Use Base Models to Evade AI Detection25 Sep 2026
- 2026GENIE: A Fine-Grained Measure for Novelty11 Jun 2026
- 2026Spoiler Alert: Narrative Forecasting as a Metric for Tension in LLM Storytelling10 Apr 2026
- 2026StoryScope: Investigating idiosyncrasies in AI fiction3 Apr 2026
- 2026LLMs Exhibit Significantly Lower Uncertainty in Creative Writing Than Professional Writers18 Feb 2026
- 2026GPTZero: Robust Detection of LLM-Generated Texts13 Feb 2026
- 2026Which course? Discourse! Teaching Discourse and Generation in the Era of LLMs2 Feb 2026