mlsanityData to 14 Oct 2026

Frankentext: Stitching random text fragments into long-form narratives

arXiv 2505.18128 ↗First posted 23 May 2025cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

We introduce Frankentexts, a long-form narrative generation paradigm that treats an LLM as a composer of existing texts rather than as an author. Given a writing prompt and thousands of randomly sampled human-written snippets, the model is asked to produce a narrative under the extreme constraint that most tokens (e.g., 90%) must be copied verbatim from the provided paragraphs. This task is effectively intractable for humans: selecting and ordering snippets yields a combinatorial search space that an LLM implicitly explores, before minimally editing and stitching together selected fragments into a coherent long-form story. Despite the extreme challenge of the task, we observe through extensive automatic and human evaluation that Frankentexts significantly improve over vanilla LLM generations in terms of writing quality, diversity, and originality while remaining coherent and relevant to the prompt. Furthermore, Frankentexts pose a fundamental challenge to detectors of AI-generated text: 72% of Frankentexts produced by our best Gemini 2.5 Pro configuration are misclassified as human-written by Pangram, a state-of-the-art detector. Human annotators praise Frankentexts for their inventive premises, vivid descriptions, and dry humor; on the other hand, they identify issues with abrupt tonal shifts and uneven grammar across segments, particularly in longer pieces. The emergence of high-quality Frankentexts raises serious questions about authorship and copyright: when humans provide the raw materials and LLMs orchestrate them into new narratives, who truly owns the result?

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 71 of its 131 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

71 of 131 references.

References · 71

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2017Billion-scale similarity search with GPUscited by 2,497
  6. 2018Hierarchical Neural Story Generationcited by 1,193
  7. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  8. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  9. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  10. 2023A Watermark for Large Language Modelscited by 725
  11. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
  12. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
38 more
  1. 2023Can AI-Generated Text be Reliably Detected?cited by 386
  2. 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
  3. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  4. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
  5. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
  6. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  7. 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 234
  8. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  9. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
  10. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
  11. 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 144
  12. 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
  13. 2019Strategies for Structuring Story Generationcited by 124
  14. 2023Skywork: A More Open Bilingual Foundation Modelcited by 112
  15. 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 105
  16. 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
  17. 2023OUTFOX: LLM-Generated Essay Detection Through In-Context Learning with Adversarially Generated Examplescited by 80
  18. 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 80
  19. 2022Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writingcited by 71
  20. 2022Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writerscited by 69
  21. 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
  22. 2022Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Textcited by 63
  23. 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
  24. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  25. 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
  26. 2023Red Teaming Language Model Detectors with Language Modelscited by 55
  27. 2024LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?cited by 49
  28. 2024LongGenBench: Benchmarking Long-Form Generation in Long Context LLMscited by 47
  29. 2023Large Language Models can be Guided to Evade AI-Generated Text Detectioncited by 44
  30. 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 42
  31. 2025People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated textcited by 40
  32. 2024Technical Report on the Pangram AI-Generated Text Classifiercited by 34
  33. 2024Suri: Multi-constraint Instruction Following for Long-form Text Generationcited by 34
  34. 2024PostMark: A Robust Blackbox Watermark for Large Language Modelscited by 29
  35. 2024Beemo: Benchmark of Expert-edited Machine-generated Outputscited by 27
  36. 2024CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysiscited by 26
  37. 2024LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detectioncited by 25
  38. 2025AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computationcited by 25

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.