TF1-EN-3M: Three Million Synthetic Moral Fables for Training Small, Open Language Models
Not on the map. Why?
Abstract (arXiv)
Moral stories are a time-tested vehicle for transmitting values, yet modern NLP lacks a large, structured corpus that couples coherent narratives with explicit ethical lessons. We present TF1-EN-3M, to our knowledge the first open dataset of three million English-language fables generated exclusively by instruction-tuned models no larger than 8B parameters. Each story follows a six-slot scaffold (character -> trait -> setting -> conflict -> resolution -> moral), produced through a combinatorial prompt engine that guarantees genre fidelity while covering a broad thematic space. A fully reproducible evaluation pipeline employs a panel of open-weight LLM judges from distinct model families, scoring grammar, creativity, moral clarity, and template adherence, complemented by reference-free diversity and readability metrics. Among ten open-weight generator candidates, an 8B-parameter Llama-3 variant delivers the best quality-cost trade-off, producing high-scoring fables on consumer hardware at approximately 0.135 per 1,000 fables. We release the dataset, generation code, evaluation scripts, and full metadata under a permissive license, enabling exact reproducibility and cost benchmarking. TF1-EN-3M opens avenues for research in instruction following, narrative intelligence, value alignment, and child-friendly educational AI -- demonstrating that large-scale moral storytelling requires neither proprietary giant models nor proprietary evaluation infrastructure.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 29 Apr 2025.
Builds on
30 of 45 references.
References · 30
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2018Datasheets for Datasetscited by 1,386
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2023Textbooks Are All You Needcited by 569
18 more
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
- 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 449
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 417
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
- 2023Scaling Data-Constrained Language Modelscited by 403
- 2022Unnatural Instructions: Tuning Language Models with (Almost) No Human Laborcited by 397
- 2023GPTScore: Evaluate as You Desirecited by 361
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 244
- 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 234
- 2021Reframing Instructional Prompts to GPTk's Languagecited by 176
- 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 135
- 2020Trading Off Diversity and Quality in Natural Language Generationcited by 96
- 2014Narrative Planning: Balancing Plot and Charactercited by 61
- 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Codecited by 61
- 2022A Corpus for Understanding and Generating Moral Storiescited by 16
- 2025Leveraging LLMs as Meta-Judges: A Multi-Agent Framework for Evaluating LLM Judgmentscited by 16
- 2024A Comparative Study of Quality Evaluation Methods for Text Summarizationcited by 13
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.