mlsanityData to 14 Oct 2026

Single-Sample Decoding of a Two-Layer Sound-Word Canvas Model for Thai Klon Pad

arXiv 2610.14980 ↗First posted 10 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a generator of Thai klon pad verse, one stanza from a short topic, and evaluate it against human verse on held-out topics. The generator is a masked language model initialised from WangchanBERTa over a fixed canvas with two layers: a sound layer of pronounced syllables, where rhyme, tone and syllable count are enforced as hard masks, and a word layer of whole words, so that no word is cut into written pieces. Decoding commits one cell at a time and samples at temperature 0.4; one sample is drawn per topic, with no selection, reranking or repair. On 78 held-out topics never used in development, judged by three independent runs of a frozen LLM judge in the same pools as the human stanzas from which the topics were written, 70.5% of the generated stanzas pass form, lexical cleanness of all four lines and topic alignment together, against 76.9% for the human stanzas (difference -6.4 points, 95% CI [-19.2, +6.4]). Cleanness is level with human (85.9% vs. 87.2%), and the stanzas pass form and cleanness together slightly more often than the human ones (+3.8 points, [-6.4, +14.1]); the difference lies in alignment (84.6% vs. 91.0%), on topics that were written from the human stanzas. The low temperature matters: at higher temperatures the same model passes clearly fewer of the same topics, because lexical errors lie in the model's lower-probability choices; sharpening the sampling distribution removes most of them, at a cost in vocabulary (7.5% rare words against 16.5% in the human stanzas) and diversity. The pre-registered target, all-three within 5 points of human, is missed by 1.4 points. KlonSuphap-LM, the only public klon pad generator we know of, passes none of the 78 held-out topics when judged in separate pools together with the method's and the human stanzas (form 19.2%, cleanness 3.8%).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

18 of 30 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  6. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  7. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  8. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 237
  9. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
  10. 2020NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraintscited by 149
  11. 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 146
  12. 2024Is Temperature the Creativity Parameter of Large Language Models?cited by 93
6 more
  1. 2023PyThaiNLP: Thai Natural Language Processing in Pythoncited by 28
  2. 2020SongNet: Rigid Formats Controlled Text Generationcited by 26
  3. 2021WangchanBERTa: Pretraining transformer-based Thai Language Modelscited by 26
  4. 2021DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modelingcited by 25
  5. 2022Zero-shot Sonnet Generation with Discourse-level Planning and Aesthetics Featurescited by 25
  6. 2023PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generationcited by 7

Built on by

Not cited yet.