mlsanityData to 14 Oct 2026

Creative Quality Alignment: Expert Tacit Knowledge Transfer via Chain-of-Thought Fine-Tuning

arXiv 2605.25977 ↗First posted 25 May 2026cs.CL cs.AI cs.LGcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

This paper provides an empirical implementation of the creative quality metric proposed in Calibrated Surprise (Zou & Xu, 2026a). The question this paper addresses is: does this mathematical claim hold at the engineering level? To make the answer as general as possible, we deliberately choose the strictest engineering conditions: low data cost and a small base model. Training data comes from approximately 100 expert chain-of-thought (CoT) annotations produced by the BC Protocol (Zou & Xu, 2026b). We also identify a data bias: most publicly available alignment datasets are skewed toward craft-related knowledge, while audience modeling and reality-logic coverage are systematically weak. We use the term Creative Quality Alignment (CQA) to describe this class of engineering methods. We also offer a supporting theoretical observation: in an LLM with a single conditional distribution architecture, calibrating the appreciation side automatically transfers to the generation side via architectural duality. This is the structural reason why ~100 CoT examples are sufficient -- not a purely empirical observation like LIMA (Zhou et al., 2023).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 3 of its 21 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

3 of 21 references.

References · 3

  1. 2024Qwen2.5 Technical Reportcited by 4,942
  2. 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 243
  3. 2026Calibrated Surprise: An Information-Theoretic Account of Creative Qualitycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DesignerlyLoop: Forming Design Intent through Curated Reasoning for Human-LLM Alignment
  2. 2026CreativeBench: Benchmarking and Enhancing Machine Creativity via Self-Evolving Challenges
  3. 2025CreBench: Human-Aligned Creativity Evaluation from Idea to Process to Product
  4. 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativity
  5. 2026QUIET: A Multi-Blank Cascaded Story Cloze Benchmark for LLM Creative Generation Capability
  6. 2025Creative Preference Optimization
  7. 2026CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposing
  8. 2025LLMCode: Evaluating and Enhancing Researcher-AI Alignment in Qualitative Analysis ↗