BC Protocol: Structured Dual-Expert Dialogue for Eliciting High-Quality Chain-of-Thought Post-Training Data
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
High-quality expert chain-of-thought (CoT) data is one of the core bottlenecks in large language model (LLM) post-training. Existing data production methods each have structural limitations: crowdsourced annotation lacks deep reasoning paths; expert solo writing is constrained by the "expert blind spot" -- experts structurally skip reasoning steps they consider obvious; RLHF only produces preference signals rather than reasoning chains. This paper proposes the BC Protocol -- a structured dual-expert elicitation method for LLM post-training data production. The method carefully pairs a domain expert (crystallized intelligence) with a knowledge engineer (fluid intelligence), systematically externalizing the expert's implicit judgments as natural language reasoning chains. We introduce the Participant Aptitude Model, which defines six participant characteristic dimensions that affect elicitation quality. "Calibrated Ignorance" is an original concept proposed in this paper. We further propose "Selection-over-Prescription" as a methodological principle: for implicit knowledge elicitation tasks, investing quality-control resources in personnel selection yields a higher return than investing the same resources in process design. In a controlled experiment in the narrative fiction domain, we directly compared CoT produced by BC Protocol dual dialogue (Group A, (n=20)) against CoT written independently by the same domain expert (Group B, (n=20)). Three cross-vendor judge models -- GPT-4o, Claude Opus 4.5, and Gemini 2.5 Pro -- conducted blind evaluation across five dimensions (600 ratings total). Results show that the BC Protocol achieves an overwhelming advantage in "naturalness of reasoning process" (Group A mean 4.80 vs. Group B mean 1.30, (p=2.4×10-8), Cliff's (δ=1.0)).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 0 of its 10 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
0 of 10 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Leveraging Open Knowledge for Advancing Task Expertise in Large Language Models
- 2025Mixture of Thoughts: Learning to Aggregate What Experts Think, Not Just What They Say
- 2025ECCoT: A Framework for Enhancing Effective Cognition via Chain of Thought in Large Language Model
- 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation
- 2026Zipping the Thought: When and How Compressed Reasoning Data Works in LLM Post-Training
- 2023ThoughtSource: A central hub for large language model reasoning data
- 2026Making Expert Reasoning Learnable with Self-Distillation
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning