Does the Linguistic Register of Thinking Matter? Wenyan as a Compact Reasoning Register for Chinese LLMs
On the map: LLM reasoning → Reasoning benchmarks and evaluation also fits: Test-time compute and efficient thinking
Abstract (arXiv)
Visible reasoning traces of Chinese reasoning-oriented LLMs are typically written in modern vernacular Chinese, which may be verbose under limited decoding budgets. We ask whether the linguistic register of reasoning can be used to improve efficiency. We propose Wenyan Thinking, which emits intermediate reasoning in Classical Chinese (wenyanwen) while retaining a short direct-answer output. Starting from modern-Chinese reasoning traces, we rewrite only the reasoning field into wenyan and fine-tune Qwen3-4B-Thinking-2507 on the rewritten supervision. To distinguish register shift from generic compression, we construct a compact modern-Chinese control using the same source data, teacher family, base model, and SFT recipe. Across budget-sensitive evaluations on MMLU-ProX-Lite-ZH, CEVAL, and AGIEval-CN, Wenyan Thinking substantially reduces reasoning length and missing-answer rates under constrained decoding. Compact rewriting explains much of the efficiency gain, while wenyan consistently outperforms the compact modern-Chinese control on the primary benchmark and remains competitive across the additional benchmarks. These results identify linguistic register as a practical design axis for efficient visible reasoning in Chinese LLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 28 of its 39 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
28 of 39 references.
Closest ancestors · 5
Same direction, newest first
- 2025A Comprehensive Evaluation of Multilingual Chain-of-Thought Reasoning: Performance, Consistency, and Faithfulness Across Languages10 Oct
- 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation13 Mar
- 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting11 May
- 2023Specializing Smaller Language Models towards Multi-Step Reasoning30 Jan
- 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct
Other references · 23
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Let's Verify Step by Stepcited by 3,789
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
11 more
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
- 2023Learning to Compress Prompts with Gist Tokenscited by 390
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectivenesscited by 119
- 2025Self-Training Elicits Concise Reasoning in Large Language Modelscited by 99
- 2024mCoT: Multilingual Instruction Tuning for Reasoning Consistency in Language Modelscited by 33
- 2023WYWEB: A NLP Evaluation Benchmark For Classical Chinesecited by 12
- 2025WenyanGPT: A Large Language Model for Classical Chinese Taskscited by 6
- 2024AC-EVAL: Evaluating Ancient Chinese Language Understanding in Large Language Modelscited by 5
- 2018Automatic Translating between Ancient Chinese and Contemporary Chinese with Limited Aligned Corporacited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations
- 2026ChLogic: Evaluating Robustness of Logical Reasoning in Chinese Expressions
- 2026From Reasoning Depth to Reasoning Breadth: Evaluating Multi-Point Associative Reasoning in Large Language Models
- 2026BrainBench: Exposing the Commonsense Reasoning Gap in Large Language Models
- 2026Reasoning or Memorization: Can LLMs Understand and Generate Chinese Xiehouyu Riddles?
- 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoning
- 2023An Empirical Study of Instruction-tuning Large Language Models in Chinese
- 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models