Chinese-Jev: Bringing System One Model to Chinese-Language Tasks
Not on the map. Why?
Abstract (arXiv)
System One models such as Jev offer an efficient alternative to generative language models for tasks that require decisions rather than open-ended responses. However, existing Jev models exhibit limited Chinese-language decision accuracy, restricting their utility in both general and specialized settings. In this paper, we introduce Chinese-Jev, a System One model that addresses this gap through a unified data processing and training pipeline. Our data processing protocol converts heterogeneous Chinese-language annotations into probability targets over candidate options, enabling a shared training formulation across domains and question formats. To enable efficient inference, Chinese-Jev adopts a lightweight encoder-only backbone for text encoding and learns to score candidate answers through decision-oriented training. To address the misalignment between the pre-training distribution and downstream Chinese-language scenarios, we first train the model on a general-purpose corpus of 10 million examples, then fine-tune it separately for the medical, legal, and financial domains. To evaluate decision accuracy and calibration in both general and domain-specific Chinese-language settings, we introduce Chinese-Jev Bench (CJ-Bench). After first-stage pre-training, Chinese-Jev exceeds the accuracy of the closed-source Jev model by 1.24% on general-domain tasks while achieving a 20.3x speedup. Subsequent domain-specific fine-tuning yields a 4.0% accuracy improvement over Jev in medicine and achieves 92% of Jev's average accuracy across specialized domains, with a 17x speedup and an average latency of only 15 ms per example. We further demonstrate on-device deployment of an INT8-quantized model on mobile devices, achieving an inference latency of approximately 1.0 second per decision. The project is available at https://gulucaptain.github.io/Chinese-Jev/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
39 of 60 references.
References · 39
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 861
- 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
- 2019Passage Re-ranking with BERTcited by 645
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
27 more
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 278
- 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 264
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 146
- 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 115
- 2021CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmarkcited by 101
- 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 91
- 2020OCNLI: Original Chinese Natural Language Inferencecited by 86
- 2019Investigating Prior Knowledge for Challenging Chinese Machine Reading Comprehensioncited by 81
- 2019ChID: A Large-scale Chinese IDiom Dataset for Cloze Testcited by 65
- 2023T2Ranking: A large-scale Chinese Benchmark for Passage Rankingcited by 60
- 2024COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuningcited by 45
- 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
- 2023LeCaRDv2: A Large-Scale Chinese Legal Case Retrieval Datasetcited by 38
- 2022CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AIcited by 26
- 2024Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Datasetcited by 23
- 2018GILE: A Generalized Input-Label Embedding for Text Classificationcited by 22
- 2023Building Efficient Universal Classifiers with Natural Language Inferencecited by 22
- 2022Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale Extractioncited by 21
- 2021ASAP: A Chinese Review Dataset Towards Aspect Category Sentiment Analysis and Rating Predictioncited by 18
- 2025GLiClass: Generalist Lightweight Model for Sequence Classification Taskscited by 15
- 2020A Sentence Cloze Dataset for Chinese Machine Reading Comprehensioncited by 14
- 2017Which Encoding is the Best for Text Classification in Chinese, English, Japanese and Korean?cited by 10
- 2023Collective Human Opinions in Semantic Textual Similaritycited by 8
- 2025Evaluating, Synthesizing, and Enhancing for Customer Support Conversationcited by 7
- 2025AppealCase: A Dataset and Benchmark for Civil Case Appeal Scenarioscited by 3
- 2025ClaimGen-CN: A Large-scale Chinese Dataset for Legal Claim Generationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values
- 2025Cheems: A Practical Guidance for Building and Evaluating Chinese Reward Models from Scratch
- 2024Enhancing Function-Calling Capabilities in LLMs: Strategies for Prompt Formats, Data Integration, and Multilingual Translation
- 2026Specialized Decision Models vs. General-Purpose LLMs: Benchmarking Jev Across Knowledge, Reasoning, and Multilingual Tasks
- 2024Yi: Open Foundation Models by 01.AI
- 2025C-VARC: A Large-Scale Chinese Value Rule Corpus for Value Alignment of Large Language Models
- 2025SSR-Zero: Simple Self-Rewarding Reinforcement Learning for Machine Translation
- 2025CCI4.0: A Bilingual Pretraining Dataset for Enhancing Reasoning in Large Language Models