No Language is an Island: Unifying Chinese and English in Financial Large Language Models, Instruction Data, and Benchmarks
Not on the map. Why?
Abstract (arXiv)
While the progression of Large Language Models (LLMs) has notably propelled financial analysis, their application has largely been confined to singular language realms, leaving untapped the potential of bilingual Chinese-English capacity. To bridge this chasm, we introduce ICE-PIXIU, seamlessly amalgamating the ICE-INTENT model and ICE-FLARE benchmark for bilingual financial analysis. ICE-PIXIU uniquely integrates a spectrum of Chinese tasks, alongside translated and original English datasets, enriching the breadth and depth of bilingual financial modeling. It provides unrestricted access to diverse model variants, a substantial compilation of diverse cross-lingual and multi-modal instruction data, and an evaluation benchmark with expert annotations, comprising 10 NLP tasks, 20 bilingual specific tasks, totaling 95k datasets. Our thorough evaluation emphasizes the advantages of incorporating these bilingual datasets, especially in translation tasks and utilizing original English data, enhancing both linguistic flexibility and analytical acuity in financial contexts. Notably, ICE-INTENT distinguishes itself by showcasing significant enhancements over conventional LLMs and existing financial LLMs in bilingual milieus, underscoring the profound impact of robust bilingual data on the accuracy and efficacy of financial NLP.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 37 of its 74 references that are in the map. First posted on arXiv 10 Mar 2024.
Builds on
37 of 74 references.
References · 37
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Qwen Technical Reportcited by 3,273
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2023Baichuan 2: Open Large-scale Language Modelscited by 664
25 more
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
- 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 277
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
- 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
- 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
- 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
- 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
- 2020Impact of News on the Commodity Market: Dataset and Resultscited by 80
- 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 80
- 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 73
- 2023DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningcited by 64
- 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
- 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
- 2023The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challengescited by 59
- 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
- 2021Trade the Event: Corporate Events Detection for News-Based Event-Driven Tradingcited by 39
- 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
- 2023FinVis-GPT: A Multimodal Large Language Model for Financial Chart Analysiscited by 27
- 2023FiNER-ORD: Financial Named Entity Recognition Open Research Datasetcited by 17
- 2023PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensationcited by 17
- 2022Astock: A New Dataset and Automated Stock Trading based on Stock-specific News Analyzing Modelcited by 12
- 2023CGCE: A Chinese Generative Chat Evaluation Benchmark for General and Financial Domainscited by 7
Built on by
Citing papers per year: 2024: 4; 2025: 1; 2026: 2.
7 papers.
- 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 112
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
- 2024CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Modelscited by 12
- 2024Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Modelscited by 4
- 2025Advancing Financial Engineering with Foundation Models: Progress, Applications, and Challengescited by 4
- 2026From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discoverycited by 4
- 2026TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practicecited by 0
- 2026From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discovery14 May 2026
- 2026TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice10 Apr 2026
- 2025Advancing Financial Engineering with Foundation Models: Progress, Applications, and Challenges7 Jul 2025
- 2024Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models9 Nov 2024
- 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making9 Jul 2024
- 2024CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models2 Jul 2024
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges15 Jun 2024