mlsanityData to 7 Oct 2026

No Language is an Island: Unifying Chinese and English in Financial Large Language Models, Instruction Data, and Benchmarks

arXiv 2403.06249 ↗First posted 10 Mar 2024cs.CE cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

While the progression of Large Language Models (LLMs) has notably propelled financial analysis, their application has largely been confined to singular language realms, leaving untapped the potential of bilingual Chinese-English capacity. To bridge this chasm, we introduce ICE-PIXIU, seamlessly amalgamating the ICE-INTENT model and ICE-FLARE benchmark for bilingual financial analysis. ICE-PIXIU uniquely integrates a spectrum of Chinese tasks, alongside translated and original English datasets, enriching the breadth and depth of bilingual financial modeling. It provides unrestricted access to diverse model variants, a substantial compilation of diverse cross-lingual and multi-modal instruction data, and an evaluation benchmark with expert annotations, comprising 10 NLP tasks, 20 bilingual specific tasks, totaling 95k datasets. Our thorough evaluation emphasizes the advantages of incorporating these bilingual datasets, especially in translation tasks and utilizing original English data, enhancing both linguistic flexibility and analytical acuity in financial contexts. Notably, ICE-INTENT distinguishes itself by showcasing significant enhancements over conventional LLMs and existing financial LLMs in bilingual milieus, underscoring the profound impact of robust bilingual data on the accuracy and efficacy of financial NLP.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 37 of its 74 references that are in the map. First posted on arXiv 10 Mar 2024.

Builds on

37 of 74 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2023Qwen Technical Reportcited by 3,273
  8. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  9. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  10. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  11. 2023BloombergGPT: A Large Language Model for Financecited by 923
  12. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
25 more
  1. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  2. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
  3. 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
  4. 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 277
  5. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  6. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  7. 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
  8. 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
  9. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  10. 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
  11. 2020Impact of News on the Commodity Market: Dataset and Resultscited by 80
  12. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 80
  13. 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 73
  14. 2023DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningcited by 64
  15. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  16. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  17. 2023The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challengescited by 59
  18. 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
  19. 2021Trade the Event: Corporate Events Detection for News-Based Event-Driven Tradingcited by 39
  20. 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
  21. 2023FinVis-GPT: A Multimodal Large Language Model for Financial Chart Analysiscited by 27
  22. 2023FiNER-ORD: Financial Named Entity Recognition Open Research Datasetcited by 17
  23. 2023PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensationcited by 17
  24. 2022Astock: A New Dataset and Automated Stock Trading based on Stock-specific News Analyzing Modelcited by 12
  25. 2023CGCE: A Chinese Generative Chat Evaluation Benchmark for General and Financial Domainscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 1; 2026: 2.

7 papers.