mlsanityData to 14 Oct 2026

TigerBot: An Open Multilingual Multitask LLM

arXiv 2312.08688 ↗First posted 14 Dec 2023cs.CL cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

We release and introduce the TigerBot family of large language models (LLMs), consisting of base and chat models, sized from 7, 13, 70 and 180 billion parameters. We develop our models embarking from Llama-2 and BLOOM, and push the boundary further in data, training algorithm, infrastructure, and application tools. Our models yield meaningful performance gain over SOTA open-source models, e.g., Llama-2, specifically 6% gain in English and 20% gain in Chinese. TigerBot model family also achieves leading performance in major academic and industrial benchmarks and leaderboards. We believe that TigerBot represents just a snapshot of lightning-fast progression in LLM open-source community. Therefore, we are thrilled to give back by publicly releasing our models and reporting our approach behind, with additional emphases on building SOTA LLMs in a democratized way and making LLMs of use in real-world applications.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 14 Dec 2023.

Builds on

24 of 31 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  10. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  11. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  12. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
12 more
  1. 2020GLU Variants Improve Transformercited by 1,804
  2. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  3. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  4. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  5. 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 632
  6. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
  7. 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 526
  8. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
  9. 2023Effective Long-Context Scaling of Foundation Modelscited by 303
  10. 2021Recursively Summarizing Books with Human Feedbackcited by 290
  11. 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Readingcited by 133
  12. 2023ChatHaruhi: Reviving Anime Character in Reality via Large Language Modelcited by 59

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 9; 2025: 5; 2026: 1.

15 papers.

Sort:

By area:

  1. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 116
  2. 2024Large Language Model Safety: A Holistic Surveycited by 59
  3. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 51
  4. 2025Reasoning Beyond Limits: Advances and Open Problems for LLMscited by 16
  5. 2024C-LLM: Learn to Check Chinese Spelling Errors Character by Charactercited by 12
  6. 2024CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Modelscited by 12
  7. 2024CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Modelscited by 11
  8. 2024CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Modelscited by 10
  9. 2024UniRS: Unifying Multi-temporal Remote Sensing Tasks through Vision Language Modelscited by 9
  10. 2024Hit the Sweet Spot! Span-Level Ensemble for Large Language Modelscited by 8
  11. 2025How Social is It? A Benchmark for LLMs' Capabilities in Multi-user Multi-turn Social Agent Taskscited by 4
  12. 2025LLaSO: A Foundational Framework for Reproducible Research in Large Language and Speech Modelcited by 3
3 more
  1. 2024NumLLM: Numeric-Sensitive Large Language Model for Chinese Financecited by 1
  2. 2025FactGuard: Leveraging Multi-Agent Systems to Generate Answerable and Unanswerable Questions for Enhanced Long-Context LLM Extractioncited by 1
  3. 2026Adversarial Alignment: Ensuring Value Consistency in Large Language Models for Sensitive Domainscited by 0