RakutenAI-7B: Extending Large Language Models for Japanese
Not on the map. Why?
Abstract (arXiv)
We introduce RakutenAI-7B, a suite of Japanese-oriented large language models that achieve the best performance on the Japanese LM Harness benchmarks among the open 7B models. Along with the foundation model, we release instruction- and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat respectively, under the Apache 2.0 license.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 21 Mar 2024.
Builds on
10 of 17 references.
References · 10
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
- 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
- 2020The Multilingual Amazon Reviews Corpuscited by 142
- 2018ROUGE 2.0: Updated and Improved Measures for Evaluation of Summarization Taskscited by 66
Built on by
Citing papers per year: 2024: 7; 2025: 4; 2026: 2.
13 papers.
Sort:
By area:
- 2024Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Modelscited by 45
- 2024Exploring Design Choices for Building Language-Specific LLMscited by 22
- 2024Meltemi: The first open Large Language Model for Greekcited by 16
- 2024Adapting LLMs to Hebrew: Unveiling DictaLM 2.0 with Enhanced Vocabulary and Instruction Capabilitiescited by 13
- 2024SUTRA: Scalable Multilingual Language Model Architecturecited by 11
- 2025TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarkingcited by 9
- 2025Continually Adding New Languages to Multilingual Language Modelscited by 7
- 2025A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMscited by 5
- 2024Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMscited by 4
- 2026XL-SafetyBench: A Country-Grounded Cross-Cultural Benchmark for LLM Safety and Cultural Sensitivitycited by 1
- 2024SnakModel: Lessons Learned from Training an Open Danish Large Language Modelcited by 0
- 2025Exploring Gender Bias Beyond Occupational Titlescited by 0
1 more
- 2026A Locally Deployed RAG-Based Academic Advising System for Course Selection2 Jun 2026
- 2026XL-SafetyBench: A Country-Grounded Cross-Cultural Benchmark for LLM Safety and Cultural Sensitivity7 May 2026
- 2025Continually Adding New Languages to Multilingual Language Models14 Sep 2025
- 2025Exploring Gender Bias Beyond Occupational Titles3 Jul 2025
- 2025A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMs27 Jun 2025
- 2025TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarking16 Feb 2025
- 2024Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs19 Dec 2024
- 2024SnakModel: Lessons Learned from Training an Open Danish Large Language Model17 Dec 2024
- 2024Meltemi: The first open Large Language Model for Greek30 Jul 2024
- 2024Adapting LLMs to Hebrew: Unveiling DictaLM 2.0 with Enhanced Vocabulary and Instruction Capabilities9 Jul 2024
- 2024Exploring Design Choices for Building Language-Specific LLMs20 Jun 2024
- 2024Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models8 May 2024
1 more
- 2024SUTRA: Scalable Multilingual Language Model Architecture7 May 2024
- 2024SUTRA: Scalable Multilingual Language Model Architecturecited by 11
- 2024SUTRA: Scalable Multilingual Language Model Architecture7 May 2024
- 2024Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Modelscited by 45
- 2024Exploring Design Choices for Building Language-Specific LLMscited by 22
- 2024Meltemi: The first open Large Language Model for Greekcited by 16
- 2024Adapting LLMs to Hebrew: Unveiling DictaLM 2.0 with Enhanced Vocabulary and Instruction Capabilitiescited by 13
- 2025TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarkingcited by 9
- 2025Continually Adding New Languages to Multilingual Language Modelscited by 7
- 2025A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMscited by 5
- 2024Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMscited by 4
- 2024SnakModel: Lessons Learned from Training an Open Danish Large Language Modelcited by 0
- 2025Exploring Gender Bias Beyond Occupational Titlescited by 0
- 2026A Locally Deployed RAG-Based Academic Advising System for Course Selectioncited by 0
- 2026A Locally Deployed RAG-Based Academic Advising System for Course Selection2 Jun 2026
- 2025Continually Adding New Languages to Multilingual Language Models14 Sep 2025
- 2025Exploring Gender Bias Beyond Occupational Titles3 Jul 2025
- 2025A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMs27 Jun 2025
- 2025TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarking16 Feb 2025
- 2024Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs19 Dec 2024
- 2024SnakModel: Lessons Learned from Training an Open Danish Large Language Model17 Dec 2024
- 2024Meltemi: The first open Large Language Model for Greek30 Jul 2024
- 2024Adapting LLMs to Hebrew: Unveiling DictaLM 2.0 with Enhanced Vocabulary and Instruction Capabilities9 Jul 2024
- 2024Exploring Design Choices for Building Language-Specific LLMs20 Jun 2024
- 2024Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models8 May 2024