mlsanityData to 14 Oct 2026

LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs

arXiv 2407.03963 ↗First posted 4 Jul 2024cs.CL cs.AIcited by 33

Not on the map. Why?

Abstract (arXiv)

This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its activities, and technical reports on the LLMs developed by LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/.

Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 35 of its 59 references that are in the map. First posted on arXiv 4 Jul 2024.

Builds on

35 of 59 references.

References · 35

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  9. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  10. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  11. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  12. 2020Extracting Training Data from Large Language Modelscited by 2,189
23 more
  1. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  2. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  3. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  4. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
  5. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  6. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  7. 2020Aligning AI With Shared Human Valuescited by 723
  8. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  9. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 639
  10. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  11. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 387
  12. 2023Do Large Language Models Know What They Don't Know?cited by 243
  13. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
  14. 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 98
  15. 2023KoBBQ: Korean Bias Benchmark for Question Answeringcited by 71
  16. 2023Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpacacited by 60
  17. 2023Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Reviewcited by 50
  18. 2023CBBQ: A Chinese Bias Benchmark Dataset Curated with Human-AI Collaboration for Large Language Modelscited by 23
  19. 2022Compositional Evaluation on Japanese Textual Entailment and Similaritycited by 14
  20. 2022mdx: A Cloud Platform for Supporting Data Science and Cross-Disciplinary Research Collaborationscited by 8
  21. 2024JBBQ: Japanese Bias Benchmark for Analyzing Social Biases in Large Language Modelscited by 7
  22. 2023Jamp: Controlled Japanese Temporal Inference Dataset for Evaluating Generalization Capacity of Language Modelscited by 4
  23. 2024Rapidly Developing High-quality Instruction Data and Evaluation Benchmark for Large Language Models with Minimal Human Effort: A Case Study on Japanesecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 15; 2026: 10.

33 papers.

Sort:

By area:

  1. 2025Do Multilingual LLMs Think In English?cited by 78
  2. 2024Beyond English-Centric LLMs: What Language Do Multilingual Language Models Think in?cited by 41
  3. 2025Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initializationcited by 24
  4. 2024Repetition Neurons: How Do Language Models Produce Repetitions?cited by 23
  5. 2025The Emergence of Abstract Thought in Large Language Models Beyond Any Languagecited by 21
  6. 2025Massive Supervised Fine-tuning Experiments Reveal How Data, Layer, and Training Factors Shape LLM Alignment Qualitycited by 14
  7. 2024Understanding the Impact of Confidence in Retrieval Augmented Generation: A Case Study in the Medical Domaincited by 9
  8. 2024JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language Modelscited by 8
  9. 2024Towards Cross-Lingual Explanation of Artwork in Large-scale Vision Language Modelscited by 7
  10. 2024Constructing Multimodal Datasets from Scratch for Rapid Development of a Japanese Visual Language Modelcited by 6
  11. 2025How a Bilingual LM Becomes Bilingual: Tracing Internal Representations with Sparse Autoencoderscited by 5
  12. 2024Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMscited by 4
21 more
  1. 2025Evaluating Multimodal Large Language Models on Vertically Written Japanese Textcited by 4
  2. 2025JETHICS: Japanese Ethics Understanding Evaluation Datasetcited by 3
  3. 2025Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktalescited by 2
  4. 2025BIS Reasoning 1.0: The First Large-Scale Japanese Benchmark for Belief-Inconsistent Syllogistic Reasoningcited by 2
  5. 2026Solar Open Technical Reportcited by 2
  6. 2026XL-SafetyBench: A Country-Grounded Cross-Cultural Benchmark for LLM Safety and Cultural Sensitivitycited by 2
  7. 2024Refined and Segmented Price Sentiment Indices from Survey Commentscited by 1
  8. 2025Analyzing the Safety of Japanese Large Language Models in Stereotype-Triggering Promptscited by 1
  9. 2025Building Instruction-Tuning Datasets from Human-Written Instructions with Open-Weight Large Language Modelscited by 1
  10. 2025Resampling Benchmark for Efficient Comprehensive Evaluation of Large Vision-Language Modelscited by 1
  11. 2025Do LLMs Need to Think in One Language? Correlation between Latent Language and Task Performancecited by 1
  12. 2026Cost of Reasoning in non-English Languages: A Case Study on Japanesecited by 1
  13. 2025Enhancing Japanese Large Language Models with Reasoning Vectorscited by 0
  14. 2025Tracing Multilingual Knowledge Acquisition Dynamics in Domain Adaptation: A Case Study of English-Japanese Biomedical Adaptationcited by 0
  15. 2026Conceptual Cultural Index: A Metric for Cultural Specificity via Relative Generalitycited by 0
  16. 2026Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Modelscited by 0
  17. 2026Repetition over Diversity: High-Signal Data Filtering for Sample-Efficient German Language Modelingcited by 0
  18. 2026Toward LLMs Beyond English-Centric Developmentcited by 0
  19. 2026FrameBench:A Language Understanding Benchmark Based on Frame Semanticscited by 0
  20. 2026Merging the Knowledge of LLMs for Automatic Speech Recognitioncited by 0
  21. 2026Manac'a-1B-Instruct-2: Reproducible Safety Alignment for a Native Brazilian-Portuguese LLM. Negative DPO Results, a Controlled Composition Scan, and a Silent Failure Mode of the LLM Judgecited by 0