PLLaMa: An Open-source Large Language Model for Plant Science
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have exhibited remarkable capabilities in understanding and interacting with natural language across various sectors. However, their effectiveness is limited in specialized areas requiring high accuracy, such as plant science, due to a lack of specific expertise in these fields. This paper introduces PLLaMa, an open-source language model that evolved from LLaMa-2. It's enhanced with a comprehensive database, comprising more than 1.5 million scholarly articles in plant science. This development significantly enriches PLLaMa with extensive knowledge and proficiency in plant and agricultural sciences. Our initial tests, involving specific datasets related to plants and agriculture, show that PLLaMa substantially improves its understanding of plant science-related topics. Moreover, we have formed an international panel of professionals, including plant scientists, agricultural engineers, and plant breeders. This team plays a crucial role in verifying the accuracy of PLLaMa's responses to various academic inquiries, ensuring its effective and reliable application in the field. To support further research and development, we have made the model's checkpoints and source codes accessible to the scientific community. These resources are available for download at urlhttps://github.com/Xianjun-Yang/PLLaMa.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 3 Jan 2024.
Builds on
18 of 26 references.
References · 18
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
- 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 286
- 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 250
- 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
- 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 90
- 2023Lawyer LLaMA Technical Reportcited by 54
6 more
- 2023AstroLLaMA: Towards Specialized Foundation Models in Astronomycited by 41
- 2023DARWIN Series: Domain Specific Large Language Models for Natural Sciencecited by 39
- 2023GeoGalactica: A Scientific Large Language Model in Geosciencecited by 33
- 2022PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Textcited by 6
- 2023MatKB: Semantic Search for Polycrystalline Materials Synthesis Procedurescited by 2
- 2024Quokka: An Open-source Large Language Model ChatBot for Material Sciencecited by 1
Built on by
Citing papers per year: 2024: 11; 2025: 7; 2026: 4.
22 papers.
Sort:
By area:
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
- 2024Continual Learning for Large Language Models: A Surveycited by 147
- 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 127
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 72
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2024Efficient Continual Pre-training by Mitigating the Stability Gapcited by 25
- 2024AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuningcited by 24
- 2024Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMscited by 12
- 2024AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomycited by 6
- 2025RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Servicescited by 6
10 more
- 2025PhenoAssistant: A Conversational Multi-Agent AI System for Automated Plant Phenotypingcited by 4
- 2025AgriEval: A Comprehensive Chinese Agricultural Benchmark for Large Language Modelscited by 3
- 2025AgriDoctor: A Multimodal Intelligent Assistant for Agriculturecited by 3
- 2025Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Makingcited by 1
- 2026DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Modelscited by 1
- 2024ChatGPT and general-purpose AI count fruits in pictures surprisingly wellcited by 0
- 2025PlantDeBERTa: An Open Source Language Model for Plant Sciencecited by 0
- 2026CultivAgents: Cultivating Relationship-Centered Multi-Agent Systems for Personalized Gardeningcited by 0
- 2026TELLME: Test-Enhanced Learning for Language Model Enrichmentcited by 0
- 2026An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Casecited by 0
- 2026DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models2 Sep 2026
- 2026TELLME: Test-Enhanced Learning for Language Model Enrichment12 Aug 2026
- 2026An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Case19 Jun 2026
- 2026CultivAgents: Cultivating Relationship-Centered Multi-Agent Systems for Personalized Gardening22 May 2026
- 2025AgriDoctor: A Multimodal Intelligent Assistant for Agriculture21 Sep 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025AgriEval: A Comprehensive Chinese Agricultural Benchmark for Large Language Models29 Jul 2025
- 2025RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services13 Jul 2025
- 2025PlantDeBERTa: An Open Source Language Model for Plant Science10 Jun 2025
- 2025PhenoAssistant: A Conversational Multi-Agent AI System for Automated Plant Phenotyping28 Apr 2025
- 2025Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making7 Apr 2025
- 2024Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs14 Oct 2024
10 more
- 2024AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuning10 Oct 2024
- 2024AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy29 Sep 2024
- 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models9 Jul 2024
- 2024Efficient Continual Pre-training by Mitigating the Stability Gap21 Jun 2024
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery16 Jun 2024
- 2024Continual Learning of Large Language Models: A Comprehensive Survey25 Apr 2024
- 2024ChatGPT and general-purpose AI count fruits in pictures surprisingly well12 Apr 2024
- 2024Simple and Scalable Strategies to Continually Pre-train Large Language Models13 Mar 2024
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2024Continual Learning for Large Language Models: A Survey2 Feb 2024
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2025PhenoAssistant: A Conversational Multi-Agent AI System for Automated Plant Phenotypingcited by 4
- 2026An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Casecited by 0
- 2026An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Case19 Jun 2026
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025PhenoAssistant: A Conversational Multi-Agent AI System for Automated Plant Phenotyping28 Apr 2025
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
- 2024Continual Learning for Large Language Models: A Surveycited by 147
- 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 127
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 72
- 2024Efficient Continual Pre-training by Mitigating the Stability Gapcited by 25
- 2024Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMscited by 12
- 2024AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomycited by 6
- 2025RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Servicescited by 6
- 2025AgriEval: A Comprehensive Chinese Agricultural Benchmark for Large Language Modelscited by 3
- 2025AgriDoctor: A Multimodal Intelligent Assistant for Agriculturecited by 3
- 2025Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Makingcited by 1
12 most cited of 17 All 17 (JSON)
- 2026DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models2 Sep 2026
- 2026TELLME: Test-Enhanced Learning for Language Model Enrichment12 Aug 2026
- 2026CultivAgents: Cultivating Relationship-Centered Multi-Agent Systems for Personalized Gardening22 May 2026
- 2025AgriDoctor: A Multimodal Intelligent Assistant for Agriculture21 Sep 2025
- 2025AgriEval: A Comprehensive Chinese Agricultural Benchmark for Large Language Models29 Jul 2025
- 2025RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services13 Jul 2025
- 2025PlantDeBERTa: An Open Source Language Model for Plant Science10 Jun 2025
- 2025Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making7 Apr 2025
- 2024Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs14 Oct 2024
- 2024AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy29 Sep 2024
- 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models9 Jul 2024
- 2024Efficient Continual Pre-training by Mitigating the Stability Gap21 Jun 2024
12 newest of 17 All 17 (JSON)