Rapid Biomedical Research Classification: The Pandemic PACT Advanced Categorisation Engine
Not on the map. Why?
Abstract (arXiv)
This paper introduces the Pandemic PACT Advanced Categorisation Engine (PPACE) along with its associated dataset. PPACE is a fine-tuned model developed to automatically classify research abstracts from funded biomedical projects according to WHO-aligned research priorities. This task is crucial for monitoring research trends and identifying gaps in global health preparedness and response. Our approach builds on human-annotated projects, which are allocated one or more categories from a predefined list. A large language model is then used to generate `rationales' explaining the reasoning behind these annotations. This augmented data, comprising expert annotations and rationales, is subsequently used to fine-tune a smaller, more efficient model. Developed as part of the Pandemic PACT project, which aims to track and analyse research funding and clinical evidence for a wide range of diseases with outbreak potential, PPACE supports informed decision-making by research funders, policymakers, and independent researchers. We introduce and release both the trained model and the instruction-based dataset used for its training. Our evaluation shows that PPACE significantly outperforms its baselines. The release of PPACE and its associated dataset offers valuable resources for researchers in multilabel biomedical document classification and supports advancements in aligning biomedical research with key global health priorities.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 32 references that are in the map. First posted on arXiv 14 Jul 2024.
Builds on
11 of 32 references.
References · 11
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2023Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solvecited by 175
- 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 123
- 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
- 2021SciFive: a text-to-text transformer model for biomedical literaturecited by 99
- 2023Benchmarking large language models for biomedical natural language processing applications and recommendationscited by 78
- 2024MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuningcited by 31
- 2023Exploring the Effectiveness of Instruction Tuning in Biomedical Language Processingcited by 16
- 2020Document Classification for COVID-19 Literaturecited by 7
- 2024Efficiency at Scale: Investigating the Performance of Diminutive Language Models in Clinical Taskscited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.