Curated AI beats frontier LLMs at pharma asset discovery
Not on the map. Why?
Abstract (arXiv)
General-purpose LLMs with web search are increasingly used to scout the competitive landscape of pharmaceutical pipelines. We benchmark Gosset -- an AI platform with a chat interface backed by curated target-, modality-, and indication-level drug-asset annotations -- against four frontier systems with web access (Claude Opus 4.7, GPT 5.5, Gemini 3.1 Pro, Perplexity sonar-pro) on ten niche oncology/immunology targets where most of the pipeline lives in the long tail of preclinical and Asian-developed assets. All five systems receive the same natural-language query and the same JSON output schema. Across 10 targets Gosset returns 3.2x more verified drugs per query than the best frontier system, at perfect precision and 100% recall against the cross-system union of verified drugs. The same curated index is exposed as a Gosset MCP server that any frontier model can call as a tool, suggesting that each of these systems can close most of the recall gap by swapping generic web search for a curated index behind the same chat interface.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 9 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
3 of 9 references.
References · 3
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LLM-Based Agents for Competitive Landscape Mapping in Drug Asset Due Diligence
- 2026Hunt Globally: Wide Search AI Agents for Drug Asset Scouting in Investing, Business Development, and Competitive Intelligence
- 2024SwiftDossier: Tailored Automatic Dossier for Drug Discovery with LLMs and Agents
- 2025GraPPI: A Retrieve-Divide-Solve GraphRAG Framework for Large-scale Protein-protein Interaction Exploration
- 2025TxGemma: Efficient and Agentic LLMs for Therapeutics
- 2025RAG-Enhanced Collaborative LLM Agents for Drug Discovery
- 2024Can Open-Source LLMs Compete with Commercial Models? Exploring the Few-Shot Performance of Current GPT Models in Biomedical Tasks
- 2025MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology