LLM-Based Agents for Competitive Landscape Mapping in Drug Asset Due Diligence
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
In this paper, we describe and benchmark a competitor-discovery component used within an agentic AI system for fast drug asset due diligence. A competitor-discovery AI agent, given an indication, retrieves all drugs comprising the competitive landscape of that indication and extracts canonical attributes for these drugs. The competitor definition is investor-specific, and data is paywalled/licensed, fragmented across registries, ontology-mismatched by indication, alias-heavy for drug names, multimodal, and rapidly changing. Although considered the best tool for this problem, the current LLM-based AI systems aren't capable of reliably retrieving all competing drug names, and there is no accepted public benchmark for this task. To address the lack of evaluation, we use LLM-based agents to transform five years of multi-modal, unstructured diligence memos from a private biotech VC fund into a structured evaluation corpus mapping indications to competitor drugs with normalized attributes. We also introduce a competitor validating LLM-as-a-judge agent that filters out false positives from the list of predicted competitors to maximize precision and suppress hallucinations. On this benchmark, our competitor-discovery agent achieves 83% recall, exceeding OpenAI Deep Research (65%) and Perplexity Labs (60%). The system is deployed in production with enterprise users; in a case study with a biotech VC investment fund, analyst turnaround time dropped from 2.5 days to ~3 hours (~20x) for the competitive analysis.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 8 of its 19 references that are in the map. First posted on arXiv 22 Aug 2025.
Builds on
8 of 19 references.
References · 8
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 180
- 2023Benchmarking large language models for biomedical natural language processing applications and recommendationscited by 78
- 2024Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queriescited by 78
- 2025Inverse Scaling in Test-Time Computecited by 50
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025LLM Agent Swarm for Hypothesis-Driven Drug Discovery
- 2025RAG-Enhanced Collaborative LLM Agents for Drug Discovery
- 2026Curated AI beats frontier LLMs at pharma asset discovery
- 2024DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration
- 2025DrugPilot: LLM-based Parameterized Reasoning Agent for Drug Discovery
- 2026Designing a Robust LLM-Based Evaluation System for Agentic AI in Drug Discovery Through Human Alignment
- 2025PharmAgents: Building a Virtual Pharma with Large Language Model Agents
- 2025DrugMCTS: a drug repurposing framework combining multi-agent, RAG and Monte Carlo Tree Search