mlsanityData to 14 Oct 2026

VCBench: Benchmarking LLMs in Venture Capital

arXiv 2509.14448 ↗First posted 17 Sep 2025cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Benchmarks such as SWE-bench and ARC-AGI demonstrate how shared datasets accelerate progress toward artificial general intelligence (AGI). We introduce VCBench, the first benchmark for predicting founder success in venture capital (VC), a domain where signals are sparse, outcomes are uncertain, and even top investors perform modestly. At inception, the market index achieves a precision of 1.9%. Y Combinator outperforms the index by a factor of 1.7x, while tier-1 firms are 2.9x better. VCBench provides 9,000 anonymized founder profiles, standardized to preserve predictive features while resisting identity leakage, with adversarial tests showing more than 90% reduction in re-identification risk. We evaluate nine state-of-the-art large language models (LLMs). DeepSeek-V3 delivers over six times the baseline precision, GPT-4o achieves the highest F0.5, and most models surpass human benchmarks. Designed as a public and evolving resource available at vcbench.com, VCBench establishes a community-driven standard for reproducible and privacy-preserving evaluation of AGI in early-stage venture forecasting.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

12 of 31 references.

References · 12

  1. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2015VQA: Visual Question Answeringcited by 2,506
  4. 2023Rethinking Benchmark and Contamination for Language Models with Rephrased Samplescited by 195
  5. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
  6. 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 147
  7. 2025Sequential Diagnosis with Language Modelscited by 60
  8. 2024AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledgecited by 44
  9. 2024A Fused Large Language Model for Predicting Startup Successcited by 13
  10. 2021Finding the unicorn: Predicting early stage startup success through a hybrid intelligence methodcited by 10
  11. 2025Policy Induction: Predicting Startup Success via Explainable Memory-Augmented In-Context Learningcited by 6
  12. 2023Startup success prediction and VC portfolio simulation using CrunchBase datacited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.