INS-ActBench: A Comprehensive Benchmark for Assessing Professional Actuarial Capability of Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have shown strong potential in financial reasoning, but existing benchmarks often evaluate domain knowledge, numerical reasoning, long-context understanding, and tool use in separate settings. This limits their ability to assess realistic professional workflows that require auditable, context-grounded, and tool-executable decisions. We introduce INS-ActBench, a comprehensive benchmark for evaluating professional actuarial capability in LLMs. INS-ActBench contains 12,050 Q&A pairs from public exams and sample questions released by 16 actuarial associations. It covers three subsets: INS-Act-Know for standardized actuarial knowledge, INS-Act-Case for long-context insurance case reasoning, and INS-Act-Practice for spreadsheet and R-code tasks with verifiable numerical outputs. Experiments on nine representative LLMs and human actuarial experts reveal a clear capability boundary: frontier LLMs perform strongly on standardized knowledge, but remain much weaker in case reasoning, tool-based workflows, and jurisdiction-sensitive practice. INS-ActBench provides a reproducible foundation for developing actuarial LLMs toward reliable professional assistance. The code is available at https://github.com/FDU-INS/INS-ActBench.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 23 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
12 of 23 references.
References · 12
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
- 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agentcited by 64
- 2024DocFinQA: A Long-Context Financial Reasoning Datasetcited by 60
- 2025FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challengingcited by 28
- 2025StatLLM: A Dataset for Evaluating the Performance of Large Language Models in Statistical Analysiscited by 8
- 2024INS-MMBench: A Comprehensive Benchmark for Evaluating LVLMs' Performance in Insurancecited by 7
- 2026FinSheet-Bench: From Simple Lookups to Complex Reasoning, Where LLMs Break on Financial Spreadsheetscited by 4
- 2025INSEva: A Comprehensive Chinese Benchmark for Large Language Models in Insurancecited by 2
- 2025Design, Results and Industry Implications of the World's First Insurance Large Language Model Evaluation Benchmarkcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.