mlsanityData to 7 Oct 2026

An Industrial-Scale Insurance LLM Achieving Verifiable Domain Mastery and Hallucination Control without Competence Trade-offs

arXiv 2603.14463 ↗First posted 15 Mar 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Adapting Large Language Models (LLMs) to high-stakes vertical domains like insurance presents a significant challenge: scenarios demand strict adherence to complex regulations and business logic with zero tolerance for hallucinations. Existing approaches often suffer from a Competency Trade-off - sacrificing general intelligence for domain expertise - or rely heavily on RAG without intrinsic reasoning. To bridge this gap, we present INS-S1, an insurance-specific LLM family trained via a novel end-to-end alignment paradigm. Our approach features two methodological innovations: (1) A Verifiable Data Synthesis System that constructs hierarchical datasets for actuarial reasoning and compliance; and (2) A Progressive SFT-RL Curriculum Framework that integrates dynamic data annealing with a synergistic mix of Verified Reasoning (RLVR) and AI Feedback (RLAIF). By optimizing data ratios and reward signals, this framework enforces domain constraints while preventing catastrophic forgetting. Additionally, we release INSEva, the most comprehensive insurance benchmark to date (39k+ samples). Extensive experiments show that INS-S1 achieves SOTA performance on domain tasks, significantly outperforming DeepSeek-R1 and Gemini-2.5-Pro. Crucially, it maintains top-tier general capabilities and achieves a record-low 0.6% hallucination rate (HHEM). Our results demonstrate that rigorous domain specialization can be achieved without compromising general intelligence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 48 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

39 of 48 references.

References · 39

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  8. 2024GPT-4o System Cardcited by 4,467
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  11. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  12. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
27 more
  1. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  2. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  3. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  4. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  5. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  6. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  7. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  8. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  9. 2025Group Sequence Policy Optimizationcited by 788
  10. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
  11. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
  12. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  13. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
  14. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
  15. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  16. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 385
  17. 2021Curriculum Learning: A Surveycited by 257
  18. 2025On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectificationcited by 121
  19. 2025CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratingscited by 109
  20. 2024Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuningcited by 90
  21. 2025Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitatecited by 61
  22. 2018DRCD: a Chinese Machine Reading Comprehension Datasetcited by 57
  23. 2023FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Modelscited by 52
  24. 2025Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Modelcited by 50
  25. 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
  26. 2025Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundationcited by 32
  27. 2019CJRC: A Reliable Human-Annotated Benchmark DataSet for Chinese Judicial Reading Comprehensioncited by 26

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Benchmarking Large Language Models for Quebec Insurance: From Closed-Book to Retrieval-Augmented Generation
  2. 2026Constructing Synthetic Instruction Datasets for Improving Reasoning in Domain-Specific LLMs: A Case Study in the Japanese Financial Domain
  3. 2023When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dust
  4. 2025QianfanHuijin Technical Report: A Novel Multi-Stage Training Paradigm for Finance Industrial LLMs
  5. 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements
  6. 2025LLMs and Agentic AI in Insurance Decision-Making: Opportunities and Challenges For Africa
  7. 2026Benchmarking Agents in Insurance Underwriting Environments
  8. 2025DianJin-R1: Evaluating and Enhancing Financial Reasoning in Large Language Models