Small Models Achieve Large Language Model Performance: Evaluating Reasoning-Enabled AI for Secure Child Welfare Research
Not on the map. Why?
Abstract (arXiv)
Objective: This study develops a systematic benchmarking framework for testing whether language models can accurately identify constructs of interest in child welfare records. The objective is to assess how different model sizes and architectures perform on four validated benchmarks for classifying critical risk factors among child welfare-involved families: domestic violence, firearms, substance-related problems generally, and opioids specifically. Method: We constructed four benchmarks for identifying risk factors in child welfare investigation summaries: domestic violence, substance-related problems, firearms, and opioids (n=500 each). We evaluated seven model sizes (0.6B-32B parameters) in standard and extended reasoning modes, plus a mixture-of-experts variant. Cohen's kappa measured agreement with gold standard classifications established by human experts. Results: The benchmarking revealed a critical finding: bigger models are not better. A small 4B parameter model with extended reasoning proved most effective, outperforming models up to eight times larger. It consistently achieved "substantial" to "almost perfect" agreement across all four benchmark categories. This model achieved "almost perfect" agreement (kappa = 0.93-0.96) on three benchmarks (substance-related problems, firearms, and opioids) and "substantial" agreement (kappa = 0.74) on the most complex task (domestic violence). Small models with extended reasoning rivaled the largest models while being more resource-efficient. Conclusions: Small reasoning-enabled models achieve accuracy levels historically requiring larger architectures, enabling significant time and computational efficiencies. The benchmarking framework provides a method for evidence-based model selection to balance accuracy with practical resource constraints before operational deployment in social work research.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Dec 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Reasoning Language Models for complex assessments tasks: Evaluating parental cooperation from child protection case reportscited by 0
- 2026Validation of a Small Language Model for DSM-5 Substance Category Classification in Child Welfare Recordscited by 0
- 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathycited by 0
- 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathy12 Apr 2026
- 2026Validation of a Small Language Model for DSM-5 Substance Category Classification in Child Welfare Records6 Mar 2026
- 2026Reasoning Language Models for complex assessments tasks: Evaluating parental cooperation from child protection case reports15 Feb 2026