mlsanityData to 14 Oct 2026

Improving Aviation Safety Analysis: Automated HFACS Classification Using Reinforcement Learning with Group Relative Policy Optimization

arXiv 2508.21201 ↗First posted 28 Aug 2025cs.CL cs.AIcited by 1

On the map: Deep reinforcement learning methods → Safe and constrained RL

Abstract (arXiv)

Analyzing the human factors behind aviation accidents is crucial for preventing future incidents, yet traditional methods using the Human Factors Analysis and Classification System (HFACS) are limited by scalability and consistency. To address this, we introduce an automated HFACS classification framework for aviation safety analysis that utilizes Reinforcement Learning with Group Relative Policy Optimization (GRPO) to fine-tune a Llama-3.1 8B language model. Our approach incorporates a multi-component reward system tailored for aviation safety analysis and integrates synthetic data generation to overcome class imbalance in accident datasets. The resulting GRPO-optimized model achieved noticeable performance gains, including a 350% increase in exact match accuracy (from 0.0400 to 0.1800) and an improved partial match accuracy of 0.8800. Significantly, our specialized model outperforms state-of-the-art LLMs (Large Language Models), including GPT-5-mini and Gemini-2.5-fiash, on key metrics. This research also proposes exact match accuracy in multi-label HFACS classification problem as a new benchmarking methodology to evaluate the advanced reasoning capabilities of language models. Ultimately, our work validates that smaller, domain-optimized models can provide a computationally efficient and better solution for critical safety analysis. This approach makes powerful, low-latency deployment on resource-constrained edge devices feasible.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Safe and constrained RL, one of 15 directions in Deep reinforcement learning methods. Builds on 16 of its 42 references that are in the map. First posted on arXiv 28 Aug 2025.

Builds on

16 of 42 references.

References · 16

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  6. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  7. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  8. 2023A Comprehensive Overview of Large Language Modelscited by 648
  9. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
  10. 2017Deep Reinforcement Learning: An Overviewcited by 333
  11. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  12. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
4 more
  1. 2016Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPUcited by 48
  2. 2024AccidentGPT: Large Multi-Modal Foundation Model for Traffic Accident Analysiscited by 10
  3. 2024Benchmarking GPT-4 on Algorithmic Problems: A Systematic Evaluation of Prompting Strategiescited by 9
  4. 2021Modified Double DQN: addressing stabilitycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can Large Language Models Explain Flight Safety Events? A Prior-Guided Semantic LLM-based Approach
  2. 2025GSPR: Aligning LLM Safeguards as Generalizable Safety Policy Reasoners
  3. 2025AviationLLM: An LLM-based Knowledge System for Aviation Training
  4. 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrails
  5. 2026A Heterogeneous Long-Micro Scale Cascading Architecture for General Aviation Health Management
  6. 2026Improving Safety Alignment via Balanced Direct Preference Optimization
  7. 2026Paved with True Intents: Intent-Aware Training Improves LLM Safety Classification Across Training Regimes
  8. 2025Mitigating the Safety Alignment Tax with Null-Space Constrained Policy Optimization