mlsanityData to 7 Oct 2026

NOTAM-Evolve: A Knowledge-Guided Self-Evolving Optimization Framework with LLMs for NOTAM Interpretation

arXiv 2511.07982 ↗First posted 11 Nov 2025cs.CL cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping

Abstract (arXiv)

Accurate interpretation of Notices to Airmen (NOTAMs) is critical for aviation safety, yet their condensed and cryptic language poses significant challenges to both manual and automated processing. Existing automated systems are typically limited to shallow parsing, failing to extract the actionable intelligence needed for operational decisions. We formalize the complete interpretation task as deep parsing, a dual-reasoning challenge requiring both dynamic knowledge grounding (linking the NOTAM to evolving real-world aeronautical data) and schema-based inference (applying static domain rules to deduce operational status). To tackle this challenge, we propose NOTAM-Evolve, a self-evolving framework that enables a large language model (LLM) to autonomously master complex NOTAM interpretation. Leveraging a knowledge graph-enhanced retrieval module for data grounding, the framework introduces a closed-loop learning process where the LLM progressively improves from its own outputs, minimizing the need for extensive human-annotated reasoning traces. In conjunction with this framework, we introduce a new benchmark dataset of 10,000 expert-annotated NOTAMs. Our experiments demonstrate that NOTAM-Evolve achieves a 30.4% absolute accuracy improvement over the base LLM, establishing a new state of the art on the task of structured NOTAM interpretation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 16 of its 33 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

16 of 33 references.

References · 16

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  6. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  7. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
  8. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  9. 2022Unified Structure Generation for Universal Information Extractioncited by 220
  10. 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 116
  11. 2024TableRAG: Million-Token Table Understanding with Language Modelscited by 40
  12. 2024SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge Graphscited by 31
4 more
  1. 2024Hierarchical Neural Operator Transformer with Learnable Frequency-aware Loss Prior for Arbitrary-scale Super-resolutioncited by 11
  2. 2025Large Language Models for Single-Step and Multi-Step Flight Trajectory Predictioncited by 5
  3. 2025Aviation Safety Enhancement via NLP & Deep Learning: Classifying Flight Phases in ATSB Safety Reportscited by 3
  4. 2022Explainable prediction of Qcodes for NOTAMs using column generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025KEO: Knowledge Extraction on OMIn via Knowledge Graphs and RAG for Safety-Critical Aviation Maintenance
  2. 2026Can Large Language Models Explain Flight Safety Events? A Prior-Guided Semantic LLM-based Approach
  3. 2025CAMB: A comprehensive industrial LLM benchmark on civil aviation maintenance
  4. 2026Building Trust in the Skies: A Knowledge-Grounded LLM-based Framework for Aviation Safety
  5. 2026PilotBench: A Benchmark for General Aviation Agents with Safety Constraints
  6. 2026Self-Evolving LLM Memory Extraction Across Heterogeneous Tasks
  7. 2026AERO: Autonomous Evolutionary Reasoning Optimization via Endogenous Dual-Loop Feedback
  8. 2026LLM-Enabled Low-Altitude UAV Natural Language Navigation via Signal Temporal Logic Specification Translation and Repair