A Large-Language-Model Framework for Automated Humanitarian Situation Reporting
Not on the map. Why?
Abstract (arXiv)
Timely and accurate situational reports are essential for humanitarian decision-making, yet current workflows remain largely manual, resource intensive, and inconsistent. We present a fully automated framework that uses large language models (LLMs) to transform heterogeneous humanitarian documents into structured and evidence-grounded reports. The system integrates semantic text clustering, automatic question generation, retrieval augmented answer extraction with citations, multi-level summarization, and executive summary generation, supported by internal evaluation metrics that emulate expert reasoning. We evaluated the framework across 13 humanitarian events, including natural disasters and conflicts, using more than 1,100 documents from verified sources such as ReliefWeb. The generated questions achieved 84.7 percent relevance, 84.0 percent importance, and 76.4 percent urgency. The extracted answers reached 86.3 percent relevance, with citation precision and recall both exceeding 76 percent. Agreement between human and LLM based evaluations surpassed an F1 score of 0.80. Comparative analysis shows that the proposed framework produces reports that are more structured, interpretable, and actionable than existing baselines. By combining LLM reasoning with transparent citation linking and multi-level evaluation, this study demonstrates that generative AI can autonomously produce accurate, verifiable, and operationally useful humanitarian situation reports.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 59 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
36 of 59 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
24 more
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
- 2022MTEB: Massive Text Embedding Benchmarkcited by 623
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 248
- 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
- 2024Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judgescited by 197
- 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
- 2024Attribute First, then Generate: Locally-attributable Grounded Text Generationcited by 54
- 2024ClimateGPT: Towards AI Synthesizing Interdisciplinary Research on Climate Changecited by 46
- 2024RAG-Fusion: a New Take on Retrieval-Augmented Generationcited by 42
- 2017Simple and Effective Dimensionality Reduction for Word Embeddingscited by 38
- 2025RAG LLMs are Not Safer: A Safety Analysis of Retrieval-Augmented Generation for Large Language Modelscited by 23
- 2025Enhancing Retrieval-Augmented Generation: A Study of Best Practicescited by 22
- 2024Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmarkcited by 19
- 2025CiteFix: Enhancing RAG Accuracy Through Post-Processing Citation Correctioncited by 8
- 2023Leave no Place Behind: Improved Geolocation in Humanitarian Documentscited by 5
- 2025Automatic Question & Answer Generation Using Generative Large Language Model (LLM)cited by 4
- 2025Retrieval Augmented Generation Evaluation for Health Documentscited by 3
- 2020Evaluating and Validating Cluster Resultscited by 2
- 2024On the Capacity of Citation Generation by Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Automated Situation Awareness: A RAG-Based Framework for Peacebuilding Reports
- 2026Large Language Models for Geolocation Extraction in Humanitarian Crisis Response
- 2026A Lightweight LLM Framework for Disaster Humanitarian Information Classification
- 2023FloodBrain: Flood Disaster Reporting by Web-based Retrieval Augmented Generation with an LLM
- 2025Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports
- 2026DisastRAG: A Multi-Source Disaster Information Integration and Access System Based on Retrieval-Augmented Large Language Models
- 2022Rethinking the Event Coding Pipeline with Prompt Entailment
- 2025RESPONSE: Benchmarking the Ability of Language Models to Undertake Commonsense Reasoning in Crisis Situation