mlsanityData to 7 Oct 2026

SmartBook: AI-Assisted Situation Report Generation for Intelligence Analysts

arXiv 2303.14337 ↗First posted 25 Mar 2023cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Timely and comprehensive understanding of emerging events is crucial for effective decision-making; automating situation report generation can significantly reduce the time, effort, and cost for intelligence analysts. In this work, we identify intelligence analysts' practices and preferences for AI assistance in situation report generation to guide the design strategies for an effective, trust-building interface that aligns with their thought processes and needs. Next, we introduce SmartBook, an automated framework designed to generate situation reports from large volumes of news data, creating structured reports by automatically discovering event-related strategic questions. These reports include multiple hypotheses (claims), summarized and grounded to sources with factual evidence, to promote in-depth situation understanding. Our comprehensive evaluation of SmartBook, encompassing a user study alongside a content review with an editing study, reveals SmartBook's effectiveness in generating accurate and relevant situation reports. Qualitative evaluations indicate over 80% of questions probe for strategic information, and over 90% of summaries produce tactically useful content, being consistently favored over summaries from a large language model integrated with web search. The editing study reveals that minimal information is removed from the generated text (under 2.5%), suggesting that SmartBook provides analysts with a valuable foundation for situation reports

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 37 of its 77 references that are in the map. First posted on arXiv 25 Mar 2023.

Builds on

37 of 77 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  9. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  10. 2020Learning to summarize from human feedbackcited by 2,562
  11. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  12. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
25 more
  1. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  2. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  3. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  4. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  5. 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
  6. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  7. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  8. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
  9. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  10. 2017Learning to Ask: Neural Question Generation for Reading Comprehensioncited by 186
  11. 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
  12. 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
  13. 2019TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selectioncited by 74
  14. 2019NPA: Neural News Recommendation with Personalized Attentioncited by 73
  15. 2020ReviewRobot: Explainable Paper Review Generation based on Knowledge Synthesiscited by 53
  16. 2020Generating Representative Headlines for News Storiescited by 39
  17. 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
  18. 2019PaperRobot: Incremental Draft Generation of Scientific Ideascited by 37
  19. 2021MixQG: Neural Question Generation with Mixed Answer Typescited by 28
  20. 2021NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledgecited by 20
  21. 2021Joint Models for Answer Verification in Question Answering Systemscited by 13
  22. 2022SumREN: Summarizing Reported Speech about Events in Newscited by 4
  23. 2018Expedition: A Time-Aware Exploratory Search System Designed for Scholarscited by 3
  24. 2021Towards Confident Machine Reading Comprehensioncited by 3
  25. 2020Answer Span Correction in Machine Reading Comprehensioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 2.

9 papers.

  1. 2024Aligning LLMs with Individual Preferences via Interactioncited by 63
  2. 2025VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cuescited by 33
  3. 2024PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intentcited by 9
  4. 2025Large Language Model Sourcing: A Surveycited by 5
  5. 2026Towards Multi-Level Transcript Segmentation: LoRA Fine-Tuning for Table-of-Contents Generationcited by 4
  6. 2024Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Playcited by 2
  7. 2025Controlled Territory and Conflict Tracking (CONTACT): (Geo-)Mapping Occupied Territory from Open Source Intelligencecited by 0
  8. 2025Towards AI-Assisted Generation of Military Training Scenarioscited by 0
  9. 2026Attribution Techniques for Mitigating Hallucinated Information in RAG Systems: A Surveycited by 0