# GeoSQA: A Benchmark for Scenario-based Question Answering in the Geography Domain at High School Level

arXiv: https://arxiv.org/abs/1908.07855 · HTML: https://mlsanity.com/paper/1908.07855/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Aug 2019.

## Built on by (most cited first, 17 of 17)

- [RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing](https://mlsanity.com/paper/2306.11300/) (2023)
- [SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning](https://mlsanity.com/paper/2104.05832/) (2021)
- [E-KAR: A Benchmark for Rationalizing Natural Language Analogical Reasoning](https://mlsanity.com/paper/2203.08480/) (2022)
- [Geographic Question Answering: Challenges, Uniqueness, Classification, and Future Directions](https://mlsanity.com/paper/2105.09392/) (2021)
- [TSQA: Tabular Scenario Based Question Answering](https://mlsanity.com/paper/2101.11429/) (2021)
- [Clues Before Answers: Generation-Enhanced Multiple-Choice QA](https://mlsanity.com/paper/2205.00274/) (2022)
- [AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension](https://mlsanity.com/paper/2203.08992/) (2022)
- [RoQLlama: A Lightweight Romanian Adapted Language Model](https://mlsanity.com/paper/2410.04269/) (2024)
- [Self-Teaching Machines to Read and Comprehend with Large-Scale Multi-Subject Question-Answering Data](https://mlsanity.com/paper/2102.01226/) (2021)
- [GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark](https://mlsanity.com/paper/2305.06545/) (2023)
- [When Retriever-Reader Meets Scenario-Based Multiple-Choice Questions](https://mlsanity.com/paper/2108.13875/) (2021)
- [Extract, Integrate, Compete: Towards Verification Style Reading Comprehension](https://mlsanity.com/paper/2109.05149/) (2021)
- [Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends](https://mlsanity.com/paper/2401.07518/) (2024)
- [Location Aware Modular Biencoder for Tourism Question Answering](https://mlsanity.com/paper/2401.02187/) (2024)
- [FormulaReasoning: A Dataset for Formula-Based Numerical Reasoning](https://mlsanity.com/paper/2402.12692/) (2024)
- [Semantic Segmentation of Node and Edge Diagrams for Assistive Technology](https://mlsanity.com/paper/2606.11320/) (2026)
- [GeoBenchLLM: A Comprehensive Benchmark for Evaluating LLMs on Geo-Related Tasks](https://mlsanity.com/paper/2608.07411/) (2026)

## Abstract (arXiv)

Scenario-based question answering (SQA) has attracted increasing research attention. It typically requires retrieving and integrating knowledge from multiple sources, and applying general knowledge to a specific case described by a scenario. SQA widely exists in the medical, geography, and legal domains---both in practice and in the exams. In this paper, we introduce the GeoSQA dataset. It consists of 1,981 scenarios and 4,110 multiple-choice questions in the geography domain at high school level, where diagrams (e.g., maps, charts) have been manually annotated with natural language descriptions to benefit NLP research. Benchmark results on a variety of state-of-the-art methods for question answering, textual entailment, and reading comprehension demonstrate the unique challenges presented by SQA for future research.