mlsanityData to 7 Oct 2026

WebSRC: A Dataset for Web-Based Structural Reading Comprehension

arXiv 2101.09465 ↗First posted 23 Jan 2021cs.CLcited by 98

Not on the map. Why?

Cited by 27 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Web search is an essential way for humans to obtain information, but it's still a great challenge for machines to understand the contents of web pages. In this paper, we introduce the task of structural reading comprehension (SRC) on web. Given a web page and a question about it, the task is to find the answer from the web page. This task requires a system not only to understand the semantics of texts but also the structure of the web page. Moreover, we proposed WebSRC, a novel Web-based Structural Reading Comprehension dataset. WebSRC consists of 400K question-answer pairs, which are collected from 6.4K web pages. Along with the QA pairs, corresponding HTML source code, screenshots, and metadata are also provided in our dataset. Each question in WebSRC requires a certain structural understanding of a web page to answer, and the answer is either a text span on the web page or yes/no. We evaluate various baselines on our dataset to show the difficulty of our task. We also investigate the usefulness of structural information and visual features. Our dataset and baselines have been publicly available at https://x-lance.github.io/WebSRC/.

Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). Builds on 27 of its 48 references that are in the map. First posted on arXiv 23 Jan 2021.

Builds on

27 of 48 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  7. 2015VQA: Visual Question Answeringcited by 2,489
  8. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  9. 2019Towards VQA Models That Can Readcited by 1,696
  10. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  11. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  12. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
15 more
  1. 2018CoQA: A Conversational Question Answering Challengecited by 674
  2. 2018QuAC : Question Answering in Contextcited by 379
  3. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  4. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  5. 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
  6. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 221
  7. 2015Evaluation of Deep Convolutional Nets for Document Image Classification and Retrievalcited by 212
  8. 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
  9. 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
  10. 2017Quasar: Datasets for Question Answering by Search and Readingcited by 50
  11. 2016The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narrativescited by 41
  12. 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
  13. 2016Dataset and Neural Recurrent Sequence Labeling Model for Open-Domain Factoid Question Answeringcited by 35
  14. 2019Introduction to Neural Network based Approaches for Question Answering over Knowledge Graphscited by 15
  15. 2020A Graph Representation of Semi-structured Data for Web Question Answeringcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 11; 2023: 12; 2024: 36; 2025: 26; 2026: 10.

98 papers.

Sort:

By area:

  1. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  2. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  3. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
  4. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  5. 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 175
  6. 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
  7. 2023MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learningcited by 171
  8. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
  9. 2023Multimodal Web Navigation with Instruction-Finetuned Foundation Modelscited by 159
  10. 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
  11. 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
  12. 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
38 more
  1. 2024mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understandingcited by 113
  2. 2025MiMo-VL Technical Reportcited by 106
  3. 2024ScreenAgent: A Vision Language Model-driven Computer Control Agentcited by 101
  4. 2024VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?cited by 98
  5. 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 98
  6. 2024ScreenAI: A Vision-Language Model for UI and Infographics Understandingcited by 97
  7. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  8. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
  9. 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
  10. 2025MM-RLHF: The Next Step Forward in Multimodal LLM Alignmentcited by 79
  11. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
  12. 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
  13. 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshotscited by 65
  14. 2023What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?cited by 64
  15. 2025MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agentscited by 64
  16. 2021Document AI: Benchmarks, Models and Applicationscited by 61
  17. 2025A Survey on (M)LLM-Based GUI Agentscited by 61
  18. 2024Ferret-UI 2: Mastering Universal User Interface Understanding Across Platformscited by 51
  19. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
  20. 2025UniToken: Harmonizing Multimodal Understanding and Generation through Unified Visual Encodingcited by 49
  21. 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
  22. 2021MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understandingcited by 44
  23. 2024HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systemscited by 37
  24. 2025A Survey of Multimodal Retrieval-Augmented Generationcited by 37
  25. 2022WebFormer: The Web-page Transformer for Structure Information Extractioncited by 34
  26. 2024Foundations and Recent Trends in Multimodal Mobile Agents: A Surveycited by 31
  27. 2024Harnessing Webpage UIs for Text-Rich Visual Understandingcited by 28
  28. 2024InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructionscited by 27
  29. 2024BlueLM-V-3B: Algorithm and System Co-Design for Multimodal Large Language Models on Mobile Devicescited by 25
  30. 2025FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflowcited by 25
  31. 2022DOM-LM: Learning Generalizable Representations for HTML Documentscited by 24
  32. 2025UItron: Foundational GUI Agent with Advanced Perception and Planningcited by 22
  33. 2024Deep Learning based Visually Rich Document Content Understanding: A Surveycited by 21
  34. 2023DUnE: Dataset for Unified Editingcited by 19
  35. 2025M2-omni: Advancing Omni-MLLM for Comprehensive Modality Support with Competitive Performancecited by 19
  36. 2025SpiritSight Agent: Advanced GUI Agent with One Lookcited by 18
  37. 2024HiRes-LLaVA: Restoring Fragmentation Input in High-Resolution Large Vision-Language Modelscited by 16
  38. 2025WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generationcited by 16

50 most cited of 98 All 98 (JSON)