WikiAsp: A Dataset for Multi-domain Aspect-based Summarization
Not on the map. Why?
Abstract (arXiv)
Aspect-based summarization is the task of generating focused summaries based on specific points of interest. Such summaries aid efficient analysis of text, such as quickly understanding reviews or opinions from different angles. However, due to large differences in the type of aspects for different domains (e.g., sentiment, product features), the development of previous models has tended to be domain-specific. In this paper, we propose WikiAsp, a large-scale dataset for multi-domain aspect-based summarization that attempts to spur research in the direction of open-domain aspect-based summarization. Specifically, we build the dataset using Wikipedia articles from 20 different domains, using the section titles and boundaries of each article as a proxy for aspect annotation. We propose several straightforward baseline models for this task and conduct experiments on the dataset. Results highlight key challenges that existing summarization models face in this setting, such as proper pronoun handling of quoted sources and consistent explanation of time-sensitive events.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 10; 2024: 24; 2025: 11; 2026: 2.
56 papers.
Sort:
By area:
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Active Retrieval Augmented Generationcited by 506
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Modelscited by 84
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
- 2022Models and Datasets for Cross-Lingual Summarisationcited by 36
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2022NEWTS: A Corpus for News Topic-Focused Summarizationcited by 27
- 2022OASum: Large-Scale Open Domain Aspect-based Summarizationcited by 24
38 more
- 2025SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reductioncited by 24
- 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publicationscited by 20
- 2024MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflowscited by 19
- 2021CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notescited by 18
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generationcited by 18
- 2024Mitigating Entity-Level Hallucination in Large Language Modelscited by 17
- 2024From Single to Multi: How LLMs Hallucinate in Multi-Document Summarizationcited by 17
- 2024RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generationcited by 16
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?cited by 15
- 2023OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarizationcited by 15
- 2024Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Studycited by 13
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generationcited by 13
- 2022SentBS: Sentence-level Beam Search for Controllable Summarizationcited by 10
- 2024LexAbSumm: Aspect-based Summarization of Legal Decisionscited by 9
- 2024DOLOMITES: Domain-Specific Long-Form Methodical Taskscited by 8
- 2025RAGRouter: Learning to Route Queries to Multiple Retrieval-Augmented Language Modelscited by 8
- 2023Concise Answers to Complex Questions: Summarization of Long-form Answerscited by 7
- 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspectivecited by 7
- 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipediacited by 6
- 2021TWAG: A Topic-Guided Wikipedia Abstract Generatorcited by 5
- 2022Unsupervised Multi-Granularity Summarizationcited by 5
- 2023USB: A Unified Summarization Benchmark Across Tasks and Domainscited by 5
- 2024Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Textscited by 5
- 2024PersonalSum: A User-Subjective Guided Personalized Summarization Dataset for Large Language Modelscited by 5
- 2024On The Persona-based Summarization of Domain-Specific Documentscited by 4
- 2025MODS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collectionscited by 4
- 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systemscited by 4
- 2024Aspect-oriented Consumer Health Answer Summarizationcited by 3
- 2024MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarizationcited by 3
- 2024PerSEval: Assessing Personalization in Text Summarizerscited by 3
- 2024Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarizationcited by 3
- 2024The State and Fate of Summarization Datasets: A Surveycited by 3
- 2023A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarizationcited by 2
- 2024Are Large Language Models In-Context Personalized Summarizers? Get an iCOPERNICUS Test Done!cited by 2
- 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practicescited by 2
- 2023XWikiGen: Cross-lingual Summarization for Encyclopedic Text Generation in Low Resource Languagescited by 1
- 2024Reducing Hallucinations in Entity Abstract Summarization with Facts-Template Decompositioncited by 1
50 most cited of 56 All 56 (JSON)
- 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practices29 May 2026
- 2026MAPLE: Medical Aspect-Based Summarization with Phrase-Level Evidence6 Jan 2026
- 2025BookAsSumQA: An Evaluation Framework for Aspect-Based Book Summarization via Question Answering9 Nov 2025
- 2025CARPAS: Towards Content-Aware Refinement of Provided Aspects for Summarization in Large Language Models8 Oct 2025
- 2025Towards Personalized Explanations for Health Simulations: A Mixed-Methods Framework for Stakeholder-Centric Summarization4 Sep 2025
- 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipedia4 Jul 2025
- 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systems5 Jun 2025
- 2025RAGRouter: Learning to Route Queries to Multiple Retrieval-Augmented Language Models29 May 2025
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation11 Mar 2025
- 2025SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reduction3 Mar 2025
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation4 Feb 2025
- 2025MODS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collections1 Feb 2025
38 more
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generation20 Jan 2025
- 2024Efficient Aspect-Based Summarization of Climate Change Reports with Small Language Models21 Nov 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024From Single to Multi: How LLMs Hallucinate in Multi-Document Summarization17 Oct 2024
- 2024MARS: Multilingual Aspect-centric Review Summarisation13 Oct 2024
- 2024PersonalSum: A User-Subjective Guided Personalized Summarization Dataset for Large Language Models4 Oct 2024
- 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspective1 Oct 2024
- 2024Are Large Language Models In-Context Personalized Summarizers? Get an iCOPERNICUS Test Done!30 Sep 2024
- 2024Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarization5 Aug 2024
- 2024Mitigating Entity-Level Hallucination in Large Language Models12 Jul 2024
- 2024PerSEval: Assessing Personalization in Text Summarizers29 Jun 2024
- 2024RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generation18 Jun 2024
- 2024MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflows10 Jun 2024
- 2024On The Persona-based Summarization of Domain-Specific Documents6 Jun 2024
- 2024MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarization5 Jun 2024
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models3 Jun 2024
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Research22 May 2024
- 2024Aspect-oriented Consumer Health Answer Summarization10 May 2024
- 2024DOLOMITES: Domain-Specific Long-Form Methodical Tasks9 May 2024
- 2024LexAbSumm: Aspect-based Summarization of Legal Decisions31 Mar 2024
- 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications8 Mar 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Study29 Feb 2024
- 2024Reducing Hallucinations in Entity Abstract Summarization with Facts-Template Decomposition29 Feb 2024
- 2024Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Texts16 Feb 2024
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec 2023
- 2023OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization7 Dec 2023
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?28 Nov 2023
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Survey15 Nov 2023
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity11 Oct 2023
- 2023Concise Answers to Complex Questions: Summarization of Long-form Answers30 May 2023
- 2023USB: A Unified Summarization Benchmark Across Tasks and Domains23 May 2023
- 2023A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization15 May 2023
- 2023Active Retrieval Augmented Generation11 May 2023
- 2023XWikiGen: Cross-lingual Summarization for Encyclopedic Text Generation in Low Resource Languages22 Mar 2023
- 2022OASum: Large-Scale Open Domain Aspect-based Summarization19 Dec 2022
- 2022SentBS: Sentence-level Beam Search for Controllable Summarization26 Oct 2022
- 2022NEWTS: A Corpus for News Topic-Focused Summarization31 May 2022
50 newest of 56 All 56 (JSON)
- 2023Active Retrieval Augmented Generationcited by 506
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Modelscited by 84
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 34
- 2025SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reductioncited by 24
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generationcited by 18
- 2024RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generationcited by 16
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generationcited by 13
- 2025RAGRouter: Learning to Route Queries to Multiple Retrieval-Augmented Language Modelscited by 8
- 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspectivecited by 7
- 2025RAGRouter: Learning to Route Queries to Multiple Retrieval-Augmented Language Models29 May 2025
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation11 Mar 2025
- 2025SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reduction3 Mar 2025
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation4 Feb 2025
- 2025PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generation20 Jan 2025
- 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspective1 Oct 2024
- 2024RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generation18 Jun 2024
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models3 Jun 2024
- 2023Active Retrieval Augmented Generation11 May 2023
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
- 2022Models and Datasets for Cross-Lingual Summarisationcited by 36
- 2022NEWTS: A Corpus for News Topic-Focused Summarizationcited by 27
- 2022OASum: Large-Scale Open Domain Aspect-based Summarizationcited by 24
- 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publicationscited by 20
- 2024MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflowscited by 19
- 2021CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notescited by 18
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
- 2024Mitigating Entity-Level Hallucination in Large Language Modelscited by 17
12 most cited of 45 All 45 (JSON)
- 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practices29 May 2026
- 2026MAPLE: Medical Aspect-Based Summarization with Phrase-Level Evidence6 Jan 2026
- 2025BookAsSumQA: An Evaluation Framework for Aspect-Based Book Summarization via Question Answering9 Nov 2025
- 2025CARPAS: Towards Content-Aware Refinement of Provided Aspects for Summarization in Large Language Models8 Oct 2025
- 2025Towards Personalized Explanations for Health Simulations: A Mixed-Methods Framework for Stakeholder-Centric Summarization4 Sep 2025
- 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipedia4 Jul 2025
- 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systems5 Jun 2025
- 2025MODS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collections1 Feb 2025
- 2024Efficient Aspect-Based Summarization of Climate Change Reports with Small Language Models21 Nov 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024From Single to Multi: How LLMs Hallucinate in Multi-Document Summarization17 Oct 2024
- 2024MARS: Multilingual Aspect-centric Review Summarisation13 Oct 2024
12 newest of 45 All 45 (JSON)