Abstractive Summarization of Reddit Posts with Multi-level Memory Networks
Not on the map. Why?
Abstract (arXiv)
We address the problem of abstractive summarization in two directions: proposing a novel dataset and a new model. First, we collect Reddit TIFU dataset, consisting of 120K posts from the online discussion forum Reddit. We use such informal crowd-generated posts as text source, in contrast with existing datasets that mostly use formal documents as source such as news articles. Thus, our dataset could less suffer from some biases that key sentences usually locate at the beginning of the text and favorable summary candidates are already inside the text in similar forms. Second, we propose a novel abstractive summarization model named multi-level memory networks (MMN), equipped with multi-level memory to store the information of text from different levels of abstraction. With quantitative evaluation and user studies via Amazon Mechanical Turk, we show the Reddit TIFU dataset is highly abstractive and the MMN outperforms the state-of-the-art summarization models.
Key facts. Cited by 102 papers in the map (data through 13 Oct 2026). First posted on arXiv 2 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 28; 2023: 24; 2024: 22; 2025: 10; 2026: 2.
102 papers.
Sort:
By area:
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 485
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 473
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 344
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 195
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
- 2023Unified Demonstration Retriever for In-Context Learningcited by 141
- 2022Calibrating Sequence likelihood Improves Conditional Language Generationcited by 121
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2021Cross Modal Retrieval with Querybank Normalisationcited by 71
- 2022SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarizationcited by 61
- 2021HTLM: Hyper-Text Pre-Training and Prompting of Language Modelscited by 58
38 more
- 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 58
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2021AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarizationcited by 51
- 2023Teach LLMs to Personalize -- An Approach inspired by Writing Educationcited by 48
- 2024SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Modelscited by 37
- 2022A Simple Hash-Based Early Exiting Approach For Language Understanding and Generationcited by 32
- 2021Focus Attention: Promoting Faithfulness and Diversity in Summarizationcited by 30
- 2023Data Portraits: Recording Foundation Model Training Datacited by 30
- 2023On Context Utilization in Summarization with Large Language Modelscited by 30
- 2022Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarizationcited by 29
- 2024Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Biascited by 28
- 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
- 2022How Far are We from Robust Long Abstractive Summarization?cited by 25
- 2023On Uncertainty Calibration and Selective Generation in Probabilistic Neural Summarization: A Benchmark Studycited by 25
- 2021Unsupervised Extractive Summarization using Pointwise Mutual Informationcited by 23
- 2021GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generationcited by 20
- 2021Enriching and Controlling Global Semantics for Text Summarizationcited by 20
- 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publicationscited by 20
- 2024Data Contamination Report from the 2024 CONDA Shared Taskcited by 20
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
- 2021Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Testcited by 17
- 2021How well do you know your summarization datasets?cited by 16
- 2022UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarizationcited by 15
- 2021Meta-Transfer Learning for Low-Resource Abstractive Summarizationcited by 14
- 2025SimMark: A Robust Sentence-Level Similarity-Based Watermarking Algorithm for Large Language Modelscited by 14
- 2022Make The Most of Prior Data: A Solution for Interactive Text Summarization with Preference Feedbackcited by 13
- 2022Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Expertscited by 12
- 2022MentSum: A Resource for Exploring Summarization of Mental Health Online Postscited by 11
- 2023Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning?cited by 11
- 2024Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasingcited by 11
- 2021TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Postscited by 10
- 2022Controlled Text Reductioncited by 10
- 2024Tandem Transformers for Inference Efficient LLMscited by 10
- 2024GenAudit: Fixing Factual Errors in Language Model Outputs with Evidencecited by 10
- 2022Template-based Abstractive Microblog Opinion Summarisationcited by 9
- 2023InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPTcited by 9
- 2024GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Modelscited by 9
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarizationcited by 8
50 most cited of 102 All 102 (JSON)
- 2026Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts30 Sep 2026
- 2026AP-OOD: Attention Pooling for Out-of-Distribution Detection5 Feb 2026
- 2025No Loss, No Gain: Gated Refinement and Adaptive Compression for Prompt Optimization27 Sep 2025
- 2025Vec2Summ: Text Summarization via Probabilistic Sentence Embeddings9 Aug 2025
- 2025Let's Measure Information Step-by-Step: AI-Based Evaluation Beyond Vibes7 Aug 2025
- 2025RedTopic: Toward Topic-Diverse Red Teaming of Large Language Models17 Jun 2025
- 2025Interpretable Depression Detection from Social Media Text Using LLM-Derived Embeddings7 Jun 2025
- 2025Improving the Calibration of Confidence Scores in Text Generation Using the Output Distribution's Characteristics31 May 2025
- 2025A Course Correction in Steerability Evaluation: Revealing Miscalibration and Side Effects in LLMs27 May 2025
- 2025Hallucinate at the Last in Long Response Generation: A Case Study on Long Document Summarization21 May 2025
- 2025DUAL: Diversity and Uncertainty Active Learning for Text Summarization2 Mar 2025
- 2025SimMark: A Robust Sentence-Level Similarity-Based Watermarking Algorithm for Large Language Models5 Feb 2025
38 more
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024DomainSum: A Hierarchical Benchmark for Fine-Grained Domain Shift in Abstractive Text Summarization21 Oct 2024
- 2024FastLexRank: Efficient Lexical Ranking for Structuring Social Media Posts2 Oct 2024
- 2024Extract-and-Abstract: Unifying Extractive and Abstractive Summarization within Single Encoder-Decoder Framework18 Sep 2024
- 2024Bidirectional Awareness Induction in Autoregressive Seq2Seq Models25 Aug 2024
- 2024GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Models22 Aug 2024
- 2024Large Language Models Know What Makes Exemplary Contexts14 Aug 2024
- 2024Data Contamination Report from the 2024 CONDA Shared Task31 Jul 2024
- 2024Position: Measure Dataset Diversity, Don't Just Claim It11 Jul 2024
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models17 Jun 2024
- 2024Write Summary Step-by-Step: A Pilot Study of Stepwise Summarization8 Jun 2024
- 2024Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing6 Jun 2024
- 2024Understanding Position Bias Effects on Fairness in Social Multi-Document Summarization3 May 2024
- 2024Does In-Context Learning Really Learn? Rethinking How Large Language Models Respond and Solve Tasks via In-Context Learning11 Apr 2024
- 2024Information-Theoretic Distillation for Reference-less Summarization20 Mar 2024
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression19 Mar 2024
- 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications8 Mar 2024
- 2024GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence19 Feb 2024
- 2024Tandem Transformers for Inference Efficient LLMs13 Feb 2024
- 2024SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models16 Jan 2024
- 2024Generative Deduplication For Socia Media Data Selection11 Jan 2024
- 2024Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Bias3 Jan 2024
- 2023Beyond Output Matching: Bidirectional Alignment for Enhanced In-Context Learning28 Dec 2023
- 2023On Context Utilization in Summarization with Large Language Models16 Oct 2023
- 2023Calibrating Likelihoods towards Consistency in Summarization Models12 Oct 2023
- 2023Core-sets for Fair and Diverse Data Summarization12 Oct 2023
- 2023Teach LLMs to Personalize -- An Approach inspired by Writing Education15 Aug 2023
- 2023SMILE: Evaluation and Domain Adaptation for Social Media Language Understanding30 Jun 2023
- 2023GUMSum: Multi-Genre Data and Evaluation for English Abstractive Summarization20 Jun 2023
- 2023Summarization from Leaderboards to Practice: Choosing A Representation Backbone and Ensuring Robustness18 Jun 2023
- 2023Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization26 May 2023
- 2023Topic-Guided Self-Introduction Generation for Social Media Users24 May 2023
- 2023USB: A Unified Summarization Benchmark Across Tasks and Domains23 May 2023
- 2023InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT22 May 2023
- 2023Recent Trends in Unsupervised Summarization18 May 2023
- 2023PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization11 May 2023
- 2023Unified Demonstration Retriever for In-Context Learning7 May 2023
- 2023On Uncertainty Calibration and Selective Generation in Probabilistic Neural Summarization: A Benchmark Study17 Apr 2023
50 newest of 102 All 102 (JSON)
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 485
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 195
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
- 2023Unified Demonstration Retriever for In-Context Learningcited by 141
- 2022Calibrating Sequence likelihood Improves Conditional Language Generationcited by 121
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2021Cross Modal Retrieval with Querybank Normalisationcited by 71
- 2021HTLM: Hyper-Text Pre-Training and Prompting of Language Modelscited by 58
- 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 58
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2021AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarizationcited by 51
12 most cited of 91 All 91 (JSON)
- 2026Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts30 Sep 2026
- 2026AP-OOD: Attention Pooling for Out-of-Distribution Detection5 Feb 2026
- 2025No Loss, No Gain: Gated Refinement and Adaptive Compression for Prompt Optimization27 Sep 2025
- 2025Vec2Summ: Text Summarization via Probabilistic Sentence Embeddings9 Aug 2025
- 2025Let's Measure Information Step-by-Step: AI-Based Evaluation Beyond Vibes7 Aug 2025
- 2025Interpretable Depression Detection from Social Media Text Using LLM-Derived Embeddings7 Jun 2025
- 2025Improving the Calibration of Confidence Scores in Text Generation Using the Output Distribution's Characteristics31 May 2025
- 2025Hallucinate at the Last in Long Response Generation: A Case Study on Long Document Summarization21 May 2025
- 2025DUAL: Diversity and Uncertainty Active Learning for Text Summarization2 Mar 2025
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024DomainSum: A Hierarchical Benchmark for Fine-Grained Domain Shift in Abstractive Text Summarization21 Oct 2024
- 2024FastLexRank: Efficient Lexical Ranking for Structuring Social Media Posts2 Oct 2024
12 newest of 91 All 91 (JSON)