mlsanityData to 7 Oct 2026

Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyond

arXiv 1602.06023 ↗First posted 19 Feb 2016cs.CLcited by 809

Not on the map. Why?

Cited by 92 in Efficient LLM inference and serving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

In this work, we model abstractive text summarization using Attentional Encoder-Decoder Recurrent Neural Networks, and show that they achieve state-of-the-art performance on two different corpora. We propose several novel models that address critical problems in summarization that are not adequately modeled by the basic architecture, such as modeling key-words, capturing the hierarchy of sentence-to-word structure, and emitting words that are rare or unseen at training time. Our work shows that many of our proposed models contribute to further improvement in performance. We also propose a new dataset consisting of multi-sentence summaries, and establish performance benchmarks for further research.

Key facts. Cited by 809 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Feb 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 158; 2022: 134; 2023: 149; 2024: 178; 2025: 134; 2026: 56.

809 papers.

Sort:

By area:

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  5. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  6. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  7. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  8. 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 805
  9. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  10. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  11. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  12. 2024Large Language Models: A Surveycited by 506
38 more
  1. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
  2. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  3. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
  4. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
  5. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  6. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  7. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  8. 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Treescited by 362
  9. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  10. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  11. 2025EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Testcited by 318
  12. 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 302
  13. 2024Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decodingcited by 266
  14. 2021Measuring Attribution in Natural Language Generation Modelscited by 253
  15. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
  16. 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 241
  17. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  18. 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 233
  19. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
  20. 2023OpenAGI: When LLM Meets Domain Expertscited by 196
  21. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
  22. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  23. 2022Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Modelscited by 176
  24. 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
  25. 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
  26. 2024Large Language Models are Inconsistent and Biased Evaluatorscited by 146
  27. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  28. 2023Meta-Transformer: A Unified Framework for Multimodal Learningcited by 136
  29. 2021Annotating and Modeling Fine-grained Factuality in Summarizationcited by 131
  30. 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 131
  31. 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 127
  32. 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
  33. 2024MiniCache: KV Cache Compression in Depth Dimension for Large Language Modelscited by 122
  34. 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
  35. 2023Aligning Language Models with Preferences through f-divergence Minimizationcited by 118
  36. 2024Twin-Merging: Dynamic Integration of Modular Expertise in Model Mergingcited by 114
  37. 2023FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Modelscited by 112
  38. 2022Locally Typical Samplingcited by 108

50 most cited of 809 All 809 (JSON)