Controlling Output Length in Neural Encoder-Decoders
Not on the map. Why?
Abstract (arXiv)
Neural encoder-decoder models have shown great success in many sequence generation tasks. However, previous work has not investigated situations in which we would like to control the length of encoder-decoder outputs. This capability is crucial for applications such as text summarization, in which we have to generate concise summaries with a desired length. In this paper, we propose methods for controlling the output sequence length for neural encoder-decoder models: two decoding-based methods and two learning-based methods. Results show that our learning-based methods have the capability to control length without degrading summary quality in a summarization task.
Key facts. Cited by 75 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 21; 2023: 16; 2024: 6; 2025: 8; 2026: 3.
75 papers.
Sort:
By area:
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2023A Long Way to Go: Investigating Length Correlations in RLHFcited by 291
- 2021Aspect-Controllable Opinion Summarizationcited by 47
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2021Data-to-text Generation with Macro Planningcited by 34
- 2021Controllable Abstractive Dialogue Summarization with Sketch Supervisioncited by 27
- 2021Control Prefixes for Parameter-Efficient Text Generationcited by 24
- 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
- 2023Improving Pacing in Long-Form Story Planningcited by 21
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021Deep Extrapolation for Attribute-Enhanced Generationcited by 18
- 2021Machine Translation Verbosity Control for Automatic Dubbingcited by 18
38 more
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
- 2021Controllable Summarization with Constrained Markov Decision Processcited by 17
- 2023"Why is this misleading?": Detecting News Headline Hallucinations with Explanationscited by 17
- 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checkingcited by 17
- 2021LenAtten: An Effective Length Controlling Unit For Text Summarizationcited by 14
- 2022Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillationcited by 14
- 2021Text Compression-aided Transformer Encodingcited by 13
- 2021A New Approach to Overgenerating and Scoring Abstractive Summariescited by 13
- 2021Style Pooling: Automatic Text Style Obfuscation for Improved Classification Fairnesscited by 12
- 2022Context-Tuning: Learning Contextualized Prompts for Natural Language Generationcited by 12
- 2023Learning Combinatorial Prompts for Universal Controllable Image Captioningcited by 12
- 2026WS-GRPO: Weakly-Supervised Group-Relative Policy Optimization for Rollout-Efficient Reasoningcited by 12
- 2021Lost in Interpreting: Speech Translation from Source or Interpreter?cited by 10
- 2021Style Control for Schema-Guided Natural Language Generationcited by 10
- 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Rewardcited by 10
- 2022Time-aware Prompting for Text Generationcited by 10
- 2024Zero-Shot Strategies for Length-Controllable Summarizationcited by 10
- 2025ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructionscited by 10
- 2022Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoningcited by 8
- 2022"What makes a question inquisitive?" A Study on Type-Controlled Inquisitive Question Generationcited by 7
- 2022Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documentscited by 7
- 2022FAST: Improving Controllability for Text Generation with Feedback Aware Self-Trainingcited by 7
- 2022Controlled Language Generation for Language Learning Itemscited by 7
- 2023CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generationcited by 7
- 2023Toward Unified Controllable Text Generation via Regular Expression Instructioncited by 7
- 2021Progressive Open-Domain Response Generation with Multiple Controllable Attributescited by 6
- 2022A Focused Study on Sequence Length for Dialogue Summarizationcited by 6
- 2022Latent Prompt Tuning for Text Summarizationcited by 6
- 2023The Current State of Summarizationcited by 6
- 2021Unifying Cross-lingual Summarization and Machine Translation with Compression Ratecited by 5
- 2022Unsupervised Multi-Granularity Summarizationcited by 5
- 2023ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oraclescited by 5
- 2021Neural Rule-Execution Tracking Machine For Transformer-Based Text Generationcited by 4
- 2022Revision for Concision: A Constrained Paraphrase Generation Taskcited by 4
- 2022Towards Attribute-Entangled Controllable Text Generation: A Pilot Study of Blessing Generationcited by 4
- 2022(Psycho-)Linguistic Features Meet Transformer Models for Improved Explainable and Controllable Text Simplificationcited by 4
- 2023Summarization with Precise Length Controlcited by 4
- 2023Controlled Text Generation with Hidden Representation Transformationscited by 4
50 most cited of 75 All 75 (JSON)
- 2026CAVEWOMAN: How Large Language Models Behave Under Linguistic Input and Output Compression23 Jun 2026
- 2026WS-GRPO: Weakly-Supervised Group-Relative Policy Optimization for Rollout-Efficient Reasoning19 Feb 2026
- 2026Author-in-the-Loop Response Generation and Evaluation: Integrating Author Expertise and Intent in Responses to Peer Review19 Jan 2026
- 2025Progress Ratio Embeddings: An Impatience Signal for Robust Length Control in Neural Text Generation7 Dec 2025
- 2025ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions18 Nov 2025
- 2025Reasoning-Guided Claim Normalization for Noisy Multilingual Social Media Posts7 Nov 2025
- 2025Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization12 Aug 2025
- 2025Length Representations in Large Language Models27 Jul 2025
- 2025Controlling Summarization Length Through EOS Token Weighting5 Jun 2025
- 2025Considering Length Diversity in Retrieval-Augmented Summarization12 Mar 2025
- 2025Beyond One-Size-Fits-All Summarization: Customizing Summaries for Diverse Users10 Mar 2025
- 2024Zero-Shot Strategies for Length-Controllable Summarization31 Dec 2024
38 more
- 2024Hansel: Output Length Controlling Framework for Large Language Models18 Dec 2024
- 2024Fine-grained length controllable video captioning with ordinal embeddings27 Aug 2024
- 2024Improving Citation Text Generation: Overcoming Limitations in Length Control20 Jul 2024
- 2024InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Models16 Jun 2024
- 2024Effective Unsupervised Constrained Text Generation based on Perturbed Masking24 Apr 2024
- 2023Unsupervised Extractive Summarization with Learnable Length Control Strategies12 Dec 2023
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Survey15 Nov 2023
- 2023Improving Pacing in Long-Form Story Planning8 Nov 2023
- 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checking22 Oct 2023
- 2023A Long Way to Go: Investigating Length Correlations in RLHF5 Oct 2023
- 2023Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models22 Sep 2023
- 2023Toward Unified Controllable Text Generation via Regular Expression Instruction19 Sep 2023
- 2023ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oracles29 Jun 2023
- 2023CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generation1 Jun 2023
- 2023Controlled Text Generation with Hidden Representation Transformations30 May 2023
- 2023Summarization with Precise Length Control9 May 2023
- 2023The Current State of Summarization8 May 2023
- 2023Evaluating the Efficacy of Length-Controllable Machine Translation3 May 2023
- 2023Exposing the Functionalities of Neurons for Gated Recurrent Unit Based Sequence-to-Sequence Model27 Mar 2023
- 2023Learning Combinatorial Prompts for Universal Controllable Image Captioning11 Mar 2023
- 2023"Why is this misleading?": Detecting News Headline Hallucinations with Explanations12 Feb 2023
- 2022(Psycho-)Linguistic Features Meet Transformer Models for Improved Explainable and Controllable Text Simplification19 Dec 2022
- 2022Controlled Language Generation for Language Learning Items28 Nov 2022
- 2022Time-aware Prompting for Text Generation3 Nov 2022
- 2022Latent Prompt Tuning for Text Summarization3 Nov 2022
- 2022Towards Attribute-Entangled Controllable Text Generation: A Pilot Study of Blessing Generation29 Oct 2022
- 2022Revision for Concision: A Constrained Paraphrase Generation Task25 Oct 2022
- 2022Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation25 Oct 2022
- 2022Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning21 Oct 2022
- 2022Psychology-guided Controllable Story Generation14 Oct 2022
- 2022FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training6 Oct 2022
- 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Reward25 Sep 2022
- 2022A Focused Study on Sequence Length for Dialogue Summarization24 Sep 2022
- 2022Few-Shot Table-to-Text Generation with Prefix-Controlled Generator23 Aug 2022
- 2022Bridging the Gap Between Training and Inference of Bayesian Controllable Language Models11 Jun 2022
- 2022Why is constrained neural language generation particularly challenging?11 Jun 2022
- 2022Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents25 May 2022
- 2022"What makes a question inquisitive?" A Study on Type-Controlled Inquisitive Question Generation17 May 2022
50 newest of 75 All 75 (JSON)
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2021Aspect-Controllable Opinion Summarizationcited by 47
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2021Data-to-text Generation with Macro Planningcited by 34
- 2021Controllable Abstractive Dialogue Summarization with Sketch Supervisioncited by 27
- 2021Control Prefixes for Parameter-Efficient Text Generationcited by 24
- 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
- 2023Improving Pacing in Long-Form Story Planningcited by 21
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021Deep Extrapolation for Attribute-Enhanced Generationcited by 18
- 2021Machine Translation Verbosity Control for Automatic Dubbingcited by 18
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
12 most cited of 69 All 69 (JSON)
- 2026CAVEWOMAN: How Large Language Models Behave Under Linguistic Input and Output Compression23 Jun 2026
- 2026Author-in-the-Loop Response Generation and Evaluation: Integrating Author Expertise and Intent in Responses to Peer Review19 Jan 2026
- 2025Progress Ratio Embeddings: An Impatience Signal for Robust Length Control in Neural Text Generation7 Dec 2025
- 2025ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions18 Nov 2025
- 2025Reasoning-Guided Claim Normalization for Noisy Multilingual Social Media Posts7 Nov 2025
- 2025Length Representations in Large Language Models27 Jul 2025
- 2025Controlling Summarization Length Through EOS Token Weighting5 Jun 2025
- 2025Beyond One-Size-Fits-All Summarization: Customizing Summaries for Diverse Users10 Mar 2025
- 2024Zero-Shot Strategies for Length-Controllable Summarization31 Dec 2024
- 2024Hansel: Output Length Controlling Framework for Large Language Models18 Dec 2024
- 2024Fine-grained length controllable video captioning with ordinal embeddings27 Aug 2024
- 2024Improving Citation Text Generation: Overcoming Limitations in Length Control20 Jul 2024
12 newest of 69 All 69 (JSON)