Encode, Tag, Realize: High-Precision Text Editing
Not on the map. Why?
Abstract (arXiv)
We propose LaserTagger - a sequence tagging approach that casts text generation as a text editing task. Target texts are reconstructed from the inputs using three main edit operations: keeping a token, deleting it, and adding a phrase before the token. To predict the edit operations, we propose a novel model, which combines a BERT encoder with an autoregressive Transformer decoder. This approach is evaluated on English text on four tasks: sentence fusion, sentence splitting, abstractive summarization, and grammar correction. LaserTagger achieves new state-of-the-art results on three of these tasks, performs comparably to a set of strong seq2seq baselines with a large number of training examples, and outperforms them when the number of examples is limited. Furthermore, we show that at inference time tagging can be more than two orders of magnitude faster than comparable seq2seq models, making it more attractive for running in a live environment.
Key facts. Cited by 99 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 29; 2023: 30; 2024: 10; 2025: 6; 2026: 8.
99 papers.
Sort:
By area:
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2022Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generationcited by 169
- 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2022Understanding Iterative Revision from Human-Written Textcited by 56
- 2021Instantaneous Grammatical Error Correction with Shallow Aggressive Decodingcited by 53
- 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
- 2022DiffusER: Discrete Diffusion via Edit-based Reconstructioncited by 41
- 2021LEWIS: Levenshtein Editing for Unsupervised Text Style Transfercited by 40
- 2022On Improving Summarization Factual Consistency from Natural Language Feedbackcited by 38
- 2022EdiT5: Semi-Autoregressive Text-Editing with T5 Warm-Startcited by 35
- 2023ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviewscited by 34
38 more
- 2021NL-EDIT: Correcting semantic parse errors through natural language interactioncited by 33
- 2022MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correctioncited by 33
- 2021Focus Attention: Promoting Faithfulness and Diversity in Summarizationcited by 30
- 2022Learning to Model Editing Processescited by 30
- 2022EditEval: An Instruction-Based Benchmark for Text Improvementscited by 30
- 2021Text Simplification by Taggingcited by 27
- 2023Second Thoughts are Best: Learning to Re-Align With Human Values from Text Editscited by 27
- 2022Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correctioncited by 25
- 2021Learning to Complete Code with Sketchescited by 23
- 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigationcited by 22
- 2022Text Generation with Text-Editing Modelscited by 21
- 2022An Imitation Learning Curriculum for Text Editing with Non-Autoregressive Modelscited by 20
- 2022Improving Iterative Text Revision by Learning Where to Edit from Other Revision Taskscited by 20
- 2021Idiomatic Expression Identification using Semantic Compatibilitycited by 19
- 2024GPT-3.5 for Grammatical Error Correctioncited by 18
- 2022Text Revision by On-the-Fly Representation Optimizationcited by 17
- 2021Learning Structural Edits via Incremental Tree Transformationscited by 16
- 2023Med-EASi: Finely Annotated Dataset and Models for Controllable Simplification of Medical Textscited by 16
- 2022Sequence-to-Action: Grammatical Error Correction with Action Guided Sequence Generationcited by 15
- 2021A New Approach to Overgenerating and Scoring Abstractive Summariescited by 13
- 2022FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correctioncited by 13
- 2022Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correctioncited by 12
- 2023SWiPE: A Dataset for Document-Level Simplification of Wikipedia Pagescited by 12
- 2023Beyond English: Evaluating LLMs for Arabic Grammatical Error Correctioncited by 12
- 2021Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correctioncited by 11
- 2021AgreeSum: Agreement-Oriented Multi-Document Summarizationcited by 10
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2022Type-Driven Multi-Turn Corrections for Grammatical Error Correctioncited by 9
- 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Textscited by 9
- 2025Enhancing Text Editing for Grammatical Error Correction: Arabic as a Case Studycited by 9
- 2022Dynamic Planning in Open-Ended Dialogue using Reinforcement Learningcited by 8
- 2023Non-autoregressive Text Editing with Copy-aware Latent Alignmentscited by 8
- 2022Explicit Image Caption Editingcited by 7
- 2022From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correctioncited by 7
- 2023Exploring the Landscape of Natural Language Processing Researchcited by 7
- 2023Controlled Generation with Prompt Insertion for Natural Language Explanations in Grammatical Error Correctioncited by 7
- 2024Rich Semantic Knowledge Enhanced Large Language Models for Few-shot Chinese Spell Checkingcited by 7
- 2022ASR Error Correction with Constrained Decoding on Operation Predictioncited by 6
50 most cited of 99 All 99 (JSON)
- 2026Leveraging Fine-grained Error Correction in Korean Speech Recognition for Consultation Services9 Sep 2026
- 2026Reviser: Revision-Capable Text Generation via Autoregressive Cursor Actions23 Jul 2026
- 2026STAGEET: Stage-wise Typed Edit Tagging for Grammatical Error Correction with Arabic as a Case Study23 Jul 2026
- 2026BeatEdit: Symbolic Music Generation as Explicit Editing13 Jul 2026
- 2026From Standard English to Singlish: A Retrieval-Augmented Approach for Code-Switched Creole Generation in Large Language Models8 May 2026
- 2026Copy-as-Decode: Grammar-Constrained Parallel Prefill for LLM Editing20 Apr 2026
- 2026Teaching LLMs Human-Like Editing of Inappropriate Argumentation via Reinforcement Learning14 Apr 2026
- 2026Scoring Edit Impact in Grammatical Error Correction via Embedded Association Graphs8 Apr 2026
- 2025Layout-Aware Text Editing for Efficient Transformation of Academic PDFs to Markdown19 Dec 2025
- 2025RE2: Improving Chinese Grammatical Error Correction via Retrieving Appropriate Examples with Explanation30 Sep 2025
- 2025Leveraging What's Overfixed: Post-Correction via LLM Grammatical Error Overcorrection25 Sep 2025
- 2025Opportunities and Challenges of LLMs in Education: An NLP Perspective30 Jul 2025
38 more
- 2025Enhancing Text Editing for Grammatical Error Correction: Arabic as a Case Study2 Mar 2025
- 2025EdiText: Controllable Coarse-to-Fine Text Editing with Diffusion Language Models27 Feb 2025
- 2024SMI-Editor: Edit-based SMILES Language Model with Fragment-level Supervision7 Dec 2024
- 2024PatentEdits: Framing Patent Novelty as Textual Entailment20 Nov 2024
- 2024Tag and correct: high precision post-editing approach to correction of speech recognition errors11 Jun 2024
- 2024Detection-Correction Structure via General Language Model for Grammatical Error Correction28 May 2024
- 2024GPT-3.5 for Grammatical Error Correction14 May 2024
- 2024LM-Combiner: A Contextual Rewriting Model for Chinese Grammatical Error Correction26 Mar 2024
- 2024A Design Space for Intelligent and Interactive Writing Assistants21 Mar 2024
- 2024Rich Semantic Knowledge Enhanced Large Language Models for Few-shot Chinese Spell Checking13 Mar 2024
- 2024COBIAS: Assessing the Contextual Reliability of Bias Benchmarks for Language Models22 Feb 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023Split and Rephrase with Large Language Models18 Dec 2023
- 2023Beyond English: Evaluating LLMs for Arabic Grammatical Error Correction13 Dec 2023
- 2023Grammatical Error Correction via Mixed-Grained Weighted Training23 Nov 2023
- 2023GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding14 Nov 2023
- 2023Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmenting20 Oct 2023
- 2023G-SPEED: General SParse Efficient Editing MoDel16 Oct 2023
- 2023Non-autoregressive Text Editing with Copy-aware Latent Alignments11 Oct 2023
- 2023WikiIns: A High-Quality Dataset for Controlled Text Editing by Natural Language Instruction8 Oct 2023
- 2023A Computational Analysis of Vagueness in Revisions of Instructional Texts21 Sep 2023
- 2023Controlled Generation with Prompt Insertion for Natural Language Explanations in Grammatical Error Correction20 Sep 2023
- 2023XATU: A Fine-grained Instruction-based Benchmark for Explainable Text Updates20 Sep 2023
- 2023RedPenNet for Grammatical Error Correction: Outputs to Tokens, Attentions to Spans19 Sep 2023
- 2023Minimum Bayes' Risk Decoding for System Combination of Grammatical Error Correction Systems12 Sep 2023
- 2023ChatGPT for Arabic Grammatical Error Correction8 Aug 2023
- 2023Exploring the Landscape of Natural Language Processing Research20 Jul 2023
- 2023Toward Interactive Dictation8 Jul 2023
- 2023Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correction5 Jul 2023
- 2023An Adversarial Multi-Task Learning Method for Chinese Text Correction with Semantic Detection28 Jun 2023
- 2023ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews21 Jun 2023
- 2023Improving Audio Caption Fluency with Automatic Error Correction16 Jun 2023
- 20235IDER: Unified Query Rewriting for Steering, Intent Carryover, Disfluencies, Entity Carryover and Repair2 Jun 2023
- 2023SWiPE: A Dataset for Document-Level Simplification of Wikipedia Pages30 May 2023
- 2023NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Texts25 May 2023
- 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigation24 May 2023
- 2023Personalized Abstractive Summarization by Tri-agent Generation Pipeline4 May 2023
- 2023The Short Text Matching Model Enhanced with Knowledge via Contrastive Learning8 Apr 2023
50 newest of 99 All 99 (JSON)
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2022Understanding Iterative Revision from Human-Written Textcited by 56
- 2022Grammatical Error Correction: A Survey of the State of the Artcited by 43
- 2021LEWIS: Levenshtein Editing for Unsupervised Text Style Transfercited by 40
- 2022EdiT5: Semi-Autoregressive Text-Editing with T5 Warm-Startcited by 35
- 2023ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviewscited by 34
- 2021NL-EDIT: Correcting semantic parse errors through natural language interactioncited by 33
- 2022MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correctioncited by 33
- 2021Focus Attention: Promoting Faithfulness and Diversity in Summarizationcited by 30
- 2022Learning to Model Editing Processescited by 30
12 most cited of 90 All 90 (JSON)
- 2026Leveraging Fine-grained Error Correction in Korean Speech Recognition for Consultation Services9 Sep 2026
- 2026Reviser: Revision-Capable Text Generation via Autoregressive Cursor Actions23 Jul 2026
- 2026STAGEET: Stage-wise Typed Edit Tagging for Grammatical Error Correction with Arabic as a Case Study23 Jul 2026
- 2026BeatEdit: Symbolic Music Generation as Explicit Editing13 Jul 2026
- 2026Teaching LLMs Human-Like Editing of Inappropriate Argumentation via Reinforcement Learning14 Apr 2026
- 2026Scoring Edit Impact in Grammatical Error Correction via Embedded Association Graphs8 Apr 2026
- 2025Layout-Aware Text Editing for Efficient Transformation of Academic PDFs to Markdown19 Dec 2025
- 2025RE2: Improving Chinese Grammatical Error Correction via Retrieving Appropriate Examples with Explanation30 Sep 2025
- 2025Leveraging What's Overfixed: Post-Correction via LLM Grammatical Error Overcorrection25 Sep 2025
- 2025Opportunities and Challenges of LLMs in Education: An NLP Perspective30 Jul 2025
- 2025Enhancing Text Editing for Grammatical Error Correction: Arabic as a Case Study2 Mar 2025
- 2024SMI-Editor: Edit-based SMILES Language Model with Fragment-level Supervision7 Dec 2024
12 newest of 90 All 90 (JSON)