mlsanityData to 14 Oct 2026

Detect, Remask, Repair: Diffusion Editing for Faithful Summarization of Evolving Contexts

arXiv 2606.12807 ↗First posted 11 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Summaries of real-world events can become outdated as contexts evolve and new information arrives. A common response is to generate a new summary from the updated context, but full regeneration discards the previous draft, can obscure what changed, and may be unnecessary when only a few claims are unsupported. We study localized faithfulness repair: updating outdated spans in an existing summary while preserving supported content. We propose DETECT-REMASK-REPAIR, a diffusion-based framework that identifies, remasks, and repairs outdated regions with masked diffusion language models. To evaluate evolving-context summarization, we introduce StreamSum, a benchmark of synthetic event timelines. Experiments on DialogSum and StreamSum show that localized diffusion repair provides a controllable alternative to full rewriting: faithfulness-steered repair improves early drafts, one-step repair reduces repair cost to under half a second, with the framework enabling faithfulness-speed-preservation tradeoffs across datasets. We also find that the framework can provide a post-hoc correction step that improves faithfulness for autoregressive systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

22 of 32 references.

References · 22

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  2. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  3. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  4. 2020SummEval: Re-evaluating Summarization Evaluationcited by 674
  5. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  6. 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
  7. 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 287
  8. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
  9. 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 244
  10. 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
  11. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Modelscited by 224
  12. 2025Remasking Discrete Diffusion Models with Inference-Time Scalingcited by 189
10 more
  1. 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 183
  2. 2020Evaluating Factuality in Generation with Dependency-level Entailmentcited by 122
  3. 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
  4. 2025Path Planning for Masked Diffusion Model Samplingcited by 80
  5. 2024TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarizationcited by 66
  6. 2025Fine-Tuning Masked Diffusion for Provable Self-Correctioncited by 39
  7. 2024Learning to Refine with Fine-Grained Natural Language Feedbackcited by 27
  8. 2024On Positional Bias of Faithfulness for Long-form Summarizationcited by 22
  9. 2024Enhancing Incremental Summarization with Structured Representationscited by 4
  10. 2025Rethinking Reasoning with MDLMs: Early Exits, Post-hoc Reasoning, and Beyondcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CORE: Context-Robust Remasking for Diffusion Language Models
  2. 2026Remask, Don't Replace: Token-to-Mask Refinement in Diffusion Language Models
  3. 2026Targeted Remasking: Replacing Token Editing with Token-to-Mask Refinement in Discrete Diffusion Language Models
  4. 2026NAVIRA: Decoupled Stochastic Remasking for Masked Diffusion Language Models
  5. 2026Multi-Stream Residual Computation in Diffusion Language Models
  6. 2025Don't Let It Fade: Preserving Edits in Diffusion Language Models via Token Timestep Allocation
  7. 2026LOCKR: A Hidden-State Trajectory-Guided Planner for Detecting and Repairing Stable-but-Wrong Lock-In in Diffusion Language Models
  8. 2025Don't Settle Too Early: Self-Reflective Remasking for Diffusion Language Models