mlsanityData to 7 Oct 2026

FACTWASH: Catching AI Rewrites That Wash Hearsay into Fact

arXiv 2608.03372 ↗First posted 4 Aug 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

AI systems rewrite information constantly: conversations become stored memories, documents become answers. The rewrite can keep a claim while washing away what made it checkable, who said it, how sure they were, when it held. We call that failure factwashing, and release factwash, an open-source write-time gate that catches it deterministically, with named flags and evidence rather than an LLM judge. Building it answers a practical question: when does a cheap check suffice, and when do you need a model? What decides is whether the property has a bounded surface-cue inventory. Explicit negation cues are close to enumerable, so a word list finishes and transfers, reaching 0.91 F1 on untuned text. Hedging and attribution have open-ended realizations, so vocabulary plateaus near half recall, and a one-question LLM witness recovers +17 and +15 points of cue-detection recall at equal precision. Deployed, that witness may only lower a verdict, so it buys precision rather than coverage. We measure cue detection on 105,596 independently annotated sentences. A blind-labelled corpus of memory writes then locates the failure: 55% of bad writes in conversational hearsay, 7% in business email (p < 0.001), so the first deployment question is not which detector to use but whether the failure occurs at all. On unmodified mem0 2.0.7, the gate flags 5 of 8 hedged-hearsay writes.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 5 of its 19 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

5 of 19 references.

References · 5

  1. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  2. 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 285
  3. 2022Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectorscited by 103
  4. 2026Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty Onecited by 7
  5. 2026Manufactured Confidence: How Memory Consolidation Turns Hearsay into Confident Factscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.