mlsanityData to 14 Oct 2026

AnyEdit++: Adaptive Long-Form Knowledge Editing via Bayesian Surprise

arXiv 2606.01053 ↗First posted 31 May 2026cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Editing complex, long-form knowledge in Large Language Models remains a significant challenge due to the difficulty of maintaining generation coherence. Existing autoregressive methods like AnyEdit alleviate length constraints but rely on Fixed-window Chunking, which disregards logical structure and compromises consistency. To address this, we present AnyEdit++, a structure-aware framework incorporating Bayes-Chunk, an adaptive segmentation mechanism that dynamically identifies semantic boundaries based on Bayesian Surprise. We underpin this approach with a theoretical framework establishing two key principles: (1) Structural Independence: we prove that cross-segment interference is minimized when anchor keys are geometrically orthogonal (a condition naturally satisfied by our surprisal-based boundaries but violated by fixed windows), and (2) Causal Locality: we demonstrate that updates injected at these semantic peaks yield strictly superior control compared to arbitrary split points. Extensive experiments across mathematical reasoning, code generation, and narrative tasks demonstrate that AnyEdit++ achieves superior performance and robustness compared to state-of-the-art baselines, validating that structural awareness is critical for effective long-form knowledge editing.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 27 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

24 of 27 references.

References · 24

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  4. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  5. 2022Mass-Editing Memory in a Transformercited by 1,001
  6. 2021Editing Factual Knowledge in Language Modelscited by 553
  7. 2022Memory-Based Model Editing at Scalecited by 447
  8. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 300
  9. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
  10. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
  11. 2023Transformer-Patcher: One Mistake worth One Neuroncited by 197
  12. 2020Editable Neural Networkscited by 155
12 more
  1. 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
  2. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 76
  3. 2023Massive Editing for Large Language Models via Meta Learningcited by 63
  4. 2023Editing Common Sense in Transformerscited by 28
  5. 2023History Matters: Temporal Knowledge Editing in Large Language Modelcited by 17
  6. 2024Commonsense Knowledge Editing Based on Free-Text in LLMscited by 16
  7. 2025Editing as Unlearning: Are Knowledge Editing Methods Strong Baselines for Large Language Model Unlearning?cited by 13
  8. 2024Beyond Task Vectors: Selective Task Arithmetic Based on Importance Metricscited by 11
  9. 2025ANT: Adaptive Neural Temporal-Aware Text-to-Motion Modelcited by 9
  10. 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Modelscited by 8
  11. 2025Is Fine-Tuning an Effective Solution? Reassessing Knowledge Editing for Unstructured Datacited by 6
  12. 2025Text2Weight: Bridging Natural Language and Neural Network Weight Spacescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Labyrinth and the Thread: Rethinking Regularizations in Sequential Knowledge Editing for Large Language Models
  2. 2025Benchmarking and Rethinking Knowledge Editing for Large Language Models
  3. 2025STEAM: A Semantic-Level Knowledge Editing Framework for Large Language Models
  4. 2024Knowledge in Superposition: Unveiling the Failures of Lifelong Knowledge Editing for Large Language Models
  5. 2025Aligning Language Models with Real-time Knowledge Editing
  6. 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
  7. 2025Causal Path Alignment: Anchoring the Optimization Trajectory for Controllable In-Parameter Knowledge Editing
  8. 2025EvoEdit: Evolving Null-space Alignment for Robust and Efficient Knowledge Editing