When the Same Musical Knowledge Forgets Differently: A Clean Probe of Pathway-Dependent Forgetting
Not on the map. Why?
Abstract (arXiv)
A model can learn that the piano piece F"ur Elise is calm and reflective by listening to the audio or by reading a text description, but does it matter which route that knowledge took when it is later at risk of being forgotten? Forgetting research in multimodal models measures what knowledge is lost under adaptation, yet has not asked whether acquisition route affects how easily that knowledge is forgotten. We call this untested premise the Pathway-Invariant Assumption. Music understanding enables a clean test because a music clip and a canonical text description can be aligned to the same perceptual content, allowing the same knowledge unit to enter a model through listening or reading while the target remains fixed. Across multiple architecturally distinct audio-language models, we observe a consistent asymmetry: text-pathway knowledge is forgotten more than matched audio-pathway knowledge under identical adaptation pressure. To attribute this effect to route rather than confounds, we introduce the Paired Pathway Controlled Protocol (PPCP), a three-phase design that establishes matched pathway baselines, activates both pathways under symmetric supervision on the same knowledge pool, and applies identical forgetting pressure to both pathways. The gap is stable across models and gain-controlled analyses, persists when contradictory overwrite is replaced by correct-label cross-domain learning, remains under single-modality pressure, and is not removed by lightweight replay. Two independent routing-depth controls confirm that the effect is not explained by architectural depth, pointing to input representation as the dominant factor. Under PPCP, our results demonstrate that forgetting is highly route-dependent, establishing acquisition route as a new analytical dimension for forgetting research and multimodal system design.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 13 Jun 2026.
Builds on
15 of 38 references.
References · 15
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2016Progressive Neural Networkscited by 1,361
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
- 2019On Tiny Episodic Memories in Continual Learningcited by 307
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
- 2023Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioningcited by 77
3 more
- 2024Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfercited by 31
- 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Expertscited by 14
- 2025Mitigating Intra- and Inter-modal Forgetting in Continual Learning of Unified Multimodal Modelscited by 6
Built on by
Not cited yet.