Model-to-Model Knowledge Transmission (M2KT): A Data-Free Framework for Cross-Model Understanding Transfer
Not on the map. Why?
Abstract (arXiv)
Modern artificial intelligence systems depend heavily on large datasets for both training and transferring knowledge between models. Knowledge distillation, transfer learning, and dataset distillation have made such transfers more efficient, yet they remain fundamentally data-driven: a teacher must produce examples, logits, or gradients for a student to learn. In this work, we introduce Model-to-Model Knowledge Transmission (M2KT), a novel paradigm for data-free conceptual transfer between neural networks. M2KT enables models to exchange knowledge packets that encapsulate structured concept embeddings, abstraction graphs, reasoning traces, and provenance metadata. Unlike classical distillation, M2KT operates primarily in concept space rather than example space, and it does not require labeled datasets or teacher-generated outputs during transfer. We formalize the notion of concept manifolds, introduce an inter-model alignment mapping between teacher and student latent spaces, and derive a composite loss that enforces geometric, structural, and reasoning consistency together with explicit safety constraints. We further present algorithmic procedures for teacher-side packet generation and student-side ingestion and verification. Experiments on symbolic reasoning with large language models show that M2KT can achieve approximately 85 to 90 percent of teacher performance while reducing data usage by over 98 percent compared to standard knowledge distillation. This work establishes a theoretical and practical foundation for data-free AI-to-AI knowledge transfer and self-improving model ecosystems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 14 references that are in the map. First posted on arXiv 19 Nov 2025.
Builds on
6 of 14 references.
References · 6
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2023A Comprehensive Survey of Dataset Distillationcited by 115
- 2023A Survey on Dataset Distillation: Approaches, Applications and Future Directionscited by 32
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation
- 2025MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
- 2024MergeNet: Knowledge Migration across Heterogeneous Models, Tasks, and Modalities
- 2026From Images to Words: Efficient Cross-Modal Knowledge Distillation to Language Models from Black-box Teachers
- 2022Selective Cross-Task Distillation
- 2025Beyond Neural Incompatibility: Cross-Scale Knowledge Transfer in Language Models through Latent Semantic Alignment
- 2025What Should Feature Distillation Transfer in LLMs? A Task-Tangent Geometry View
- 2024Knowledge Distillation of Black-Box Large Language Models