{"list":"other","total":105,"rows":[{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"1910.01108","title":"DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter","created":"2019-10-02","cited_by_count":4307},{"id":"2006.05525","title":"Knowledge Distillation: A Survey","created":"2020-06-09","cited_by_count":1603},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"1909.10351","title":"TinyBERT: Distilling BERT for Natural Language Understanding","created":"2019-09-23","cited_by_count":1167},{"id":"2606.19348","title":"DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence","created":"2026-04-26","cited_by_count":1040},{"id":"2306.13649","title":"On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes","created":"2023-06-23","cited_by_count":939},{"id":"2305.02301","title":"Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes","created":"2023-05-03","cited_by_count":737},{"id":"2311.03099","title":"Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch","created":"2023-11-06","cited_by_count":694},{"id":"2111.09832","title":"Merging Models with Fisher-Weighted Averaging","created":"2021-11-18","cited_by_count":621},{"id":"2602.15763","title":"GLM-5: from Vibe Coding to Agentic Engineering","created":"2026-02-17","cited_by_count":587},{"id":"1908.09355","title":"Patient Knowledge Distillation for BERT Model Compression","created":"2019-08-25","cited_by_count":508},{"id":"2310.16944","title":"Zephyr: Direct Distillation of LM Alignment","created":"2023-10-25","cited_by_count":506},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"2212.09849","title":"Dataless Knowledge Fusion by Merging Weights of Language Models","created":"2022-12-19","cited_by_count":387},{"id":"2212.08410","title":"Teaching Small Language Models to Reason","created":"2022-12-16","cited_by_count":284},{"id":"2601.19897","title":"Self-Distillation Enables Continual Learning","created":"2026-01-27","cited_by_count":247},{"id":"2403.13257","title":"Arcee's MergeKit: A Toolkit for Merging Large Language Models","created":"2024-03-20","cited_by_count":194},{"id":"2305.03053","title":"ZipIt! Merging Models from Different Tasks without Training","created":"2023-05-04","cited_by_count":179},{"id":"2603.07079","title":"Entropy-Aware On-Policy Distillation of Language Models","created":"2026-03-07","cited_by_count":175},{"id":"2412.00081","title":"Task Singular Vectors: Reducing Task Interference in Model Merging","created":"2024-11-26","cited_by_count":147},{"id":"2410.19735","title":"Model merging with SVD to tie the Knots","created":"2024-10-25","cited_by_count":122},{"id":"2211.08403","title":"REPAIR: REnormalizing Permuted Activations for Interpolation Repair","created":"2022-11-15","cited_by_count":120},{"id":"2405.17461","title":"EMR-Merging: Tuning-Free High-Performance Model Merging","created":"2024-05-23","cited_by_count":110},{"id":"2604.14084","title":"TIP: Token Importance in On-Policy Distillation","created":"2026-04-15","cited_by_count":104},{"id":"2402.02705","title":"Representation Surgery for Multi-Task Model Merging","created":"2024-02-05","cited_by_count":96},{"id":"2502.04959","title":"No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces","created":"2025-02-07","cited_by_count":96},{"id":"2210.01351","title":"Less is More: Task-aware Layer-wise Distillation for Language Model Compression","created":"2022-10-04","cited_by_count":93},{"id":"2502.18036","title":"Harnessing Multiple Large Language Models: A Survey on LLM Ensemble","created":"2025-02-25","cited_by_count":86},{"id":"2406.11617","title":"DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling","created":"2024-06-17","cited_by_count":81},{"id":"2603.19220","title":"Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation","created":"2026-03-19","cited_by_count":60},{"id":"2408.07990","title":"FuseChat: Knowledge Fusion of Chat Models","created":"2024-08-15","cited_by_count":55},{"id":"2602.15260","title":"Fast and Effective On-policy Distillation from Reasoning Prefixes","created":"2026-02-16","cited_by_count":53},{"id":"2304.14933","title":"An Empirical Study of Multimodal Model Merging","created":"2023-04-28","cited_by_count":52},{"id":"2408.07057","title":"A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning","created":"2024-08-13","cited_by_count":52},{"id":"2410.13025","title":"LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks","created":"2024-10-16","cited_by_count":52},{"id":"2310.08184","title":"Learning from models beyond fine-tuning","created":"2023-10-12","cited_by_count":48},{"id":"2604.24005","title":"TCOD: Exploring Temporal Curriculum in On-Policy Distillation for Multi-turn Autonomous Agents","created":"2026-04-27","cited_by_count":47},{"id":"2406.14563","title":"Model Merging and Safety Alignment: One Bad Model Spoils the Bunch","created":"2024-06-20","cited_by_count":43},{"id":"2604.10688","title":"SCOPE: Signal-Calibrated On-Policy Distillation Enhancement with Dual-Path Adaptive Weighting","created":"2026-04-12","cited_by_count":43},{"id":"2402.11455","title":"LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks","created":"2024-02-18","cited_by_count":39},{"id":"2501.01230","title":"Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent","created":"2025-01-02","cited_by_count":39},{"id":"2602.02994","title":"Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation","created":"2026-02-03","cited_by_count":36},{"id":"2505.10833","title":"MergeBench: A Benchmark for Merging Domain-Specialized LLMs","created":"2025-05-16","cited_by_count":33},{"id":"2604.13010","title":"Lightning OPD: Efficient Post-Training for Large Reasoning Models with Offline On-Policy Distillation","created":"2026-04-14","cited_by_count":33},{"id":"2502.02421","title":"Activation-Informed Merging of Large Language Models","created":"2025-02-04","cited_by_count":30},{"id":"2406.08431","title":"Diffusion Soup: Model Merging for Text-to-Image Diffusion Models","created":"2024-06-12","cited_by_count":26},{"id":"2502.17159","title":"RobustMerge: Parameter-Efficient Model Merging for MLLMs with Direction Robustness","created":"2025-02-24","cited_by_count":26},{"id":"2503.17239","title":"SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Merging","created":"2025-03-21","cited_by_count":25},{"id":"2503.23733","title":"AdaMMS: Model Merging for Heterogeneous Multimodal Large Language Models with Unsupervised Coefficient Optimization","created":"2025-03-31","cited_by_count":25},{"id":"2403.00108","title":"LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem","created":"2024-02-29","cited_by_count":24},{"id":"2410.17961","title":"Closed-form merging of parameter-efficient modules for Federated Continual Learning","created":"2024-10-23","cited_by_count":22},{"id":"2311.01555","title":"Instruction Distillation Makes Large Language Models Efficient Zero-shot Rankers","created":"2023-11-02","cited_by_count":19},{"id":"2404.05188","title":"Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model Merging","created":"2024-04-08","cited_by_count":19},{"id":"2605.01347","title":"MAD-OPD: Breaking the Ceiling in On-Policy Distillation via Multi-Agent Debate","created":"2026-05-02","cited_by_count":17},{"id":"2605.31490","title":"Are Full Rollouts Necessary for On-Policy Distillation?","created":"2026-05-29","cited_by_count":17},{"id":"2311.07682","title":"Fuse to Forget: Bias Reduction and Selective Memorization through Model Fusion","created":"2023-11-13","cited_by_count":13},{"id":"2505.19892","title":"OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Merging","created":"2025-05-26","cited_by_count":13},{"id":"2505.23859","title":"Towards Minimizing Feature Drift in Model Merging: Layer-wise Task Vector Fusion for Adaptive Knowledge Integration","created":"2025-05-29","cited_by_count":13},{"id":"2605.30833","title":"Your Teacher Can't Help You Here: Combating Supervision Fidelity Decay in On-Policy Distillation","created":"2026-05-29","cited_by_count":13},{"id":"2409.18314","title":"Realistic Evaluation of Model Merging for Compositional Generalization","created":"2024-09-26","cited_by_count":12},{"id":"2410.14389","title":"SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery","created":"2024-10-18","cited_by_count":12},{"id":"2505.13893","title":"InfiGFusion: Graph-on-Logits Distillation via Efficient Gromov-Wasserstein for Model Fusion","created":"2025-05-20","cited_by_count":12},{"id":"2505.14009","title":"Activation-Guided Consensus Merging for Large Language Models","created":"2025-05-20","cited_by_count":12},{"id":"2411.15231","title":"IterIS: Iterative Inference-Solving Alignment for LoRA Merging","created":"2024-11-21","cited_by_count":11},{"id":"2411.17792","title":"H3Fusion: Helpful, Harmless, Honest Fusion of Aligned LLMs","created":"2024-11-26","cited_by_count":11},{"id":"2502.10339","title":"STAR: Spectral Truncation and Rescale for Model Merging","created":"2025-02-14","cited_by_count":11},{"id":"2601.16547","title":"CORD: Bridging the Audio-Text Reasoning Gap via Weighted On-policy Cross-modal Distillation","created":"2026-01-23","cited_by_count":11},{"id":"2605.29343","title":"Draft-OPD: On-Policy Distillation for Speculative Draft Models","created":"2026-05-28","cited_by_count":11},{"id":"2502.12706","title":"Scalable Model Merging with Progressive Layer-wise Distillation","created":"2025-02-18","cited_by_count":10},{"id":"2410.05357","title":"Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild","created":"2024-10-07","cited_by_count":9},{"id":"2606.09456","title":"Breaking the Tokenizer Barrier: On-Policy Distillation across Model Families","created":"2026-06-08","cited_by_count":9},{"id":"2509.21413","title":"Null-Space Filtering for Data-Free Continual Model Merging: Preserving Stability, Promoting Plasticity","created":"2025-09-25","cited_by_count":8},{"id":"2603.06242","title":"DC-Merge: Improving Model Merging with Directional Consistency","created":"2026-03-06","cited_by_count":8},{"id":"2601.22285","title":"Demystifying Mergeability: Interpretable Properties to Predict Model Merging Success","created":"2026-01-29","cited_by_count":7},{"id":"2602.05176","title":"Among Us: Measuring and Mitigating Malicious Contributions in Model Collaboration Systems","created":"2026-02-05","cited_by_count":7},{"id":"2606.01476","title":"OmniOPD: Logit-Free On-Policy Distillation via Speculative Verification","created":"2026-05-31","cited_by_count":7},{"id":"2412.04144","title":"If You Can't Use Them, Recycle Them: Optimizing Merging at Scale Mitigates Performance Tradeoffs","created":"2024-12-05","cited_by_count":6},{"id":"2507.17706","title":"HydraOpt: Navigating the Efficiency-Performance Trade-off of Adapter Merging","created":"2025-07-23","cited_by_count":6},{"id":"2510.18541","title":"Pay Attention to the Triggers: Constructing Backdoors That Survive Distillation","created":"2025-10-21","cited_by_count":6},{"id":"2602.13273","title":"MergePipe: A Budget-Aware Parameter Management System for Scalable LLM Merging","created":"2026-02-05","cited_by_count":6},{"id":"2502.16094","title":"Merger-as-a-Stealer: Stealing Targeted PII from Aligned LLMs with Model Merging","created":"2025-02-22","cited_by_count":5},{"id":"2505.11427","title":"Mergenetic: a Simple Evolutionary Model Merging Library","created":"2025-05-16","cited_by_count":5},{"id":"2505.24174","title":"Adaptive LoRA Merge with Parameter Pruning for Low-Resource Generation","created":"2025-05-30","cited_by_count":5},{"id":"2509.17348","title":"AIMMerging: Adaptive Iterative Model Merging Using Training Trajectories for Language Model Continual Learning","created":"2025-09-22","cited_by_count":5},{"id":"2510.20479","title":"RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model Merging","created":"2025-10-23","cited_by_count":5},{"id":"2511.21437","title":"A Systematic Study of In-the-Wild Model Merging for Large Language Models","created":"2025-11-26","cited_by_count":5},{"id":"2605.09608","title":"Geometry Conflict: Explaining and Controlling Forgetting in LLM Continual Post-Training","created":"2026-05-10","cited_by_count":5},{"id":"2605.13030","title":"FeatCal: Feature Calibration for Post-Merging Models","created":"2026-05-13","cited_by_count":5},{"id":"2603.09463","title":"An Empirical Study and Theoretical Explanation on Task-Level Model-Merging Collapse","created":"2026-03-10","cited_by_count":4},{"id":"2603.26317","title":"Label-Free Cross-Task LoRA Merging with Null-Space Compression","created":"2026-03-27","cited_by_count":4},{"id":"2604.04461","title":"DP-OPD: Differentially Private On-Policy Distillation for Language Models","created":"2026-04-06","cited_by_count":3},{"id":"2606.03723","title":"Compress then Merge: From Multiple LoRAs into One Low-Rank Adapter","created":"2026-06-02","cited_by_count":3},{"id":"2606.07289","title":"Closed-Form Spectral Regularization for Multi-Task Model Merging","created":"2026-06-05","cited_by_count":3},{"id":"2509.02555","title":"Surrogate Benchmarks for Model Merging Optimization","created":"2025-09-02","cited_by_count":2},{"id":"2512.19320","title":"MAGIC: Achieving Superior Model Merging via Magnitude Calibration","created":"2025-12-22","cited_by_count":2},{"id":"2512.21288","title":"Model Merging via Multi-Teacher Knowledge Distillation","created":"2025-12-24","cited_by_count":2},{"id":"2601.16127","title":"Improving Training Efficiency and Reducing Maintenance Costs via Language Specific Model Merging","created":"2026-01-22","cited_by_count":2}],"next_cursor":"100"}