mlsanityData to 7 Oct 2026

MGit: A Model Versioning and Management System

arXiv 2307.07507 ↗First posted 14 Jul 2023cs.LG cs.DC cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

Models derived from other models are extremely common in machine learning (ML) today. For example, transfer learning is used to create task-specific models from "pre-trained" models through finetuning. This has led to an ecosystem where models are related to each other, sharing structure and often even parameter values. However, it is hard to manage these model derivatives: the storage overhead of storing all derived models quickly becomes onerous, prompting users to get rid of intermediate models that might be useful for further analysis. Additionally, undesired behaviors in models are hard to track down (e.g., is a bug inherited from an upstream model?). In this paper, we propose a model versioning and management system called MGit that makes it easier to store, test, update, and collaborate on model derivatives. MGit introduces a lineage graph that records provenance and versioning information between models, optimizations to efficiently store model parameters, as well as abstractions over this lineage graph that facilitate relevant testing, updating and collaboration functionality. MGit is able to reduce the lineage graph's storage footprint by up to 7x and automatically update downstream models in response to updates to upstream models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 74 references that are in the map. First posted on arXiv 14 Jul 2023.

Builds on

41 of 74 references.

References · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  8. 2016Densely Connected Convolutional Networkscited by 6,691
  9. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  10. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  11. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  12. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
29 more
  1. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  2. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  4. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  5. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  6. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  7. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,461
  8. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  9. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  10. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  11. 2019Towards Federated Learning at Scale: System Designcited by 826
  12. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
  13. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 610
  14. 2017Learning multiple visual domains with residual adapterscited by 553
  15. 2021Editing Factual Knowledge in Language Modelscited by 548
  16. 2021Fast Model Editing at Scalecited by 491
  17. 2013Do Deep Nets Really Need to be Deep?cited by 466
  18. 2020Parameter-Efficient Transfer Learning with Diff Pruningcited by 351
  19. 2018Model compression via distillation and quantizationcited by 287
  20. 2021Evaluating the Robustness of Neural Language Models to Input Perturbationscited by 87
  21. 2019Machine Learning at the Network Edge: A Surveycited by 83
  22. 2021Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefscited by 79
  23. 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 38
  24. 2022GEMEL: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edgecited by 32
  25. 2020Model Assertions for Monitoring and Improving ML Modelscited by 22
  26. 2023Git-Theta: A Git Extension for Collaborative Development of Machine Learning Modelscited by 15
  27. 2016ModelHub: Towards Unified Data and Lifecycle Management for Deep Learningcited by 13
  28. 2021ML-EXray: Visibility into ML Deployment on the Edgecited by 6
  29. 2022A Tale of Two Models: Constructing Evasive Attacks on Edge Modelscited by 6

Built on by

Not cited yet.