mlsanityData to 14 Oct 2026

MCITlib: Multimodal Continual Instruction Tuning Library and Benchmark

arXiv 2508.07307 ↗First posted 10 Aug 2025cs.CV cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Continual learning enables AI systems to acquire new knowledge while retaining previously learned information. While traditional unimodal methods have made progress, the rise of Multimodal Large Language Models (MLLMs) brings new challenges in Multimodal Continual Learning (MCL), where models are expected to address both catastrophic forgetting and cross-modal coordination. To advance research in this area, we present MCITlib, a comprehensive library for Multimodal Continual Instruction Tuning. MCITlib currently implements 8 representative algorithms and conducts evaluations on 3 benchmarks under 2 backbone models. The library will be continuously updated to support future developments in MCL. The codebase is released at https://github.com/Ghy0501/MCITlib.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 51 of its 60 references that are in the map. First posted on arXiv 10 Aug 2025.

Builds on

51 of 60 references.

References · 51

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  7. 2016Learning without Forgettingcited by 2,496
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  9. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  10. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  11. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  12. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
38 more
  1. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  2. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
  3. 2023A Survey on Multimodal Large Language Modelscited by 909
  4. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
  5. 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 858
  6. 2016A Diagram Is Worth A Dozen Imagescited by 804
  7. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  8. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
  9. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
  10. 2023Orthogonal Subspace Learning for Language Model Continual Learningcited by 312
  11. 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
  12. 2023Class-Incremental Learning: A Surveycited by 209
  13. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
  14. 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 139
  15. 2022CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical Reasoningcited by 120
  16. 2022MapQA: A Dataset for Question Answering on Choropleth Mapscited by 85
  17. 2021PyCIL: A Python Toolbox for Class-Incremental Learningcited by 83
  18. 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
  19. 2023PILOT: A Pre-Trained Model-Based Continual Learning Toolboxcited by 64
  20. 2024CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language Modelcited by 61
  21. 2024Recent Advances of Multimodal Continual Learning: A Comprehensive Surveycited by 39
  22. 2025CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answeringcited by 37
  23. 2022Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Taskcited by 35
  24. 2023Avalanche: A PyTorch Library for Deep Continual Learningcited by 33
  25. 2025SEFE: Superficial and Essential Forgetting Eliminator for Multimodal Continual Instruction Tuningcited by 33
  26. 2025HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Modelcited by 31
  27. 2024ModalPrompt: Towards Efficient Multimodal Continual Instruction Tuning with Dual-Modality Guided Promptcited by 30
  28. 2023Learnability and Algorithm for Continual Learningcited by 28
  29. 2023FinVis-GPT: A Multimodal Large Language Model for Financial Chart Analysiscited by 28
  30. 2022Continual Object Detection: A review of definitions, strategies, and challengescited by 25
  31. 2025MLLM-CL: Continual Learning for Multimodal Large Language Modelscited by 23
  32. 2025SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problemscited by 22
  33. 2023A Survey on Continual Semantic Segmentation: Theory, Challenge, Method and Applicationcited by 21
  34. 2025LLaVA-c: Continual Improved Visual Instruction Tuningcited by 14
  35. 2023Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Modelscited by 13
  36. 2025Federated Continual Instruction Tuningcited by 12
  37. 2025Continual Learning for Generative AI: From LLMs to MLLMs and Beyondcited by 12
  38. 2025When Continue Learning Meets Multimodal Large Language Model: A Surveycited by 9

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 11.

13 papers.

Sort:

By area:

  1. 2025Multimodal Continual Instruction Tuning with Dynamic Gradient Guidancecited by 7
  2. 2026Spectral Imbalance Causes Forgetting in Low-Rank Continual Adaptationcited by 5
  3. 2026Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuningcited by 3
  4. 2026CL-VISTA: Benchmarking Continual Learning in Video Large Language Modelscited by 2
  5. 2026Hidden Forgetting in Continual Multimodal Learning: When Accuracy Survives but Grounding Failscited by 1
  6. 2025KORE: Enhancing Knowledge Injection for Large Multimodal Models via Knowledge-Oriented Controlscited by 0
  7. 2026MAny: Merge Anything for Multimodal Continual Instruction Tuningcited by 0
  8. 2026CRAM: Centroid-Routing and Adaptive MoE for Multimodal Continual Instruction Tuningcited by 0
  9. 2026KeepLoRA++: Continual Learning with Layer-Scaled Residual Gradient Adaptationcited by 0
  10. 2026Is Our Benchmark Enough? An Analysis of Continual Learning for MLLMscited by 0
  11. 2026Progressive Multimodal Alignment for Continual Instruction Tuningcited by 0
  12. 2026PaLoRA: Paced Low-Rank Adaptation for Continual Learningcited by 0
1 more
  1. 2026Monarch-MoE: Structured Experts for Multimodal Continual Instruction Tuningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024SwitchCIT: Switching for Continual Instruction Tuning
  2. 2025Enhancing Multimodal Continual Instruction Tuning with BranchLoRA
  3. 2024Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer
  4. 2025MLLM-CTBench: A Benchmark for Continual Instruction Tuning with Reasoning Process Diagnosis
  5. 2023Continual Instruction Tuning for Large Multimodal Models
  6. 2026ReCAP: Retrieval-Guided Capability Reuse for Multimodal Continual Instruction Tuning
  7. 2025Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs
  8. 2026SiGMA: Sign-Guided Merging and Adaptation for Multimodal Continual Instruction Tuning