mlsanityData to 7 Oct 2026

MTT-Bench: Predicting Social Dominance in Mice via Multimodal Large Language Models

arXiv 2604.22492 ↗First posted 24 Apr 2026eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding social dominance in animal behavior is critical for neuroscience and behavioral studies. In this work, we explore the capability of Multimodal Large Language Models(MLLMs) to analyze raw behavioral video of mice and predict their dominance hierarchy. We introduce MTT-Bench, a novel benchmark comprising annotated videos of pairwise mouse interactions for Mouse Tube Test analysis. Building on existing MLLM architectures, we fine-tune these models to perform zero-shot inference on unseen behavioral sequences, predicting social dominance without explicit labels during testing. Our framework demonstrates promising results, showing high agreement with tube test rankings. This work opens a new direction for applying foundation models to ethology and social behavior analysis, without the need to design domain-specific models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 24 Apr 2026.

Builds on

12 of 27 references.

References · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  3. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  5. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  6. 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
  7. 2020Time Series Data Augmentation for Deep Learning: A Surveycited by 225
  8. 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 134
  9. 2022SuperAnimal pretrained pose estimation models for behavioral analysiscited by 38
  10. 2022A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainabilitycited by 30
  11. 2022Cross-Skeleton Interaction Graph Aggregation Network for Representation Learning of Mouse Social Behaviourcited by 4
  12. 2025MouseGPT: A Large-scale Vision-Language Model for Mouse Behavior Analysiscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rodent-Bench
  2. 2023AmadeusGPT: a natural language interface for interactive animal behavioral analysis
  3. 2025Preliminary Use of Vision Language Model Driven Extraction of Mouse Behavior Towards Understanding Fear Expression
  4. 2026CheeseBench: Evaluating Large Language Models on Rodent Behavioral Neuroscience Paradigms
  5. 2025SIV-Bench: A Video Benchmark for Social Interaction Understanding and Reasoning
  6. 2024GPT-4o: Visual perception performance of multimodal large language models in piglet activity understanding
  7. 2026K9-Bench: Evaluating Multimodal LLMs on Canine-Centric Videos
  8. 2025NLP4Neuro: Sequence-to-sequence learning for neural population decoding