mlsanityData to 14 Oct 2026

A Computer Vision Pipeline for Individual-Level Behavior Analysis: Benchmarking on the Edinburgh Pig Dataset

arXiv 2509.12047 ↗First posted 15 Sep 2025cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Animal behavior analysis plays a crucial role in understanding animal welfare, health status, and productivity in agricultural settings. However, traditional manual observation methods are time-consuming, subjective, and limited in scalability. We present a modular pipeline that leverages open-sourced state-of-the-art computer vision techniques to automate animal behavior analysis in a group housing environment. Our approach combines state-of-the-art models for zero-shot object detection, motion-aware segmentation and tracking, and advanced feature extraction using vision transformers for robust behavior recognition. The pipeline addresses challenges including animal occlusions and group housing scenarios, as demonstrated in indoor pig monitoring. We validated our system on the Edinburgh Pig Behavior Video Dataset for multiple behavioral tasks. Our temporal model achieved 94.2% overall accuracy, representing a 21.2 percentage point improvement over existing methods. The pipeline demonstrated robust tracking capabilities with a 93.3% identity preservation (IDF1) score and an 89.3% average precision (AP) for object detection. The modular design suggests potential for adaptation to other contexts, though further validation across species would be required. The open-source implementation provides a scalable solution for behavior monitoring, contributing to precision pig farming and welfare assessment through automated, objective, and continuous analysis.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 59 references that are in the map. First posted on arXiv 15 Sep 2025.

Builds on

16 of 59 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
  6. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
  7. 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 429
  8. 2023Scaling Open-Vocabulary Object Detectioncited by 343
  9. 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
  10. 2018Markerless tracking of user-defined features with deep learningcited by 206
  11. 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 132
  12. 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 94
4 more
  1. 2021Perspectives on individual animal identification from biology and computer visioncited by 31
  2. 2022Multimodal sensor data fusion for in-situ classification of animal behavior using accelerometry and GNSS datacited by 10
  3. 2023Application of deep learning for livestock behaviour recognition: A systematic literature reviewcited by 5
  4. 2024The Survey on Multi-Source Data Fusion in Cyber-Physical-Social Systems:Foundational Infrastructure for Industrial Metaverses and Industries 5.0cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.