A Computer Vision Pipeline for Individual-Level Behavior Analysis: Benchmarking on the Edinburgh Pig Dataset
Not on the map. Why?
Abstract (arXiv)
Animal behavior analysis plays a crucial role in understanding animal welfare, health status, and productivity in agricultural settings. However, traditional manual observation methods are time-consuming, subjective, and limited in scalability. We present a modular pipeline that leverages open-sourced state-of-the-art computer vision techniques to automate animal behavior analysis in a group housing environment. Our approach combines state-of-the-art models for zero-shot object detection, motion-aware segmentation and tracking, and advanced feature extraction using vision transformers for robust behavior recognition. The pipeline addresses challenges including animal occlusions and group housing scenarios, as demonstrated in indoor pig monitoring. We validated our system on the Edinburgh Pig Behavior Video Dataset for multiple behavioral tasks. Our temporal model achieved 94.2% overall accuracy, representing a 21.2 percentage point improvement over existing methods. The pipeline demonstrated robust tracking capabilities with a 93.3% identity preservation (IDF1) score and an 89.3% average precision (AP) for object detection. The modular design suggests potential for adaptation to other contexts, though further validation across species would be required. The open-source implementation provides a scalable solution for behavior monitoring, contributing to precision pig farming and welfare assessment through automated, objective, and continuous analysis.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 59 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
16 of 59 references.
References · 16
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 429
- 2023Scaling Open-Vocabulary Object Detectioncited by 343
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
- 2018Markerless tracking of user-defined features with deep learningcited by 206
- 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 132
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 94
4 more
- 2021Perspectives on individual animal identification from biology and computer visioncited by 31
- 2022Multimodal sensor data fusion for in-situ classification of animal behavior using accelerometry and GNSS datacited by 10
- 2023Application of deep learning for livestock behaviour recognition: A systematic literature reviewcited by 5
- 2024The Survey on Multi-Source Data Fusion in Cyber-Physical-Social Systems:Foundational Infrastructure for Industrial Metaverses and Industries 5.0cited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Evaluating Small Language Models for Agentic On-Farm Decision Support Systemscited by 0
- 2026Exploring parameter-efficient fine-tuning (PEFT) of billion-parameter vision models with QLoRA and DoRA: insights into generalization for limited-data image classification under a 98:1 test-to-train regimecited by 0
- 2026Automated Segmentation and Tracking of Group Housed Pigs Using Foundation Modelscited by 0
- 2026Lightweight Distillation of SAM 3 and DINOv3 for Edge-Deployable Individual-Level Livestock Monitoring and Longitudinal Visual Analyticscited by 0
- 2026Lightweight Distillation of SAM 3 and DINOv3 for Edge-Deployable Individual-Level Livestock Monitoring and Longitudinal Visual Analytics29 Apr 2026
- 2026Automated Segmentation and Tracking of Group Housed Pigs Using Foundation Models3 Apr 2026
- 2026Exploring parameter-efficient fine-tuning (PEFT) of billion-parameter vision models with QLoRA and DoRA: insights into generalization for limited-data image classification under a 98:1 test-to-train regime18 Mar 2026
- 2025Evaluating Small Language Models for Agentic On-Farm Decision Support Systems16 Dec 2025