Lightweight Distillation of SAM 3 and DINOv3 for Edge-Deployable Individual-Level Livestock Monitoring and Longitudinal Visual Analytics
Not on the map. Why?
Abstract (arXiv)
Foundation-model pipelines for individual-level livestock monitoring -- combining open-vocabulary detection, promptable video segmentation, and self-supervised visual embeddings -- have raised the accuracy ceiling of precision livestock farming (PLF), but their GPU memory budgets exceed the envelope of commodity edge accelerators. To close this gap, the 446M-parameter Perception Encoder (PE-ViT-L+) backbone of SAM 3 is distilled into a 40.66M-parameter multi-scale student through three mechanisms: a Feature Pyramid Network student encoder built on TinyViT-21M-512, a four-term direction-then-scale distillation loss, and backbone-substitution inference with sliding-window session pruning that bounds streaming GPU memory growth. The DINOv3 family includes a pre-distilled ViT-S/16 variant (21.6M parameters) released alongside a 6716M-parameter ViT-7B teacher; the ViT-S (21M) variant is adopted as the per-individual embedder. On the Edinburgh Pig dataset, the compressed pipeline reaches 92.29% MOTA and 96.15% IDF1 against the SAM 3 teacher (1.68- and 0.84-percentage-point losses), achieves a 7.77-fold reduction in system-level parameters and a 3.01-fold reduction in peak VRAM (19.52GB -> 6.49GB), and reaches 97.34% top-1 accuracy with 91.67% macro-F1 on nine-class pig behaviour classification. The pipeline fits inside an NVIDIA Jetson Orin NX 16GB envelope with 4.9GB of headroom, supporting a proposed -- but not yet empirically validated -- on-device embedding-pool re-identification mechanism whose per-individual footprint of approximately 94MB per animal per year produces a longitudinal visual record amenable to retrospective association with disease, lameness, reproductive, and growth outcome labels.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 50 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
24 of 50 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2018Group Normalizationcited by 1,524
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2025DINOv3cited by 1,414
12 more
- 2017Mixed Precision Trainingcited by 1,156
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2023Scaling Open-Vocabulary Object Detectioncited by 343
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 264
- 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 234
- 2019Fixup Initialization: Residual Learning Without Normalizationcited by 198
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2025A Computer Vision Pipeline for Individual-Level Behavior Analysis: Benchmarking on the Edinburgh Pig Datasetcited by 4
- 2025EfficientSAM3: Progressive Hierarchical Distillation for Video Concept Segmentation from SAM1, 2, and 3cited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SAM3-Assisted Training of Lightweight YOLO Models for Precision Pig Farming
- 2026Cross-Architecture Knowledge Distillation from a Vision Foundation Model to a Lightweight Visual State Space Model for Tea Leaf Disease Classification
- 2026Energy-Efficient Plant Monitoring via Knowledge Distillation
- 2024AgriCLIP: Adapting CLIP for Agriculture and Livestock via Domain-Specialized Cross-Model Alignment
- 2025ATMS-KD: Adaptive Temperature and Mixed Sample Knowledge Distillation for a Lightweight Residual CNN in Agricultural Embedded Systems
- 2026SAM3 Self-Distillation for Fine-Grained GOOSE 2D Semantic Segmentation
- 2026Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap
- 2024Domain Adaptable Fine-Tune Distillation Framework For Advancing Farm Surveillance