Zero-Shot Retail Theft Detection via Orchestrated Vision Models: A Model-Agnostic, Cost-Effective Alternative to Trained Single-Model Systems
Not on the map. Why?
Abstract (arXiv)
Retail theft costs the global economy over 100 billion annually, yet existing AI-based detection systems require expensive custom model training on proprietary datasets and charge 200-500/month per store. We present Paza, a zero-shot retail theft detection framework that achieves practical concealment detection without training any model. Our approach orchestrates multiple existing models in a layered pipeline - cheap object detection and pose estimation running continuously, with an expensive vision-language model (VLM) invoked only when behavioral pre-filters trigger. A multi-signal suspicion pre-filter (requiring dwell time plus at least one behavioral signal) reduces VLM invocations by 240x compared to per-frame analysis, bounding calls to <=10/minute and enabling a single GPU to serve 10-20 stores. The architecture is model-agnostic: the VLM component accepts any OpenAI-compatible endpoint, enabling operators to swap between models such as Gemma 4, Qwen3.5-Omni, GPT-4o, or future releases without code changes - ensuring the system improves as the VLM landscape evolves. We evaluate the VLM component on the DCSASS synthesized shoplifting dataset (169 clips, controlled environment), achieving 89.5% precision and 92.8% specificity at 59.3% recall zero-shot - where the recall gap is attributable to sparse frame sampling in offline evaluation rather than VLM reasoning failures, as precision and specificity are the operationally critical metrics determining false alarm rates. We present a detailed cost model showing viability at 50-100/month per store (3-10x cheaper than commercial alternatives), and introduce a privacy-preserving design that obfuscates faces in the detection pipeline. The source code is available at https://github.com/xHaileab/Paza-AI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
9 of 28 references.
References · 9
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Zero-Shot Action Recognition in Surveillance Videos
- 2025When Does Supervised Training Pay Off? The Hidden Economics of Object Detection in the Era of Vision-Language Models
- 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Models
- 2025Roboflow100-VL: A Multi-Domain Object Detection Benchmark for Vision-Language Models
- 2026TinyVLM: Zero-Shot Object Detection on Microcontrollers via Vision-Language Distillation with Matryoshka Embeddings
- 2026What Matters for Grocery Product Retrieval with Open Source Vision Language Models
- 2023Garbage in, garbage out: Zero-shot detection of crime using Large Language Models
- 2026Unleashing the Potential of Vision-Language Models for Generalizable AI-Generated Image Detection