FedVAR: Prototype-Aligned Federated Framework for Video Anomaly Recognition
Not on the map. Why?
Abstract (arXiv)
In the era of Industrial Internet of Things (IIoT) and Cyber-Physical Systems (CPS), Federated Learning (FL) offers a promising decentralized intelligence paradigm for Video Anomaly Recognition (VAR). This task is vital for maintaining high-fidelity Digital Twins and ensuring safety in mission-critical environments. However, the inherent data heterogeneity across distributed edge clients leads to a fundamental challenge known as semantic misalignment, where clients learn divergent feature representations of "normal" and "abnormal" events. The problem becomes particularly pronounced in VAR, where the presence of diverse and fine-grained anomaly categories leads each client to develop distinct semantic interpretations of abnormality. Existing federated methods primarily focus on binary anomaly detection and fail to address this misalignment, preventing effective fine-grained recognition. In this paper, we introduce FedVAR, a weakly-supervised FL framework explicitly designed for VAR. Leveraging the rich representations of Vision-Language Models (VLMs), FedVAR employs a prototype-based alignment mechanism that creates a shared semantic anchor for all clients to re-center and align their visual and textual feature spaces. This process enforces a consistent representation of "normality" across the decentralized network, directly mitigating semantic misalignment and enabling robust prompt-learning of anomaly direction vectors with minimal communication overhead. We conduct extensive experiments on challenging benchmarks under various non-IID data partitioning schemes, unseen domains, and novel anomaly classes. The results demonstrate that FedVAR consistently outperforms state-of-the-art federated baselines, establishing a robust framework for distributed intelligence in video-based CPS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 55 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
28 of 55 references.
References · 28
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
- 2020Adaptive Federated Optimizationcited by 1,046
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 711
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 571
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
- 2018Adaptive Federated Learning in Resource Constrained Edge Computing Systemscited by 409
16 more
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2019Axial Attention in Multidimensional Transformerscited by 358
- 2021Prompting Visual-Language Models for Efficient Video Understandingcited by 310
- 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
- 2021Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learningcited by 193
- 2019Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detectioncited by 171
- 2022PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Modelcited by 134
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 123
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2023Efficient Model Personalization in Federated Learning via Client-Specific Prompt Generationcited by 54
- 2023Prompt-based Distribution Alignment for Unsupervised Domain Adaptationcited by 44
- 2023Delving into CLIP latent space for Video Anomaly Recognitioncited by 27
- 2024Video Anomaly Detection in 10 Years: A Survey and Outlookcited by 18
- 2024Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baselinecited by 17
- 2024Byzantine-Robust Federated Learning: Impact of Client Subsampling and Local Updatescited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Federated Binary Gating with Server-Side Vision-Language Inference for Surveillance Anomaly Classification
- 2026Parser-Free VLM Verification for Federated Weakly Supervised Video Anomaly Detection
- 2026STAIN-FL: Stealthy Targeted Attack Injection with Contextual Triggers in Federated Learning
- 2026Advancing Adaptive Multi-Stage Video Anomaly Reasoning: A Benchmark Dataset and Method
- 2022Federated Zero-Shot Learning for Visual Recognition
- 2026Digital Twin-Driven Communication-Efficient Federated Anomaly Detection for Industrial IoT
- 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understanding
- 2025Text-guided Fine-Grained Video Anomaly Understanding