Ekya: Continuous Learning of Video Analytics Models on Edge Compute Servers
Not on the map. Why?
Abstract (arXiv)
Video analytics applications use edge compute servers for the analytics of the videos (for bandwidth and privacy). Compressed models that are deployed on the edge servers for inference suffer from data drift, where the live video data diverges from the training data. Continuous learning handles data drift by periodically retraining the models on new data. Our work addresses the challenge of jointly supporting inference and retraining tasks on edge servers, which requires navigating the fundamental tradeoff between the retrained model's accuracy and the inference accuracy. Our solution Ekya balances this tradeoff across multiple models and uses a micro-profiler to identify the models that will benefit the most by retraining. Ekya's accuracy gain compared to a baseline scheduler is 29% higher, and the baseline requires 4x more GPU resources to achieve the same accuracy as Ekya.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 8; 2023: 13; 2024: 16; 2025: 16; 2026: 3.
58 papers.
Sort:
By area:
- 2024Cost-Effective Online Multi-LLM Selection with Versatile Reward Modelscited by 36
- 2022Federated Learning under Distributed Concept Driftcited by 35
- 2022GEMEL: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edgecited by 32
- 2024Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inferencecited by 25
- 2023EdgeFM: Leveraging Foundation Model for Open-set Learning on the Edgecited by 21
- 2022On-device Training: A First Overview on Existing Systemscited by 18
- 2023Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Servingcited by 15
- 2024Asteroid: Resource-Efficient Hybrid Pipeline Parallelism for Collaborative DNN Training on Heterogeneous Edge Devicescited by 13
- 2022Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edgescited by 12
- 2023Shoggoth: Towards Efficient Edge-Cloud Collaborative Real-Time Video Inference via Adaptive Online Learningcited by 11
- 2021Boggart: Towards General-Purpose Acceleration of Retrospective Video Analyticscited by 10
- 2023Cost-effective On-device Continual Learning over Memory Hierarchy with Mirocited by 10
38 more
- 2024Continual Learning for Smart City: A Surveycited by 9
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A surveycited by 8
- 2024DaCapo: Accelerating Continuous Learning in Autonomous Systems for Video Analyticscited by 8
- 2022Turbo: Opportunistic Enhancement for Edge Video Analyticscited by 7
- 2022Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniquescited by 7
- 2023MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurationscited by 7
- 2023Monitoring and Adapting ML Models on Mobile Devicescited by 6
- 2024Delta: A Cloud-assisted Data Enrichment Framework for On-Device Continual Learningcited by 6
- 2021Chanakya: Learning Runtime Decisions for Adaptive Real-Time Perceptioncited by 5
- 2023Modyn: Data-Centric Machine Learning Pipeline Orchestrationcited by 5
- 2025Compass: SLO-aware Query Planner for Compound AI Serving at Scalecited by 5
- 2025AVA: Towards Agentic Video Analytics with Vision Language Modelscited by 5
- 2023View while Moving: Efficient Video Recognition in Long-untrimmed Videoscited by 4
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analyticscited by 4
- 2023Moby: Empowering 2D Models for Efficient Point Cloud Analytics on the Edgecited by 3
- 2024A Scene-aware Models Adaptation Scheme for Cross-scene Online Inference on Mobile Devicescited by 3
- 2024Federated Learning Clients Clustering with Adaptation to Data Driftscited by 3
- 2023OneAdapt: Fast Configuration Adaptation for Video Analytics Applications via Backpropagationcited by 2
- 2024Empower Vision Applications with LoRA LMMcited by 2
- 2025A Survey on Video Analytics in Cloud-Edge-Terminal Collaborative Systemscited by 2
- 2025E4: Energy-Efficient DNN Inference for Edge Video Analytics Via Early-Exit and DVFScited by 2
- 2025LeMix: Unified Scheduling for LLM Training and Inference on Multi-GPU Systemscited by 2
- 2023EdgeMA: Model Adaptation System for Real-Time Video Analytics on Edge Devicescited by 1
- 2023ECLM: Efficient Edge-Cloud Collaborative Learning with Continuous Environment Adaptationcited by 1
- 2024Enabling Cross-Camera Collaboration for Video Analytics on Distributed Smart Camerascited by 1
- 2024EdgeOL: Efficient in-situ Online Learning on Edge Devicescited by 1
- 2024On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functionscited by 1
- 2024EdgeSync: Faster Edge-model Updating via Adaptive Continuous Learning for Video Data Driftcited by 1
- 2025Prism: Mining Task-aware Domains in Non-i.i.d. IMU Data for Flexible User Perceptioncited by 1
- 2025GPUs, CPUs, and... NICs: Rethinking the Network's Role in Serving Complex AI Pipelinescited by 1
- 2025High-Quality Pseudo-Label Generation Based on Visual Prompt Assisted Cloud Model Updatecited by 1
- 2025MACE: A Hybrid LLM Serving System with Colocated SLO-aware Continuous Retraining Alignmentcited by 1
- 2025Cerberus: Real-Time Video Anomaly Detection via Cascaded Vision-Language Modelscited by 1
- 2022Variant Parallelism: Lightweight Deep Convolutional Models for Distributed Inference on IoT Devicescited by 0
- 2022APT: Adaptive Perceptual quality based camera Tuning using reinforcement learningcited by 0
- 2024Compass: A Decentralized Scheduler for Latency-Sensitive ML Workflowscited by 0
- 2024Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inferencecited by 0
- 2025Alchemist: Towards the Design of Efficient Online Continual Learning Systemcited by 0
50 most cited of 58 All 58 (JSON)
- 2026AdaptAV: Continuous Adaption of Vision Models for Autonomous Vehicles Using Cloud-based Oracle24 Aug 2026
- 2026Online LLM Selection via Constrained Bandits with Time-Varying Demand16 Jun 2026
- 2026Taming Asynchronous CPU-GPU Coupling for Frequency-aware Latency Estimation on Mobile Edge11 Apr 2026
- 2025RedunCut: Measurement-Driven Sampling and Accuracy Performance Modeling for Low-Cost Live Video Analytics30 Dec 2025
- 2025ECCO: Leveraging Cross-Camera Correlations for Efficient Live Video Continuous Learning12 Dec 2025
- 2025Precision-Scalable Microscaling Datapaths with Optimized Reduction Tree for Efficient NPU Integration9 Nov 2025
- 2025EdgeSync: Accelerating Edge-Model Updates for Data Drift through Adaptive Continuous Learning18 Oct 2025
- 2025Cerberus: Real-Time Video Anomaly Detection via Cascaded Vision-Language Models18 Oct 2025
- 2025MACE: A Hybrid LLM Serving System with Colocated SLO-aware Continuous Retraining Alignment28 Sep 2025
- 2025LeMix: Unified Scheduling for LLM Training and Inference on Multi-GPU Systems28 Jul 2025
- 2025AVA: Towards Agentic Video Analytics with Vision Language Models1 May 2025
- 2025Legilimens: Performant Video Analytics on the System-on-Chip Edge29 Apr 2025
38 more
- 2025Compass: SLO-aware Query Planner for Compound AI Serving at Scale23 Apr 2025
- 2025High-Quality Pseudo-Label Generation Based on Visual Prompt Assisted Cloud Model Update1 Apr 2025
- 2025E4: Energy-Efficient DNN Inference for Edge Video Analytics Via Early-Exit and DVFS6 Mar 2025
- 2025Alchemist: Towards the Design of Efficient Online Continual Learning System3 Mar 2025
- 2025A Survey on Video Analytics in Cloud-Edge-Terminal Collaborative Systems10 Feb 2025
- 2025GPUs, CPUs, and... NICs: Rethinking the Network's Role in Serving Complex AI Pipelines22 Jan 2025
- 2025Prism: Mining Task-aware Domains in Non-i.i.d. IMU Data for Flexible User Perception3 Jan 2025
- 2024Federated Learning Clients Clustering with Adaptation to Data Drifts3 Nov 2024
- 2024Empower Vision Applications with LoRA LMM1 Nov 2024
- 2024Delta: A Cloud-assisted Data Enrichment Framework for On-Device Continual Learning24 Oct 2024
- 2024Asteroid: Resource-Efficient Hybrid Pipeline Parallelism for Collaborative DNN Training on Heterogeneous Edge Devices15 Aug 2024
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analytics29 Jul 2024
- 2024EdgeSync: Faster Edge-model Updating via Adaptive Continuous Learning for Video Data Drift5 Jun 2024
- 2024Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inference27 May 2024
- 2024Cost-Effective Online Multi-LLM Selection with Versatile Reward Models26 May 2024
- 2024Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference25 May 2024
- 2024A Scene-aware Models Adaptation Scheme for Cross-scene Online Inference on Mobile Devices9 May 2024
- 2024Continual Learning for Smart City: A Survey1 Apr 2024
- 2024DaCapo: Accelerating Continuous Learning in Autonomous Systems for Video Analytics21 Mar 2024
- 2024Compass: A Decentralized Scheduler for Latency-Sensitive ML Workflows27 Feb 2024
- 2024On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functions26 Feb 2024
- 2024EdgeOL: Efficient in-situ Online Learning on Edge Devices30 Jan 2024
- 2024Enabling Cross-Camera Collaboration for Video Analytics on Distributed Smart Cameras25 Jan 2024
- 2023Modyn: Data-Centric Machine Learning Pipeline Orchestration11 Dec 2023
- 2023Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving8 Dec 2023
- 2023ECLM: Efficient Edge-Cloud Collaborative Learning with Continuous Environment Adaptation18 Nov 2023
- 2023EdgeFM: Leveraging Foundation Model for Open-set Learning on the Edge18 Nov 2023
- 2023OneAdapt: Fast Configuration Adaptation for Video Analytics Applications via Backpropagation3 Oct 2023
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A survey27 Sep 2023
- 2023EdgeMA: Model Adaptation System for Real-Time Video Analytics on Edge Devices17 Aug 2023
- 2023Cost-effective On-device Continual Learning over Memory Hierarchy with Miro11 Aug 2023
- 2023View while Moving: Efficient Video Recognition in Long-untrimmed Videos9 Aug 2023
- 2023Shoggoth: Towards Efficient Edge-Cloud Collaborative Real-Time Video Inference via Adaptive Online Learning27 Jun 2023
- 2023Monitoring and Adapting ML Models on Mobile Devices12 May 2023
- 2023MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations4 Apr 2023
- 2023Moby: Empowering 2D Models for Efficient Point Cloud Analytics on the Edge18 Feb 2023
- 2022On-device Training: A First Overview on Existing Systems1 Dec 2022
- 2022Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniques28 Nov 2022
50 newest of 58 All 58 (JSON)
- 2022Federated Learning under Distributed Concept Driftcited by 35
- 2022GEMEL: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edgecited by 32
- 2024Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inferencecited by 25
- 2023EdgeFM: Leveraging Foundation Model for Open-set Learning on the Edgecited by 21
- 2022On-device Training: A First Overview on Existing Systemscited by 18
- 2024Asteroid: Resource-Efficient Hybrid Pipeline Parallelism for Collaborative DNN Training on Heterogeneous Edge Devicescited by 13
- 2022Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edgescited by 12
- 2023Shoggoth: Towards Efficient Edge-Cloud Collaborative Real-Time Video Inference via Adaptive Online Learningcited by 11
- 2021Boggart: Towards General-Purpose Acceleration of Retrospective Video Analyticscited by 10
- 2023Cost-effective On-device Continual Learning over Memory Hierarchy with Mirocited by 10
- 2024Continual Learning for Smart City: A Surveycited by 9
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A surveycited by 8
12 most cited of 51 All 51 (JSON)
- 2026AdaptAV: Continuous Adaption of Vision Models for Autonomous Vehicles Using Cloud-based Oracle24 Aug 2026
- 2026Online LLM Selection via Constrained Bandits with Time-Varying Demand16 Jun 2026
- 2026Taming Asynchronous CPU-GPU Coupling for Frequency-aware Latency Estimation on Mobile Edge11 Apr 2026
- 2025RedunCut: Measurement-Driven Sampling and Accuracy Performance Modeling for Low-Cost Live Video Analytics30 Dec 2025
- 2025ECCO: Leveraging Cross-Camera Correlations for Efficient Live Video Continuous Learning12 Dec 2025
- 2025Precision-Scalable Microscaling Datapaths with Optimized Reduction Tree for Efficient NPU Integration9 Nov 2025
- 2025EdgeSync: Accelerating Edge-Model Updates for Data Drift through Adaptive Continuous Learning18 Oct 2025
- 2025LeMix: Unified Scheduling for LLM Training and Inference on Multi-GPU Systems28 Jul 2025
- 2025Legilimens: Performant Video Analytics on the System-on-Chip Edge29 Apr 2025
- 2025Compass: SLO-aware Query Planner for Compound AI Serving at Scale23 Apr 2025
- 2025High-Quality Pseudo-Label Generation Based on Visual Prompt Assisted Cloud Model Update1 Apr 2025
- 2025Alchemist: Towards the Design of Efficient Online Continual Learning System3 Mar 2025
12 newest of 51 All 51 (JSON)