EV-JEPA: Elastic V-JEPA for Any Device and Cross-Device Inference
Not on the map. Why?
Abstract (arXiv)
Foundation models like V-JEPA are increasingly deployed across a heterogeneous edge-cloud continuum spanning smart glasses, phones, robots, and servers. Yet, they are typically trained as rigid, fixed-capacity networks bound to one device, supporting neither reconfigurable compute budgets nor collaborative execution. Existing approaches address only one axis at a time: slimmable and NAS-based methods provide width elasticity but assume single-device inference, whereas split-computing methods enable cross-device collaboration only for fixed partitions and static capacities. We introduce Elastic V-JEPA (EV-JEPA), a single model trained once and deployable everywhere along the continuum. Its width is reconfigurable, and it is natively partitionable across heterogeneous devices. At its core is Transition-Aware Triplet Training (T3). At each step we pick a narrow and a wide width, and train three paths: each width alone, plus a hybrid path that runs the early layers narrow and the rest wide. The hybrid switch point is where one device hands off to another, so the same weights learn both single-device and cross-device execution. Across various benchmarks, EV-JEPA falls within 1 accuracy point of independently trained baselines while improving over previous elastic training approaches by up to 11 accuracy points. Narrow-to-wide cross-device hybrid execution recovers to within 1.1 points of the highest-capacity standalone model and supports many-to-one, any-to-any, and variable-split configurations. Finally, we show that the elastic principle extends beyond the backbone to an elastic token compression mechanism that exposes controllable trade-offs among on-device computation, latency, and accuracy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 44 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
40 of 44 references.
References · 40
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 787
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2020Rescaling Egocentric Visioncited by 540
28 more
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 528
- 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 414
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2018Slimmable Neural Networkscited by 305
- 2022Matryoshka Representation Learningcited by 282
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2020DynaBERT: Dynamic BERT with Adaptive Width and Depthcited by 251
- 2019Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computingcited by 228
- 2019Universally Slimmable Networks and Improved Training Techniquescited by 221
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 208
- 2020BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Modelscited by 188
- 2021AutoFormer: Searching Transformers for Visual Recognitioncited by 188
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
- 2020Rolling-Unrolling LSTMs for Action Anticipation from First-Person Videocited by 120
- 2020SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloudcited by 112
- 2024VideoPrism: A Foundational Visual Encoder for Video Understandingcited by 105
- 2023MatFormer: Nested Transformer for Elastic Inferencecited by 85
- 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 68
- 2020AttentiveNAS: Improving Neural Architecture Search via Attentive Samplingcited by 66
- 2021Searching the Search Space of Vision Transformercited by 41
- 2022Interaction Region Visual Transformer for Egocentric Action Anticipationcited by 37
- 2024Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Modelscited by 33
- 2022SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systemscited by 14
- 2024HydraViT: Stacking Heads for a Scalable ViTcited by 11
- 2024Semantically Guided Representation Learning For Action Anticipationcited by 10
- 2024Slicing Vision Transformer for Flexible Inferencecited by 6
- 2023Three Guidelines You Should Know for Universally Slimmable Self-Supervised Learningcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
- 2024Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inference
- 2025Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
- 2026Branch-JEPA: Finite-Support Predictive Distributions for JEPA World Models
- 2025Hetero-SplitEE: Split Learning of Neural Networks with Early Exits for Heterogeneous IoT Devices
- 2026The SIGReg Objective as Variational Free Energy: A Theoretical Active-Inference Account of JEPA World Models
- 2026Stepped MoE: Segment-Level Routing with Configurable Inference Complexity
- 2025FlexQuant: Elastic Quantization Framework for Locally Hosted LLM on Edge Devices