Training-Free Adaptive 360-degree Video Streaming via Semantic Potential Fields
Not on the map. Why?
Abstract (arXiv)
Adaptive 360deg video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless channels. While Deep Reinforcement Learning (DRL) methods achieve high Quality of Experience (QoE), their lack of interpretability and dependence on offline training limit deployment in safety-critical systems. We propose OrbitStream, a training-free framework that formulates viewport prediction as a Gravitational Viewport Prediction (GVP) problem, where semantic objects generate potential fields that attract operator gaze, and employs a Saturation-Based Proportional-Derivative (PD) Controller for buffer regulation. On object-rich teleoperation traces, OrbitStream achieves 94.7% zero-shot viewport prediction accuracy without user-specific profiling, approaching trajectory-extrapolation baselines (~98.5%). Across 3,600 Monte Carlo simulations, it ranks second among 12 algorithms (QoE 2.71 vs. BOLA-E's 2.80), outperforming FastMPC (1.84), with 1.01 ms decision latency and minimal rebuffering.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 39 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
6 of 39 references.
References · 6
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2016BOLA: Near-Optimal Bitrate Adaptation for Online Videoscited by 27
- 2019Pano: Optimizing 360deg Video Streaming with a Better Understanding of Quality Perceptioncited by 8
- 2016Viewport-Adaptive Navigable 360-Degree Video Deliverycited by 7
- 2017Viewport-aware adaptive 360deg video streaming using tiles for virtual realitycited by 2
- 2021VAD360: Viewport Aware Dynamic 360-Degree Video Frame Tilingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RynnWorld-Teleop: An Action-Conditioned World Model for Digital Teleoperation
- 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesis
- 2024MADRL-Based Rate Adaptation for 360deg Video Streaming with Multi-Viewpoint Prediction
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedback
- 2026Reflex: Real-Time VLA Control through Streaming Inference
- 2022Visual Backtracking Teleoperation: A Data Collection Protocol for Offline Image-Based Reinforcement Learning
- 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approach
- 2026Adaptor: Advancing Assistive Teleoperation with Few-Shot Learning and Cross-Operator Generalization