RetailSMV: Exocentric vs. Egocentric Adaptation of Foundation Video World Models in Retail
On the map: World models → Video-generation world models and simulators
also in 1 more
Abstract (arXiv)
Foundation video diffusion models are increasingly viewed as world simulators for embodied agents, yet their pretraining on internet-scale generic video leaves them poorly aligned with real-world deployment domains. We study parameter-efficient adaptation of a pretrained foundation video world model to retail scenes: when synchronized egocentric and exocentric video of the same activity are available, which viewpoint of training data produces the strongest adapted model? We introduce RetailSMV (Retail Synchronized Multi-View), a corpus of 32,105 captioned retail clips from five supermarkets with synchronized ego/exo capture from the store-staff perspective (stocking, arranging, weighing, managing supply carts, scanning at checkout), rather than the customer-centric framing of prior retail video corpora, and train three matched Low-Rank Adaptation (LoRA) configurations of Cosmos3-Nano (egocentric-only, exocentric-only, combined) under identical hyperparameters. On a 200-clip held-out test set evaluated with seven complementary metrics under a strict paired statistical protocol, exocentric-only adaptation matches or exceeds combined adaptation on six of seven point estimates and is significantly better on LPIPS, PSNR, and DreamSim, despite training on only 15,985 exocentric clips (versus 32,105 for combined). A symmetric paired comparison further shows that adding exocentric data to egocentric-only training helps while adding egocentric data to exocentric-only training hurts. The absolute adaptation gap is largest at the shortest rollout time, identifying the near-horizon prediction window as the regime in which adaptation is most beneficial.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 22 of its 73 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
22 of 73 references.
Closest ancestors · 2
Same direction, newest first
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
Other references · 20
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
8 more
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 120
- 2025Sari Sandbox: A Virtual Retail Store Environment for Embodied AI Agentscited by 4
- 2025Israel-Hamas war through Telegram, Reddit and Twittercited by 3
- 2026PRISM: A Multi-View Multi-Capability Retail Video Dataset for Embodied Vision-Language Modelscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SABER: A Scalable Action-Based Embodied Dataset for Real-World VLA Adaptation
- 2026See Better, Foresee Better, Act Wiser: Physically Grounded Proactive Modeling and Decision Making
- 2026EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge
- 2025EgoExoBench: A Benchmark for First- and Third-person View Video Understanding in MLLMs
- 2026EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions
- 2026EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Next
- 2024VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI
- 2025EgoMe: A New Dataset and Challenge for Following Me via Egocentric View in Real World