Motion-Compensated Latent Semantic Canvases for Visual Situational Awareness on Edge
Not on the map. Why?
Abstract (arXiv)
We propose Motion-Compensated Latent Semantic Canvases (MCLSC) for visual situational awareness on resource-constrained edge devices. The core idea is to maintain persistent semantic metadata in two latent canvases - a slowly accumulating static layer and a rapidly updating dynamic layer - defined in a baseline coordinate frame stabilized from the video stream. Expensive panoptic segmentation (Mask2Former) runs asynchronously and is motion-gated: inference is triggered only when motion indicates new information, while stabilization/motion compensation preserves a consistent coordinate system for latent semantic memory. On prerecorded 480p clips, our prototype reduces segmentation calls by >30x and lowers mean end-to-end processing time by >20x compared to naive per-frame segmentation, while maintaining coherent static/dynamic semantic overlays.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 13 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
8 of 13 references.
References · 8
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2018Panoptic Segmentationcited by 802
- 2019Panoptic-DeepLabcited by 363
- 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 332
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 135
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 134
- 2021FrameExit: Conditional Early Exiting for Efficient Video Recognitioncited by 59
Built on by
Not cited yet.