WorldComp2D: Spatio-semantic Representations of Object Identity and Location from Local Views
Not on the map. Why?
Abstract (arXiv)
Learning latent representations that capture both semantic and spatial information is central to efficient spatio-semantic reasoning. However, many existing approaches rely on implicit latent structures combined with dense feature maps or task-specific heads, limiting computational efficiency and flexibility. We propose WorldComp2D, a novel lightweight representation learning framework that explicitly structures latent space geometry according to object identity and spatial proximity using multiscale local receptive fields. This framework consists of (i) a proximity-dependent encoder that maps a given observation into a spatio-semantic latent space and (ii) a localizer that infers the coordinates of objects in the input from the resulting spatio-semantic representation. Using facial landmark localization as a proof-of-concept, we show that, compared to SoTA lightweight models, WorldComp2D reduces the numbers of parameters and FLOPs by up to 4.0X and 2.2X, respectively, while maintaining real-time performance on CPU. These results demonstrate that explicitly structured latent spaces provide an efficient and general foundation for spatio-semantic reasoning. This framework is open-sourced at https://github.com/JinSeongmin/WorldComp2D.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
23 of 31 references.
References · 23
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020Supervised Contrastive Learningcited by 2,829
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2018World Modelscited by 1,513
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019Contrastive Multiview Codingcited by 1,301
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2018Look at Boundary: A Boundary-Aware Face Alignment Algorithmcited by 138
11 more
- 2019Adaptive Wing Loss for Robust Face Alignment via Heatmap Regressioncited by 128
- 2020Pixel-in-Pixel Net: Towards Efficient Facial Landmark Detection in the Wildcited by 74
- 2020Agent Modelling under Partial Observability for Deep Reinforcement Learningcited by 57
- 2022Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learningcited by 47
- 2023STAR Loss: Reducing Semantic Ambiguity in Facial Landmark Detectioncited by 43
- 2021ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignmentcited by 34
- 2019Aggregation via Separation: Boosting Facial Landmark Detector with Semi-Supervised Style Translationcited by 33
- 2023Precise Facial Landmark Detection by Reference Heatmap Transformercited by 16
- 2021HIH: Towards More Accurate Face Alignment via Heatmap in Heatmapcited by 15
- 2024Cascaded Dual Vision Transformer for Accurate Facial Landmark Detectioncited by 5
- 2024POPoS: Improving Efficient and Robust Facial Landmark Detection with Parallel Optimal Position Searchcited by 2
Built on by
Not cited yet.