Ordinal Neural Collapse as a Representation Prior for Visual Navigation
Not on the map. Why?
Abstract (arXiv)
Learning robust navigation policies directly from visual observations remains a fundamental challenge in vision-based robotic navigation. In end-to-end imitation learning approaches, the visual encoder and action decoder are jointly optimized using a single action loss, which provides only an indirect supervisory signal to the encoder. This indirect supervision frequently results in the encoder learning ambiguous, action-agnostic representations. The problem is further complicated by substantial variations in scene structure and appearance across diverse environments, as well as the prevalence of visual distractors inherent to real-world navigation settings. Such action-agnostic features cause the navigation policy to produce inconsistent actions at ambiguous decision points, leading to navigation failure. To overcome these limitations, we propose ORION (Ordinal Neural Collapse for Visual Navigation), a method that explicitly organizes the encoder's representation space according to the ordinal structure of navigation actions. In the context of goal-directed navigation, ego-centric control categories from Far Left to Far Right exhibit a natural ordinal relationship in which neighboring classes share similar visual contexts, while semantically opposing classes differ substantially in appearance. We encourage class representations to be arranged sequentially along a single discriminative axis, while suppressing off-axis variance within each class. The pretrained encoder is then integrated into a diffusion-based navigation framework, and the full pipeline is fine-tuned end-to-end. Extensive experiments in both simulation and real-world settings show that ORION consistently outperforms end-to-end and neural collapse baselines in navigation success rate and goal progress, with notable gains in visually challenging scenarios such as complex multi-way intersections.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
31 of 37 references.
References · 31
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 950
- 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 745
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 424
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
- 2020Decoupling Representation Learning from Reinforcement Learningcited by 263
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
19 more
- 2021A Geometric Analysis of Neural Collapse with Unconstrained Featurescited by 226
- 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 215
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2016Learning to Navigate in Complex Environmentscited by 192
- 2021Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Trainingcited by 166
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2021On the Role of Neural Collapse in Transfer Learningcited by 100
- 2022Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?cited by 100
- 2022On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Featurescited by 97
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2019Deep Visual MPC-Policy Learning for Navigationcited by 54
- 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 40
- 2023Neural Collapse for Unconstrained Feature Model under Cross-entropy Loss with Imbalanced Datacited by 38
- 2022Understanding and Improving Transfer Learning of Deep Models via Neural Collapsecited by 24
- 2025Prior Does Matter: Visual Navigation via Denoising Diffusion Bridge Modelscited by 24
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigationcited by 23
- 2024Control-oriented Clustering of Visual Latent Representationcited by 8
- 2025Neural Collapse in Cumulative Link Models for Ordinal Regression: An Analysis with Unconstrained Feature Modelcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026NavJev: Efficient Vision-Language Navigation via Action-Centric Visual Compression and Discriminative Action-Semantic Memory
- 2024Narrowing the Gap between Vision and Action in Navigation
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
- 2026GemNav: Discrete-Token Visual Robot Navigation using a Multimodal Large Language Model
- 2026Less Is More: Scalable Visual Navigation from Limited Data
- 2025Can Pretrained Vision-Language Embeddings Alone Guide Robot Navigation?