FlatManifold: Robust Continual Learning under Severe Label Noise and Domain Shifts via Intrinsic Manifold Flattening
Not on the map. Why?
Abstract (arXiv)
In non-stationary streaming environments, simultaneously adapting to complex, non-linear domain shifts via continual learning while mitigating the catastrophic effects of severe, uncalibrated label noise poses a fundamental mathematical challenge. In this paper, we propose FlatManifold, a novel, streamlined robust continual learning framework that utilizes a Nystr"om manifold flattening map based on the kernel trick and projection onto an orthogonalized Reproducing Kernel Hilbert Space (RKHS). Unlike traditional methods that rely on complex, error-prone sample-filtering pipelines, the proposed approach exploits the intrinsic mathematical robustness of the flattened space itself. By mapping feature distributions onto a fixed orthogonal target topology with a ridge regularizer, the framework naturally smoothes and counteracts the influence of extreme label noise during the optimization process. Concurrently, catastrophic forgetting is prevented via a continual topology brake term that leverages the covariance matrix of past experiences. Extensive evaluation on real-world multi-session robotics datasets demonstrates that even under severe conditions featuring 40% symmetric label noise, FlatManifold successfully mitigates gradient corruption. Under extreme cross-session domain shifts spanning various seasons and lighting conditions, the proposed framework establishes high generalization capabilities, significantly outperforming standard sequential optimization baselines and proving that structural linearization itself serves as a powerful mathematical barrier against distributed label corruption.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
22 of 37 references.
References · 22
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2022Large Language Models Are Reasoning Teacherscited by 318
10 more
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
- 2023SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Researchcited by 112
- 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoningcited by 85
- 2024Step-level Value Preference Optimization for Mathematical Reasoningcited by 71
- 2024Improving Physics Reasoning in Large Language Models Using Mixture of Refinement Agentscited by 22
- 2025Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedbackcited by 22
- 2023Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Levelcited by 15
- 2025Full-Step-DPO: Self-Supervised Preference Optimization with Step-wise Rewards for Mathematical Reasoningcited by 14
- 2024Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphscited by 10
- 2024Enhancing LLMs for Physics Problem-Solving using Reinforcement Learning with Human-AI Feedbackcited by 6
Built on by
Not cited yet.