mlsanityData to 7 Oct 2026

FlatManifold: Robust Continual Learning under Severe Label Noise and Domain Shifts via Intrinsic Manifold Flattening

arXiv 2607.05201 ↗First posted 6 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In non-stationary streaming environments, simultaneously adapting to complex, non-linear domain shifts via continual learning while mitigating the catastrophic effects of severe, uncalibrated label noise poses a fundamental mathematical challenge. In this paper, we propose FlatManifold, a novel, streamlined robust continual learning framework that utilizes a Nystr"om manifold flattening map based on the kernel trick and projection onto an orthogonalized Reproducing Kernel Hilbert Space (RKHS). Unlike traditional methods that rely on complex, error-prone sample-filtering pipelines, the proposed approach exploits the intrinsic mathematical robustness of the flattened space itself. By mapping feature distributions onto a fixed orthogonal target topology with a ridge regularizer, the framework naturally smoothes and counteracts the influence of extreme label noise during the optimization process. Concurrently, catastrophic forgetting is prevented via a continual topology brake term that leverages the covariance matrix of past experiences. Extensive evaluation on real-world multi-session robotics datasets demonstrates that even under severe conditions featuring 40% symmetric label noise, FlatManifold successfully mitigates gradient corruption. Under extreme cross-session domain shifts spanning various seasons and lighting conditions, the proposed framework establishes high generalization capabilities, significantly outperforming standard sequential optimization baselines and proving that structural linearization itself serves as a powerful mathematical barrier against distributed label corruption.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

22 of 37 references.

References · 22

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2017Deep reinforcement learning from human preferencescited by 3,846
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  8. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  9. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
  10. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
  11. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
  12. 2022Large Language Models Are Reasoning Teacherscited by 318
10 more
  1. 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
  2. 2023SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Researchcited by 112
  3. 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoningcited by 85
  4. 2024Step-level Value Preference Optimization for Mathematical Reasoningcited by 71
  5. 2024Improving Physics Reasoning in Large Language Models Using Mixture of Refinement Agentscited by 22
  6. 2025Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedbackcited by 22
  7. 2023Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Levelcited by 15
  8. 2025Full-Step-DPO: Self-Supervised Preference Optimization with Step-wise Rewards for Mathematical Reasoningcited by 14
  9. 2024Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphscited by 10
  10. 2024Enhancing LLMs for Physics Problem-Solving using Reinforcement Learning with Human-AI Feedbackcited by 6

Built on by

Not cited yet.