Open-environment Machine Learning
Not on the map. Why?
Abstract (arXiv)
Conventional machine learning studies generally assume close-environment scenarios where important factors of the learning process hold invariant. With the great success of machine learning, nowadays, more and more practical tasks, particularly those involving open-environment scenarios where important factors are subject to change, called open-environment machine learning (Open ML) in this article, are present to the community. Evidently it is a grand challenge for machine learning turning from close environment to open environment. It becomes even more challenging since, in various big data tasks, data are usually accumulated with time, like streams, while it is hard to train the machine learning model after collecting all data as in conventional studies. This article briefly introduces some advances in this line of research, focusing on techniques concerning emerging new classes, decremental/incremental features, changing data distributions, varied learning objectives, and discusses some theoretical issues.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 26 of its 96 references that are in the map. First posted on arXiv 1 Jun 2022.
Builds on
26 of 96 references.
References · 26
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2018Recent Advances in Open Set Recognition: A Surveycited by 309
- 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
- 2019A review of domain adaptation without target labelscited by 154
- 2018Adaptive Online Learning in Dynamic Environmentscited by 130
- 2021Non-stationary Reinforcement Learning without Prior Knowledge: An Optimal Black-box Approachcited by 98
- 2020Dynamic Regret of Convex and Smooth Functionscited by 90
- 2021A Simple Approach for Non-stationary Linear Banditscited by 54
- 2019Bandit Convex Optimization in Non-stationary Environmentscited by 41
- 2021Knowledge-aware Zero-Shot Learning: Survey and Perspectivecited by 41
14 more
- 2016A Unified View of Multi-Label Performance Measurescited by 36
- 2019A comprehensive, application-oriented study of catastrophic forgetting in DNNscited by 35
- 2021Open-world Machine Learning: Applications, Challenges, and Opportunitiescited by 34
- 2021Non-stationary Online Learning with Memory and Non-stochastic Controlcited by 33
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 23
- 2016Classification under Streaming Emerging New Classes: A Solution using Completely Random Treescited by 17
- 2017Learning with Feature Evolvable Streamscited by 15
- 2018Handling Concept Drift via Model Reusecited by 15
- 2016One-Pass Learning with Incremental and Decremental Featurescited by 13
- 2019An Unbiased Risk Estimator for Learning with Augmented Classescited by 13
- 2017Distribution-Free One-Pass Learningcited by 10
- 2019Prediction with Unpredictable Feature Evolutioncited by 8
- 2020Exploratory Machine Learning with Unknown Unknownscited by 8
- 2018Robust Artificial Intelligence and Robust Human Organizationscited by 3
Built on by
Citing papers per year: 2022: 5; 2023: 15; 2024: 9; 2025: 12; 2026: 7.
48 papers.
Sort:
By area:
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2022Adapting to Online Label Shift with Provable Guaranteescited by 26
- 2022Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Datacited by 21
- 2024Happy: A Debiased Learning Framework for Continual Generalized Category Discoverycited by 18
- 2022Learnware: Small Models Do Bigcited by 16
- 2023Adapting to Continuous Covariate Shift via Online Density Ratio Estimationcited by 15
- 2023Robust multi-agent coordination via evolutionary generation of auxiliary adversarial attackerscited by 15
- 2023Efficient Methods for Non-stationary Online Learningcited by 15
- 2022Dynamic Regret of Online Markov Decision Processescited by 13
- 2024Parametric Feature Transfer: One-shot Federated Learning with Foundation Modelscited by 13
- 2024Robust Semi-Supervised Learning in Open Environmentscited by 8
36 more
- 2023Learnability with Time-Sharing Computational Resource Concernscited by 7
- 2023Towards Unbiased Training in Federated Open-world Semi-supervised Learningcited by 6
- 2023Communication-Robust Multi-Agent Learning by Adaptable Auxiliary Multi-Agent Adversary Generationcited by 6
- 2023Physics Inspired Hybrid Attention for SAR Target Recognitioncited by 6
- 2022LAMDA-SSL: Semi-Supervised Learning in Pythoncited by 5
- 2023Aux-Drop: Handling Haphazard Inputs in Online Learning Using Auxiliary Dropoutscited by 5
- 2026Revisiting Weighted Strategy for Non-stationary Parametric Bandits and MDPscited by 5
- 2023Multiobjective Evolutionary Pruning of Deep Neural Networks with Transfer Learning for improving their Performance and Robustnesscited by 4
- 2023Real-time Safety Assessment of Dynamic Systems in Non-stationary Environments: A Review of Methods and Techniquescited by 4
- 2024Open Continual Feature Selection via Granular-Ball Knowledge Transfercited by 4
- 2025Understanding the Limits of Deep Tabular Methods with Temporal Shiftcited by 4
- 2023OEBench: Investigating Open Environment Challenges in Real-World Relational Data Streamscited by 3
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approachcited by 3
- 2025BackMix: Regularizing Open Set Recognition by Removing Underlying Fore-Background Priorscited by 3
- 2025Realistic Evaluation of TabPFN v2 in Open Environmentscited by 3
- 2026Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Usecited by 3
- 2023OmniForce: On Human-Centered, Large Model Empowered and Cloud-Edge Collaborative AutoML Systemcited by 2
- 2024Dynamic Against Dynamic: An Open-set Self-learning Frameworkcited by 1
- 2024Exploiting Fine-Grained Prototype Distribution for Boosting Unsupervised Class Incremental Learningcited by 1
- 2025Mitigating Negative Transfer via Reducing Environmental Disagreementcited by 1
- 2026Online Learning with Gradient-Variation Interval Regretcited by 1
- 2023Universal Online Optimization in Dynamic Environments via Uniclass Predictioncited by 0
- 2023Revisiting Weighted Strategy for Non-stationary Parametric Banditscited by 0
- 2023Rethinking the Value of Labels for Instance-Dependent Label Noise Learningcited by 0
- 2024Theory-inspired Label Shift Adaptation via Aligned Distribution Mixturecited by 0
- 2024Theoretically Guaranteed Distribution Adaptable Learningcited by 0
- 2025On the Learning with Augmented Class via Forestscited by 0
- 2025Awesome-OL: An Extensible Toolkit for Online Learningcited by 0
- 2025Exploring the Tradeoff Between Diversity and Discrimination for Continuous Category Discoverycited by 0
- 2025DCV-ROOD Evaluation Framework: Dual Cross-Validation for Robust Out-of-Distribution Detectioncited by 0
- 2025Information Theory in Open-world Machine Learning Foundations, Frameworks, and Future Directioncited by 0
- 2025Feature-aware Modulation for Learning from Temporal Tabular Datacited by 0
- 2026Exploring the Impact of Parameter Update Magnitude on Forgetting and Generalization of Continual Learningcited by 0
- 2026Continual Quadruped Robots Coordination via Semantic Skill Discoverycited by 0
- 2026Offline Multi-agent Continual Cooperation via Skill Partition and Reusecited by 0
- 2026On the Relation Between Interval Regret and Dynamic Regretcited by 0
- 2026On the Relation Between Interval Regret and Dynamic Regret28 Sep 2026
- 2026Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use1 Jul 2026
- 2026Offline Multi-agent Continual Cooperation via Skill Partition and Reuse24 Jun 2026
- 2026Continual Quadruped Robots Coordination via Semantic Skill Discovery6 Jun 2026
- 2026Online Learning with Gradient-Variation Interval Regret2 Jun 2026
- 2026Exploring the Impact of Parameter Update Magnitude on Forgetting and Generalization of Continual Learning24 Feb 2026
- 2026Revisiting Weighted Strategy for Non-stationary Parametric Bandits and MDPs3 Jan 2026
- 2025Feature-aware Modulation for Learning from Temporal Tabular Data3 Dec 2025
- 2025Mitigating Negative Transfer via Reducing Environmental Disagreement28 Oct 2025
- 2025Information Theory in Open-world Machine Learning Foundations, Frameworks, and Future Direction17 Oct 2025
- 2025DCV-ROOD Evaluation Framework: Dual Cross-Validation for Robust Out-of-Distribution Detection6 Sep 2025
- 2025Exploring the Tradeoff Between Diversity and Discrimination for Continuous Category Discovery15 Aug 2025
36 more
- 2025Awesome-OL: An Extensible Toolkit for Online Learning27 Jul 2025
- 2025Realistic Evaluation of TabPFN v2 in Open Environments22 May 2025
- 2025On the Learning with Augmented Class via Forests14 May 2025
- 2025Multi-agent Embodied AI: Advances and Future Directions8 May 2025
- 2025Representation Learning for Tabular Data: A Comprehensive Survey17 Apr 2025
- 2025BackMix: Regularizing Open Set Recognition by Removing Underlying Fore-Background Priors22 Mar 2025
- 2025Understanding the Limits of Deep Tabular Methods with Temporal Shift27 Feb 2025
- 2024Robust Semi-Supervised Learning in Open Environments24 Dec 2024
- 2024Theoretically Guaranteed Distribution Adaptable Learning5 Nov 2024
- 2024Theory-inspired Label Shift Adaptation via Aligned Distribution Mixture4 Nov 2024
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach28 Oct 2024
- 2024Happy: A Debiased Learning Framework for Continual Generalized Category Discovery9 Oct 2024
- 2024Exploiting Fine-Grained Prototype Distribution for Boosting Unsupervised Class Incremental Learning19 Aug 2024
- 2024Dynamic Against Dynamic: An Open-set Self-learning Framework27 Apr 2024
- 2024Open Continual Feature Selection via Granular-Ball Knowledge Transfer15 Mar 2024
- 2024Parametric Feature Transfer: One-shot Federated Learning with Foundation Models2 Feb 2024
- 2023Physics Inspired Hybrid Attention for SAR Target Recognition27 Sep 2023
- 2023Efficient Methods for Non-stationary Online Learning16 Sep 2023
- 2023OEBench: Investigating Open Environment Challenges in Real-World Relational Data Streams29 Aug 2023
- 2023Rethinking the Value of Labels for Instance-Dependent Label Noise Learning10 May 2023
- 2023Robust multi-agent coordination via evolutionary generation of auxiliary adversarial attackers10 May 2023
- 2023Communication-Robust Multi-Agent Learning by Adaptable Auxiliary Multi-Agent Adversary Generation9 May 2023
- 2023Learnability with Time-Sharing Computational Resource Concerns3 May 2023
- 2023Towards Unbiased Training in Federated Open-world Semi-supervised Learning1 May 2023
- 2023Real-time Safety Assessment of Dynamic Systems in Non-stationary Environments: A Review of Methods and Techniques25 Apr 2023
- 2023Aux-Drop: Handling Haphazard Inputs in Online Learning Using Auxiliary Dropouts9 Mar 2023
- 2023Revisiting Weighted Strategy for Non-stationary Parametric Bandits5 Mar 2023
- 2023OmniForce: On Human-Centered, Large Model Empowered and Cloud-Edge Collaborative AutoML System1 Mar 2023
- 2023Multiobjective Evolutionary Pruning of Deep Neural Networks with Transfer Learning for improving their Performance and Robustness20 Feb 2023
- 2023Universal Online Optimization in Dynamic Environments via Uniclass Prediction13 Feb 2023
- 2023Adapting to Continuous Covariate Shift via Online Density Ratio Estimation6 Feb 2023
- 2022Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Data18 Dec 2022
- 2022Learnware: Small Models Do Big7 Oct 2022
- 2022Dynamic Regret of Online Markov Decision Processes26 Aug 2022
- 2022LAMDA-SSL: Semi-Supervised Learning in Python9 Aug 2022
- 2022Adapting to Online Label Shift with Provable Guarantees5 Jul 2022
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2022Adapting to Online Label Shift with Provable Guaranteescited by 26
- 2022Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Datacited by 21
- 2024Happy: A Debiased Learning Framework for Continual Generalized Category Discoverycited by 18
- 2022Learnware: Small Models Do Bigcited by 16
- 2023Adapting to Continuous Covariate Shift via Online Density Ratio Estimationcited by 15
- 2023Robust multi-agent coordination via evolutionary generation of auxiliary adversarial attackerscited by 15
- 2023Efficient Methods for Non-stationary Online Learningcited by 15
- 2022Dynamic Regret of Online Markov Decision Processescited by 13
- 2024Parametric Feature Transfer: One-shot Federated Learning with Foundation Modelscited by 13
- 2024Robust Semi-Supervised Learning in Open Environmentscited by 8
12 most cited of 47 All 47 (JSON)
- 2026On the Relation Between Interval Regret and Dynamic Regret28 Sep 2026
- 2026Offline Multi-agent Continual Cooperation via Skill Partition and Reuse24 Jun 2026
- 2026Continual Quadruped Robots Coordination via Semantic Skill Discovery6 Jun 2026
- 2026Online Learning with Gradient-Variation Interval Regret2 Jun 2026
- 2026Exploring the Impact of Parameter Update Magnitude on Forgetting and Generalization of Continual Learning24 Feb 2026
- 2026Revisiting Weighted Strategy for Non-stationary Parametric Bandits and MDPs3 Jan 2026
- 2025Feature-aware Modulation for Learning from Temporal Tabular Data3 Dec 2025
- 2025Mitigating Negative Transfer via Reducing Environmental Disagreement28 Oct 2025
- 2025Information Theory in Open-world Machine Learning Foundations, Frameworks, and Future Direction17 Oct 2025
- 2025DCV-ROOD Evaluation Framework: Dual Cross-Validation for Robust Out-of-Distribution Detection6 Sep 2025
- 2025Exploring the Tradeoff Between Diversity and Discrimination for Continuous Category Discovery15 Aug 2025
- 2025Awesome-OL: An Extensible Toolkit for Online Learning27 Jul 2025
12 newest of 47 All 47 (JSON)