FLAML: A Fast and Lightweight AutoML Library
Not on the map. Why?
Abstract (arXiv)
We study the problem of using low computational cost to automate the choices of learners and hyperparameters for an ad-hoc training dataset and error metric, by conducting trials of different configurations on the given training data. We investigate the joint impact of multiple factors on both trial cost and model error, and propose several design guidelines. Following them, we build a fast and lightweight library FLAML which optimizes for low computational resource in finding accurate models. FLAML integrates several simple but effective search strategies into an adaptive system. It significantly outperforms top-ranked AutoML libraries on a large open source AutoML benchmark under equal, or sometimes orders of magnitude smaller budget constraints.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 17; 2023: 18; 2024: 23; 2025: 19; 2026: 23.
104 papers.
Sort:
By area:
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Taskscited by 66
- 2023Instruction Mining: Instruction Data Selection for Tuning Large Language Modelscited by 57
- 2022AMLB: an AutoML Benchmarkcited by 55
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2023TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applicationscited by 32
- 2024AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Modelscited by 29
- 2024Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Modelscited by 29
- 2022Empirical Analysis of Model Selection for Heterogeneous Causal Effect Estimationcited by 25
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learningcited by 23
- 2023Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoMLcited by 16
38 more
- 2024Automated data processing and feature engineering for deep learning and big data applications: a surveycited by 14
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigmcited by 14
- 2024AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generationcited by 13
- 2024AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language Modelscited by 13
- 2025TabPFN: One Model to Rule Them All?cited by 10
- 2022XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learningcited by 8
- 2022SubStrat: A Subset-Based Strategy for Faster AutoMLcited by 8
- 2023AutoML in The Wild: Obstacles, Workarounds, and Expectationscited by 8
- 2023Q(D)O-ES: Population-based Quality (Diversity) Optimisation for Post Hoc Ensemble Selection in AutoMLcited by 8
- 2021A Scalable AutoML Approach Based on Graph Neural Networkscited by 7
- 2021FairAutoML: Embracing Unfairness Mitigation in AutoMLcited by 6
- 2023DivBO: Diversity-aware CASH for Ensemble Learningcited by 6
- 2024Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Datacited by 6
- 2026Closed-loop Auto Research for Molecular Property Prediction: Discovering and Certifying Generalizable Improvementscited by 6
- 2022Meta-Learning for Unsupervised Outlier Detection with Optimal Transportcited by 5
- 2024X Hacking: The Threat of Misguided AutoMLcited by 5
- 2024Structure-agnostic Optimality of Doubly Robust Learning for Treatment Effect Estimationcited by 5
- 2025Min-Max Optimisation for Nonconvex-Nonconcave Functions Using a Random Zeroth-Order Extragradient Algorithmcited by 5
- 2025CoMind: Towards Community-Driven Agents for Machine Learning Engineeringcited by 5
- 2025We Need to Rethink Benchmarking in Anomaly Detectioncited by 4
- 2021ChaCha for Online AutoMLcited by 3
- 2022AutoDES: AutoML Pipeline Generation of Classification with Dynamic Ensemble Strategy Selectioncited by 3
- 2022AutoMLBench: A Comprehensive Experimental Evaluation of Automated Machine Learning Frameworkscited by 3
- 2024The Potential of AutoML for Recommender Systemscited by 3
- 2022Missing Data Infill with Automungecited by 2
- 2022Mining Robust Default Configurations for Resource-constrained AutoMLcited by 2
- 2022Automatically Categorising GitHub Repositories by Application Domaincited by 2
- 2023Scalable End-to-End ML Platforms: from AutoML to Self-servecited by 2
- 2023KGLiDS: A Platform for Semantic Abstraction, Linking, and Automation of Data Sciencecited by 2
- 2023EvolveMT: an Ensemble MT Engine Improving Itself with Usage Onlycited by 2
- 2023Roulette: A Semantic Privacy-Preserving Device-Edge Collaborative Inference Framework for Deep Learning Classification Taskscited by 2
- 2024Unveiling the Potential of Robustness in Selecting Conditional Average Treatment Effect Estimatorscited by 2
- 2021Federated Data Science to Break Down Silos [Vision]cited by 1
- 2022Practitioner Motives to Use Different Hyperparameter Optimization Methodscited by 1
- 2022SIBILA: A novel interpretable ensemble of general-purpose machine learning models applied to medical contextscited by 1
- 2022ACE: Adaptive Constraint-aware Early Stopping in Hyperparameter Optimizationcited by 1
- 2022Arbitrarily Large Labelled Random Satisfiability Formulas for Machine Learning Trainingcited by 1
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
50 most cited of 104 All 104 (JSON)
- 2026Large Language Models for Automated Cross-Domain Machine Learning Task Type Identification: A Benchmark Dataset and Evaluation28 Sep 2026
- 2026CRISP: Scalable Importance-Stratified Coresets for Imbalanced Tabular Learning22 Sep 2026
- 2026SAGE-Loop: Reliable Closed-Loop LLM-Driven AutoML with Trial-and-Correction and Adaptive Ensembling11 Sep 2026
- 2026Causal Foundation Models2 Sep 2026
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysis2 Sep 2026
- 2026Using Grounded Theory for Agent Behavior Analysis at Scale31 Aug 2026
- 2026Candidate-Fate Accounting for Transparent Sensor Diagnostic Pipeline Search19 Aug 2026
- 2026TraceSQL: Traceable Answerability Estimation for Reference-Free Text-to-SQL Verification18 Aug 2026
- 2026Evolving Executable Pipeline Programs for AutoML with Language Models17 Aug 2026
- 2026Recovering Wasted Compute in Autoresearch Agents11 Aug 2026
- 2026Winning by Peeking: Unenforced Budgets and Test-Set Selection Inflate Short-Budget AutoML Comparisons7 Aug 2026
- 2026SemiScope: Disentangling Classifier Tuning and Joint Optimization in Semi-Supervised Security Classification30 Jun 2026
38 more
- 2026Closed-loop Auto Research for Molecular Property Prediction: Discovering and Certifying Generalizable Improvements22 Jun 2026
- 2026Evaluation of AutoML Frameworks for IDS under Imbalanced Data Conditions of the NSL-KDD Dataset10 Jun 2026
- 2026SAGE: An LLM-driven Self Reflective Agentic Framework for Fraud Detection6 Jun 2026
- 20261GC-7RC: One Graphic Card -- Seven Research Challenges! How Good Are AI Agents at Doing Your Job?16 May 2026
- 2026SNAC-Pack 2.0: Scaled-Out Surrogate Neural Architecture Codesign15 May 2026
- 2026CellScientist: From Execution Feedback to Auditable Model-Revision Trajectories for Cellular Perturbation Prediction8 May 2026
- 2026Memory-Augmented LLM-based Multi-Agent System for Automated Feature Generation on Tabular Data22 Apr 2026
- 2026Machine Learning Transferability for Malware Detection27 Mar 2026
- 2026Pointing-Based Object Recognition16 Mar 2026
- 2026PyGALAX: An Open-Source Python Toolkit for Advanced Explainable Geospatial Machine Learning31 Jan 2026
- 2026Billboard in Focus: Estimating Driver Gaze Duration from a Single Image11 Jan 2026
- 2025Who Leads? Comparing Human-Centric and Model-Centric Strategies for Defining ML Target Variables29 Oct 2025
- 2025Automated Machine Learning for Unsupervised Tabular Tasks8 Oct 2025
- 2025MINERVA: Mutual Information Neural Estimation for Supervised Feature Selection2 Oct 2025
- 2025In-Context Decision Making for Optimizing Complex AutoML Pipelines19 Aug 2025
- 2025We Need to Rethink Benchmarking in Anomaly Detection21 Jul 2025
- 2025Imbalanced Regression Pipeline Recommendation16 Jul 2025
- 2025CoMind: Towards Community-Driven Agents for Machine Learning Engineering25 Jun 2025
- 2025Efficient Malware Detection with Optimized Learning on High-Dimensional Features18 Jun 2025
- 2025CaliciBoost: Performance-Driven Evaluation of Molecular Representations for Caco-2 Permeability Prediction9 Jun 2025
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learning9 Jun 2025
- 2025Do-PFN: In-Context Learning for Causal Effect Estimation6 Jun 2025
- 2025VirnyFlow: Optimizing ML Pipelines for Accuracy, Fairness, and Stability at Scale2 Jun 2025
- 2025TabPFN: One Model to Rule Them All?26 May 2025
- 2025General Post-Processing Framework for Fairness Adjustment of Machine Learning Models22 Apr 2025
- 2025Can Moran Eigenvectors Improve Machine Learning of Spatial Data? Insights from Synthetic Data Validation16 Apr 2025
- 2025Min-Max Optimisation for Nonconvex-Nonconcave Functions Using a Random Zeroth-Order Extragradient Algorithm10 Apr 2025
- 2025AutoML Benchmark with shorter time constraints and early stopping1 Apr 2025
- 2025EDCA - An Evolutionary Data-Centric AutoML Framework for Efficient Pipelines6 Mar 2025
- 2025Enhancing Plagiarism Detection in Marathi with a Weighted Ensemble of TF-IDF and BERT Embeddings for Low-Resource Language Processing9 Jan 2025
- 2024Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data19 Dec 2024
- 2024An AutoML-based approach for Network Intrusion Detection24 Nov 2024
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learning22 Oct 2024
- 2024UniAutoML: A Human-Centered Framework for Unified Discriminative and Generative AutoML with Large Language Models9 Oct 2024
- 2024AutoMode-ASR: Learning to Select ASR Systems for Better Quality and Cost19 Sep 2024
- 2024Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models4 Aug 2024
- 2024AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language Models1 Aug 2024
- 2024Towards Evolutionary-based Automated Machine Learning for Small Molecule Pharmacokinetic Prediction1 Aug 2024
50 newest of 104 All 104 (JSON)
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learningcited by 23
- 2025CoMind: Towards Community-Driven Agents for Machine Learning Engineeringcited by 5
- 20261GC-7RC: One Graphic Card -- Seven Research Challenges! How Good Are AI Agents at Doing Your Job?cited by 1
- 2026SAGE: An LLM-driven Self Reflective Agentic Framework for Fraud Detectioncited by 1
- 2026Recovering Wasted Compute in Autoresearch Agentscited by 1
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysiscited by 1
- 2026Memory-Augmented LLM-based Multi-Agent System for Automated Feature Generation on Tabular Datacited by 0
- 2026Using Grounded Theory for Agent Behavior Analysis at Scalecited by 0
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysis2 Sep 2026
- 2026Using Grounded Theory for Agent Behavior Analysis at Scale31 Aug 2026
- 2026Recovering Wasted Compute in Autoresearch Agents11 Aug 2026
- 2026SAGE: An LLM-driven Self Reflective Agentic Framework for Fraud Detection6 Jun 2026
- 20261GC-7RC: One Graphic Card -- Seven Research Challenges! How Good Are AI Agents at Doing Your Job?16 May 2026
- 2026Memory-Augmented LLM-based Multi-Agent System for Automated Feature Generation on Tabular Data22 Apr 2026
- 2025CoMind: Towards Community-Driven Agents for Machine Learning Engineering25 Jun 2025
- 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learning22 Oct 2024
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug 2023
- 2023MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Taskscited by 66
- 2023Instruction Mining: Instruction Data Selection for Tuning Large Language Modelscited by 57
- 2022AMLB: an AutoML Benchmarkcited by 55
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2023TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applicationscited by 32
- 2024AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Modelscited by 29
- 2022Empirical Analysis of Model Selection for Heterogeneous Causal Effect Estimationcited by 25
- 2023Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoMLcited by 16
- 2024Automated data processing and feature engineering for deep learning and big data applications: a surveycited by 14
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigmcited by 14
- 2024AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language Modelscited by 13
12 most cited of 93 All 93 (JSON)
- 2026Large Language Models for Automated Cross-Domain Machine Learning Task Type Identification: A Benchmark Dataset and Evaluation28 Sep 2026
- 2026CRISP: Scalable Importance-Stratified Coresets for Imbalanced Tabular Learning22 Sep 2026
- 2026SAGE-Loop: Reliable Closed-Loop LLM-Driven AutoML with Trial-and-Correction and Adaptive Ensembling11 Sep 2026
- 2026Causal Foundation Models2 Sep 2026
- 2026Candidate-Fate Accounting for Transparent Sensor Diagnostic Pipeline Search19 Aug 2026
- 2026TraceSQL: Traceable Answerability Estimation for Reference-Free Text-to-SQL Verification18 Aug 2026
- 2026Evolving Executable Pipeline Programs for AutoML with Language Models17 Aug 2026
- 2026Winning by Peeking: Unenforced Budgets and Test-Set Selection Inflate Short-Budget AutoML Comparisons7 Aug 2026
- 2026SemiScope: Disentangling Classifier Tuning and Joint Optimization in Semi-Supervised Security Classification30 Jun 2026
- 2026Closed-loop Auto Research for Molecular Property Prediction: Discovering and Certifying Generalizable Improvements22 Jun 2026
- 2026Evaluation of AutoML Frameworks for IDS under Imbalanced Data Conditions of the NSL-KDD Dataset10 Jun 2026
- 2026SNAC-Pack 2.0: Scaled-Out Surrogate Neural Architecture Codesign15 May 2026
12 newest of 93 All 93 (JSON)