Mathematical Programming in Machine Learning and Artificial Intelligence: A Unified Taxonomy of Models and Applications
Not on the map. Why?
Abstract (arXiv)
Mathematical programming provides a common language for many decisions embedded in modern machine-learning (ML) and artificial-intelligence (AI) systems: selecting retrieval context, routing tokens, allocating inference compute, fitting structured predictors, protecting against distribution shift, and balancing competing objectives. However, the relevant literature is fragmented across optimization, information retrieval, recommendation, natural-language processing, computer vision, and learning theory. This paper organizes various applications under common mathematical programming paradigms: linear, quadratic, binary and mixed-integer, conic, bilevel, multi-objective, inverse, distributionally robust, submodular, and min--max optimization. We normalize the models with a mostly unified notation and, for every application, identify inputs, decision variables, a principal formulation, structural properties, solution strategies, and limitations. Across paradigms, we compare tractability, relaxation quality, decomposition, approximation guarantees, and scalability bottlenecks. The paper shows that mathematical programming is most useful not as a claim that all learning is LP or MIP, but as a disciplined interface between predictions and constrained decisions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
14 of 34 references.
References · 14
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
- 2022Mixture-of-Experts with Expert Choice Routingcited by 623
- 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 405
- 2015Best Subset Selection via a Modern Optimization Lenscited by 100
- 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 86
- 2025Accelerating Scientific Discovery with Autonomous Goal-evolving Agentscited by 19
- 2025Robust LLM Alignment via Distributionally Robust Direct Preference Optimizationcited by 18
- 2018Generalized Inverse Optimization through Online Learningcited by 12
- 2025Threading Keyframe with Narratives: MLLMs as Strong Long Video Comprehenderscited by 10
- 2025Automated Composition of Agents: A Knapsack Approach for Agentic Component Selectioncited by 10
Built on by
Not cited yet.