mlsanityData to 14 Oct 2026

Mathematical Programming in Machine Learning and Artificial Intelligence: A Unified Taxonomy of Models and Applications

arXiv 2609.07254 ↗First posted 7 Sep 2026math.OC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Mathematical programming provides a common language for many decisions embedded in modern machine-learning (ML) and artificial-intelligence (AI) systems: selecting retrieval context, routing tokens, allocating inference compute, fitting structured predictors, protecting against distribution shift, and balancing competing objectives. However, the relevant literature is fragmented across optimization, information retrieval, recommendation, natural-language processing, computer vision, and learning theory. This paper organizes various applications under common mathematical programming paradigms: linear, quadratic, binary and mixed-integer, conic, bilevel, multi-objective, inverse, distributionally robust, submodular, and min--max optimization. We normalize the models with a mostly unified notation and, for every application, identify inputs, decision variables, a principal formulation, structural properties, solution strategies, and limitations. Across paradigms, we compare tractability, relaxation quality, decomposition, approximation guarantees, and scalability bottlenecks. The paper shows that mathematical programming is most useful not as a claim that all learning is LP or MIP, but as a disciplined interface between predictions and constrained decisions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

14 of 34 references.

References · 14

  1. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  2. 2018DARTS: Differentiable Architecture Searchcited by 1,798
  3. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
  4. 2022Mixture-of-Experts with Expert Choice Routingcited by 623
  5. 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 405
  6. 2015Best Subset Selection via a Modern Optimization Lenscited by 100
  7. 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 86
  8. 2025Accelerating Scientific Discovery with Autonomous Goal-evolving Agentscited by 19
  9. 2025Robust LLM Alignment via Distributionally Robust Direct Preference Optimizationcited by 18
  10. 2018Generalized Inverse Optimization through Online Learningcited by 12
  11. 2025Threading Keyframe with Narratives: MLLMs as Strong Long Video Comprehenderscited by 10
  12. 2025Automated Composition of Agents: A Knapsack Approach for Agentic Component Selectioncited by 10
2 more
  1. 2026Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTScited by 5
  2. 2025A First-order Generative Bilevel Optimization Framework for Diffusion Modelscited by 4

Built on by

Not cited yet.