mlsanityData to 7 Oct 2026

Differentiable Bilevel Programming for Stackelberg Congestion Games

arXiv 2209.07618 ↗First posted 15 Sep 2022cs.GT cs.AI cs.MAcited by 4

Not on the map. Why?

Abstract (arXiv)

In a Stackelberg congestion game (SCG), a leader aims to maximize their own gain by anticipating and manipulating the equilibrium state at which the followers settle by playing a congestion game. Often formulated as bilevel programs, large-scale SCGs are well known for their intractability and complexity. Here, we attempt to tackle this computational challenge by marrying traditional methodologies with the latest differentiable programming techniques in machine learning. The core idea centers on replacing the lower-level equilibrium problem with a smooth evolution trajectory defined by the imitative logit dynamic (ILD), which we prove converges to the equilibrium of the congestion game under mild conditions. Building upon this theoretical foundation, we propose two new local search algorithms for SCGs. The first is a gradient descent algorithm that obtains the derivatives by unrolling ILD via differentiable programming. Thanks to the smoothness of ILD, the algorithm promises both efficiency and scalability. The second algorithm adds a heuristic twist by cutting short the followers' evolution trajectory. Behaviorally, this means that, instead of anticipating the followers' best response at equilibrium, the leader seeks to approximate that response by only looking ahead a limited number of steps. Our numerical experiments are carried out over various instances of classic SCG applications, ranging from toy benchmarks to large-scale real-world examples. The results show the proposed algorithms are reliable and scalable local solvers that deliver high-quality solutions with greater regularity and significantly less computational effort compared to the many incumbents included in our study.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 36 of its 189 references that are in the map. First posted on arXiv 15 Sep 2022.

Builds on

36 of 189 references.

References · 36

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  4. 2015Automatic differentiation in machine learning: a surveycited by 846
  5. 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 660
  6. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
  7. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
  8. 2019Differentiable Convex Optimization Layerscited by 458
  9. 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 403
  10. 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 357
  11. 2019PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Searchcited by 265
  12. 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
24 more
  1. 2017Forward and Reverse Gradient-Based Hyperparameter Optimizationcited by 232
  2. 2016Unrolled Generative Adversarial Networkscited by 208
  3. 2018Truncated Back-propagation for Bilevel Optimizationcited by 187
  4. 2020On the Iteration Complexity of Hypergradient Computationcited by 154
  5. 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
  6. 2016Learning in games with continuous action sets and unknown payoff functionscited by 78
  7. 2015Scalable Gradient-Based Tuning of Continuous Regularization Hyperparameterscited by 71
  8. 2016Theano: A Python framework for fast computation of mathematical expressionscited by 64
  9. 2019Pontryagin Differentiable Programming: An End-to-End Learning and Control Frameworkcited by 48
  10. 2020End-to-End Learning and Intervention in Gamescited by 19
  11. 2020AlphaGAN: Fully Differentiable Architecture Search for Generative Adversarial Networkscited by 10
  12. 2021Inducing Equilibria via Incentives: Simultaneous Design-and-Play Ensures Global Convergencecited by 8
  13. 2018Convergence of the Iterates in Mirror Descent Methodscited by 7
  14. 2018Altruistic Autonomy: Beating Congestion on Shared Roadscited by 7
  15. 2020Linear Convergence of Generalized Mirror Descent with Time-Dependent Mirrorscited by 5
  16. 2013Complexity and Approximation of the Continuous Network Design Problemcited by 3
  17. 2017Traffic Optimization For a Mixture of Self-interested and Compliant Agentscited by 3
  18. 2020Information Design in Non-atomic Routing Games with Partial Participation: Computation and Propertiescited by 3
  19. 2022Public Signals in Network Congestion Gamescited by 3
  20. 2013A Nonlinear Pairwise Swapping Dynamics to Model the Selfish Rerouting Evolutionary Gamecited by 1
  21. 2013The Network Improvement Problem for Equilibrium Routingcited by 1
  22. 2018Congestion Pricing in a World of Self-driving vehicles: an Analysis of Different Strategies in Alternative Future Scenarioscited by 1
  23. 2019Pricing Traffic Networks with Mixed Vehicle Autonomycited by 1
  24. 2019Optimal Tolling for Heterogeneous Traffic Networks with Mixed Autonomycited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 1.

4 papers.