mlsanityData to 13 Oct 2026

Chebyshev Center-Based Direction Selection for Multi-Objective Optimization and Training PINNs

arXiv 2605.09975 ↗First posted 11 May 2026cs.LG math.OCcited by 0

Not on the map. Why?

Abstract (arXiv)

Physics-informed neural networks (PINNs) are a promising approach for solving partial differential equations (PDEs). Their training, however, is often difficult because multiple loss terms induced by PDE residuals and boundary or initial conditions must be optimized simultaneously. To address this difficulty, existing approaches often construct update directions by explicitly enforcing particular desirable properties, such as scale robustness and simultaneous descent. While effective in many cases, such property-by-property designs can make it unclear which conditions are essential, what geometric principle determines the selected update direction, and how different methods are structurally related. In this work, we formulate update-direction selection for PINN training as a Chebyshev-center problem in the dual cone. The proposed formulation selects a normalized direction that maximizes the minimum distance to the cone facets. The resulting formulation admits an efficient dual problem in a much lower-dimensional space and yields a convergence guarantee in the nonconvex setting. It also recovers the key desirable properties targeted by existing approaches without imposing them separately; rather, they follow from the single geometric criterion underlying the formulation. This makes the selected direction interpretable through a single geometric rule and provides a unified basis for systematically comparing related direction-selection methods. Experiments on several PINN benchmarks further demonstrate strong empirical performance of the proposed method.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

23 of 31 references.

References · 23

  1. 2021Convex optimizationcited by 2,488
  2. 2020Gradient Surgery for Multi-Task Learningcited by 1,225
  3. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 812
  4. 2021Characterizing possible failure modes in physics-informed neural networkscited by 637
  5. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 633
  6. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 604
  7. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 446
  8. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 283
  9. 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 234
  10. 2021Efficient training of physics-informed neural networks via importance samplingcited by 110
  11. 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
  12. 2023PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEscited by 85
11 more
  1. 2021DAS-PINNs: A deep adaptive sampling method for solving high-dimensional partial differential equationscited by 66
  2. 2023Separable Physics-Informed Neural Networkscited by 65
  3. 2022Failure-informed adaptive sampling for PINNscited by 64
  4. 2023PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networkscited by 62
  5. 2024ConFIG: Towards Conflict-free Training of Physics Informed Neural Networkscited by 44
  6. 2025Gradient-Adaptive Policy Optimization: Towards Multi-Objective Alignment of Large Language Modelscited by 23
  7. 2024Dual Cone Gradient Descent for Training Physics-Informed Neural Networkscited by 21
  8. 2023MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networkscited by 17
  9. 2026Reward-free Alignment for Conflicting Objectivescited by 11
  10. 2024PMGDA: A Preference-based Multiple Gradient Descent Algorithmcited by 10
  11. 2025Enhancing Stability of Physics-Informed Neural Network Training Through Saddle-Point Reformulationcited by 1

Built on by

Not cited yet.