mlsanityData to 14 Oct 2026

Flows for Flows: Morphing one Dataset into another with Maximum Likelihood Estimation

arXiv 2309.06472 ↗First posted 12 Sep 2023hep-ph cs.LG hep-excited by 0

Not on the map. Why?

Abstract (arXiv)

Many components of data analysis in high energy physics and beyond require morphing one dataset into another. This is commonly solved via reweighting, but there are many advantages of preserving weights and shifting the data points instead. Normalizing flows are machine learning models with impressive precision on a variety of particle physics tasks. Naively, normalizing flows cannot be used for morphing because they require knowledge of the probability density of the starting dataset. In most cases in particle physics, we can generate more examples, but we do not know densities explicitly. We propose a protocol called flows for flows for training normalizing flows to morph one dataset into another even if the underlying probability density of neither dataset is known explicitly. This enables a morphing strategy trained with maximum likelihood estimation, a setup that has been shown to be highly effective in related tasks. We study variations on this protocol to explore how far the data points are moved to statistically match the two datasets. Furthermore, we show how to condition the learned flows on particular features in order to create a morphing function for every value of the conditioning feature. For illustration, we demonstrate flows for flows for toy examples as well as a collider physics example involving dijet events

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 37 references that are in the map. First posted on arXiv 12 Sep 2023.

Builds on

10 of 37 references.

References · 10

  1. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  4. 2019Neural Spline Flowscited by 596
  5. 2020OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transportcited by 143
  6. 2020Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex Optimizationcited by 90
  7. 2020Anomaly Detection with Density Estimationcited by 72
  8. 2021Machine Learning in the Search for New Fundamental Physicscited by 50
  9. 2020Unsupervised in-distribution anomaly detection of new physics through conditional density estimationcited by 12
  10. 2021New Methods and Datasets for Group Anomaly Detection From Fundamental Physicscited by 6

Built on by

Not cited yet.