mlsanityData to 14 Oct 2026

One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices

arXiv 2609.35514 ↗First posted 28 Sep 2026cs.LG stat.COcited by 0

Not on the map. Why?

Abstract (arXiv)

In ecology, psychometrics, and the analysis of social and financial networks, binary matrices are often analyzed conditional on their observed row and column sums, which restricts the problem to a finite sample space of matrices with the same margins. Two fundamental problems are to count this space and to sample uniformly from it. Sequential importance sampling (SIS) addresses both with independent weighted samples and an unbiased count estimator, but its efficiency depends critically on the proposal distribution. Existing proposals are analytically designed, and their accuracy can vary substantially with the margins. We show that the ideal SIS proposal, under which every weight equals the count and the variance vanishes, is exactly the policy of a generative flow network (GFlowNet) with unit reward on every matrix that has the given margins. We therefore propose MarginFlow, a framework that turns the design of the proposal into a learning problem and amortizes it across margins by exploiting their self-similarity. Every partial matrix is itself an instance with reduced margins, so one set transformer that reads the remaining margins serves every margin. We train MarginFlow on a pool of 1904 margins and evaluate it zero-shot on 1190 held-out margins, synthetic and real, from 3×3 to 870×6. On 1187 of the 1190 margins it matches or beats the best of 31 analytically designed configurations, chosen post hoc for each margin, and its median effective sample fraction is 99.8%. On the 56 margins where that best loses more than one nat of effective sample size, MarginFlow wins every one and raises the median effective sample fraction from 10.3% to 94.1%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 59 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

22 of 59 references.

References · 22

  1. 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 392
  2. 2021GFlowNet Foundationscited by 290
  3. 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 251
  4. 2018Neural Importance Samplingcited by 155
  5. 2022GFlowNets and variational inferencecited by 106
  6. 2018Solving Statistical Mechanics Using Variational Autoregressive Networkscited by 100
  7. 2024Probabilistic Inference in Language Models via Twisted Sequential Monte Carlocited by 90
  8. 2020VarGrad: A Low-Variance Gradient Estimator for Variational Inferencecited by 75
  9. 2023Robust Scheduling with GFlowNetscited by 69
  10. 2023Generative Flow Networks as Entropy-Regularized RLcited by 64
  11. 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
  12. 2024Discrete Probabilistic Inference as Control in Multi-path Environmentscited by 44
10 more
  1. 2015Neural Adaptive Sequential Monte Carlocited by 34
  2. 2016Inference Compilation and Universal Probabilistic Programmingcited by 32
  3. 2016Inference Networks for Sequential Monte Carlo in Graphical Modelscited by 20
  4. 2016Configuring Random Graph Models with Fixed Degree Sequencescited by 16
  5. 2025Reinforced sequential Monte Carlo for amortised samplingcited by 6
  6. 2024Action abstractions for amortized samplingcited by 4
  7. 2026f-Trajectory Balance: A Loss Family for Tuning GFlowNets, Generative Models, and LLMs with Off- and On-Policy Datacited by 4
  8. 2026PowerFlow: Unlocking the Dual Nature of LLMs via Principled Distribution Matchingcited by 2
  9. 2023A stopping rule for randomly sampling bipartite networks with fixed degree sequencescited by 1
  10. 2026Spectral Gap for the Binary Fixed-Margin Swap Chaincited by 1

Built on by

Not cited yet.