mlsanityData to 14 Oct 2026

Generalized Graph Variational Autoencoders: Bounded Divergences Control Posterior Collapse

arXiv 2609.29546 ↗First posted 25 Aug 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The variational graph autoencoder (VGAE) regularizes its posterior toward the prior with the Kullback-Leibler divergence, a choice inherited from the variational autoencoder rather than argued for. We introduce the generalized graph variational autoencoder (GGVA), which replaces that term with any member of the R'enyi-Tsallis family of order q while leaving every other part of the model untouched. Both members admit closed forms for diagonal Gaussians and both recover the KL exactly as q → 1, so the VGAE is the q=1 arm of our own model rather than a separate baseline, and any measured difference is attributable to a single scalar. Our analysis identifies boundedness, not the order, as the operative property: for q<1 the Tsallis divergence is bounded above by 1/(1-q), independently of the latent width, whereas the KL and the R'enyi divergence of the same order are unbounded. On ten graphs spanning three synthetic families, a social network, three citation networks, a connectome, a power grid and a road network, q moves the retained posterior information by up to 49× relative to the VGAE, while the R'enyi arm at the same order stays within 1.02-1.30× of it on all six larger real graphs (isolating the bound as the cause). The retained information is usable: probing the frozen embedding for node class, a label absent from the objective, gives GGVA up to +0.14 macro-F1 over the VGAE on CiteSeer, with the R'enyi control again tracking the VGAE. We also report what the design was built to expose: none of this reaches held-out link-prediction accuracy on any of the six larger real graphs, and boundedness delays posterior collapse rather than preventing it.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

14 of 26 references.

References · 14

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  3. 2016Variational Graph Auto-Encoderscited by 1,382
  4. 2015Generating Sentences from a Continuous Spacecited by 612
  5. 2015Importance Weighted Autoencoderscited by 456
  6. 2017Wasserstein Auto-Encoderscited by 373
  7. 2016Ladder Variational Autoencoderscited by 318
  8. 2016R'enyi Divergence Variational Inferencecited by 104
  9. 2023t3-Variational Autoencoder: Learning Heavy-tailed Data with Student's t and Power Divergencecited by 18
  10. 2020q-VAE for Disentangled Representation Learning and Latent Dynamical Systemscited by 9
  11. 2020Epitomic Variational Graph Autoencodercited by 7
  12. 2026GraphNetz: Statistical Benchmarking of Graph Neural Networks with Paired Tests and Rank Aggregationcited by 1
2 more
  1. 2026Perspectives on Tsallis Statistics for Artificial Intelligencecited by 1
  2. 2026When Should Graph Attention Be Sparse? Learning a Per-Edge Tsallis Indexcited by 1

Built on by

Not cited yet.