mlsanityData to 7 Oct 2026

Geometry-Aware Graph Construction via Adaptive Spectral Bandwidth Control

arXiv 2609.03306 ↗First posted 3 Sep 2026cs.LG eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

Kernelized graph methods - spectral clustering, diffusion maps, and sparse kernel -regression graphs - that use Gaussian kernels depend on the choice of Gaussian bandwidth sigma, which governs the spectral character of the local kernel operator. When sigma is too small, the kernel overestimates local complexity and treats each sample as an independent direction; when sigma is too large, the kernel collapses multiple directions together, the condition number diverges, and all geometric discrimination is lost. We propose a choice of scale to make the spectral complexity of the kernel consistent with the intrinsic complexity of the underlying manifold. We propose a per-node bandwidth criterion that operationalizes this principle by jointly matching the kernel's effective rank to the local intrinsic dimension estimated via minimum spanning tree, anchoring the search in the manifold-consistent log-log scaling regime. We evaluate SSL embeddings from six encoders on CIFAR-100, showing that adaptive bandwidth consistently improves leave-one-out (LOO) classification and label propagation (LP) accuracy over fixed-bandwidth methods and competing adaptive methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

16 of 28 references.

References · 16

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  7. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  8. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  9. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 246
  10. 2022RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rankcited by 145
  11. 2021Solo-learn: A Library of Self-supervised Methods for Visual Representation Learningcited by 116
  12. 2023Characterizing Large Language Model Geometry Helps Solve Toxicity Detection and Generationcited by 11
4 more
  1. 2022The Geometry of Self-supervised Learning Models and its Impact on Transfer Learningcited by 7
  2. 2025T-REGS: Minimum Spanning Tree Regularization for Self-Supervised Learningcited by 2
  3. 2026IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimensioncited by 2
  4. 2022Study of Manifold Geometry using Multiscale Non-Negative Kernel Graphscited by 1

Built on by

Not cited yet.