Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes
Not on the map. Why?
Abstract (arXiv)
Material characterization using electron micrographs is a crucial but challenging task with applications in various fields, such as semiconductors, quantum materials, batteries, etc. The challenges in categorizing electron micrographs include but are not limited to the complexity of patterns, high level of detail, and imbalanced data distribution(long-tail distribution). Existing methods have difficulty in modeling the complex relational structure in electron micrographs, hindering their ability to effectively capture the complex relationships between different spatial regions of micrographs. We propose a hypergraph neural network(HgNN) backbone architecture, a conceptually alternative approach, to better model the complex relationships in electron micrographs and improve material characterization accuracy. By utilizing cost-effective GPU hardware, our proposed framework outperforms popular baselines. The results of the ablation studies demonstrate that the proposed framework is effective in achieving state-of-the-art performance on benchmark datasets and efficient in terms of computational and memory requirements for handling large-scale electron micrograph-based datasets.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 73 of its 88 references that are in the map. First posted on arXiv 21 Aug 2024.
Builds on
73 of 88 references.
References · 73
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2017Graph Attention Networkscited by 8,854
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Layer Normalizationcited by 5,579
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
38 more
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2014Going Deeper with Convolutionscited by 4,231
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2021Going deeper with Image Transformerscited by 759
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2019Graph U-Netscited by 489
- 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
- 2018Hypergraph Neural Networkscited by 482
- 2021LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inferencecited by 475
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2019Self-Attention Graph Poolingcited by 421
- 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
- 2017Residual Gated Graph ConvNetscited by 341
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
- 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 324
- 2021Graph Neural Network-Based Anomaly Detection in Multivariate Time Seriescited by 300
- 2021DeepViT: Towards Deeper Vision Transformercited by 288
- 2021Escaping the Big Data Paradigm with Compact Transformerscited by 261
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Hypergraph Vision Transformers: Images are More than Nodes, More than Edgescited by 16
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Modelcited by 1
- 2026Structured Hyperedge Adaptation for Parameter-Efficient Fine-Tuning of Vision Transformerscited by 0
- 2026Structured Hyperedge Adaptation for Parameter-Efficient Fine-Tuning of Vision Transformers21 Jun 2026
- 2026Learning Label-Efficient Interpretable Medical Image Diagnosis via Semi-supervised Hypergraph Concept Bottleneck Model1 Jun 2026
- 2025Hypergraph Vision Transformers: Images are More than Nodes, More than Edges11 Apr 2025