AttWalk: Attentive Cross-Walks for Deep Mesh Analysis
Not on the map. Why?
Abstract (arXiv)
Mesh representation by random walks has been shown to benefit deep learning. Randomness is indeed a powerful concept. However, it comes with a price: some walks might wander around non-characteristic regions of the mesh, which might be harmful to shape analysis, especially when only a few walks are utilized. We propose a novel walk-attention mechanism that leverages the fact that multiple walks are used. The key idea is that the walks may provide each other with information regarding the meaningful (attentive) features of the mesh. We utilize this mutual information to extract a single descriptor of the mesh. This differs from common attention mechanisms that use attention to improve the representation of each individual descriptor. Our approach achieves SOTA results for two basic 3D shape analysis tasks: classification and retrieval. Even a handful of walks along a mesh suffice for learning.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 42 of its 66 references that are in the map. First posted on arXiv 23 Apr 2021.
Builds on
42 of 66 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
30 more
- 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2020Exploring Self-attention for Image Recognitioncited by 313
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
- 2015Stacked Attention Networks for Image Question Answeringcited by 273
- 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
- 2015Deep Convolutional Networks on Graph-Structured Datacited by 246
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2019Local Relation Networks for Image Recognitioncited by 210
- 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
- 2018Point Convolutional Neural Networks by Extension Operatorscited by 154
- 2019Modeling Point Clouds with Self-Attention and Gumbel Subset Samplingcited by 151
- 2019DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processingcited by 104
- 2016Learning shape correspondence with anisotropic convolutional neural networkscited by 95
- 2018MeshNet: Mesh Neural Network for 3D Shape Representationcited by 95
- 2019SpiralNet++: A Fast and Highly Efficient Mesh Convolution Operatorcited by 89
- 2020MLCVNet: Multi-Level Context VoteNet for 3D Object Detectioncited by 80
- 2018Triplet-Center Loss for Multi-View 3D Object Retrievalcited by 69
- 2019PCAN: 3D Attention Map Learning Using Contextual Information for Point Cloud Based Retrievalcited by 68
- 2020Primal-Dual Mesh Convolutional Neural Networkscited by 44
- 2020DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshescited by 42
- 2020CNNs on Surfaces using Rotation-Equivariant Featurescited by 42
- 2018Multi-directional Geodesic Neural Networks via Equivariant Convolutioncited by 32
- 2016GIFT: A Real-time and Scalable 3D Shape Search Enginecited by 31
- 2018A Deeper Look at 3D Shape Classifierscited by 25
- 2019View N-gram Network for 3D Object Retrievalcited by 18
- 2018VERAM: View-Enhanced Recurrent Attention Model for 3D Shape Classificationcited by 12
- 2020Multiscale Mesh Deformation Component Analysis with Attention-based Autoencoderscited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 1; 2025: 1; 2026: 1.
5 papers.
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2024RayProNet: A Neural Point Field Framework for Radio Propagation Modeling in 3D Environmentscited by 4
- 2022Random Walks for Adversarial Meshescited by 3
- 2025Random Walks in Self-supervised Learning for Triangular Meshescited by 0
- 2026MME: Mixture of Mesh Experts with Random Walk Transformer Gatingcited by 0
- 2026MME: Mixture of Mesh Experts with Random Walk Transformer Gating28 Feb 2026
- 2025Random Walks in Self-supervised Learning for Triangular Meshes2 Mar 2025
- 2024RayProNet: A Neural Point Field Framework for Radio Propagation Modeling in 3D Environments4 Jun 2024
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspective27 Sep 2022
- 2022Random Walks for Adversarial Meshes15 Feb 2022