A Lightweight Transformer for Faster and Robust EBSD Data Collection
Not on the map. Why?
Abstract (arXiv)
Three dimensional electron back-scattered diffraction (EBSD) microscopy is a critical tool in many applications in materials science, yet its data quality can fluctuate greatly during the arduous collection process, particularly via serial-sectioning. Fortunately, 3D EBSD data is inherently sequential, opening up the opportunity to use transformers, state-of-the-art deep learning architectures that have made breakthroughs in a plethora of domains, for data processing and recovery. To be more robust to errors and accelerate this 3D EBSD data collection, we introduce a two step method that recovers missing slices in an 3D EBSD volume, using an efficient transformer model and a projection algorithm to process the transformer's outputs. Overcoming the computational and practical hurdles of deep learning with scarce high dimensional data, we train this model using only synthetic 3D EBSD data with self-supervision and obtain superior recovery accuracy on real 3D EBSD data, compared to existing methods.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 49 references that are in the map. First posted on arXiv 18 Aug 2023.
Builds on
23 of 49 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2020Reformer: The Efficient Transformercited by 1,668
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
11 more
- 2021Transformers in Vision: A Surveycited by 1,013
- 2020Efficient Transformers: A Surveycited by 790
- 2019Axial Attention in Multidimensional Transformerscited by 358
- 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
- 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
- 2019Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGANcited by 87
- 2023Transformers in Speech Processing: A Surveycited by 39
- 2023Understanding Masked Autoencoders via Hierarchical Latent Variable Modelscited by 39
- 2021AMMU : A Survey of Transformer-based Biomedical Pretrained Language Modelscited by 32
- 2021Decoupled Spatial-Temporal Transformer for Video Inpaintingcited by 28
- 2022Deep Unfolded Tensor Robust PCA with Self-supervised Learningcited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.