mlsanityData to 7 Oct 2026

A Self-Supervised Robotic System for Autonomous Contact-Based Spatial Mapping of Semiconductor Properties

arXiv 2411.09892 ↗First posted 15 Nov 2024cs.RO cond-mat.mtrl-sci cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Integrating robotically driven contact-based material characterization techniques into self-driving laboratories can enhance measurement quality, reliability, and throughput. While deep learning models support robust autonomy, current methods lack reliable pixel-precision positioning and require extensive labeled data. To overcome these challenges, we propose an approach for building self-supervised autonomy into contact-based robotic systems that teach the robot to follow domain expert measurement principles at high-throughputs. Firstly, we design a vision-based, self-supervised convolutional neural network (CNN) architecture that uses differentiable image priors to optimize domain-specific objectives, refining the pixel precision of predicted robot contact poses by 20.0% relative to existing approaches. Secondly, we design a reliable graph-based planner for generating distance-minimizing paths to accelerate the robot measurement throughput and decrease planning variance by 6x. We demonstrate the performance of this approach by autonomously driving a 4-degree-of-freedom robotic probe for 24 hours to characterize semiconductor photoconductivity at 3,025 uniquely predicted poses across a gradient of drop-casted perovskite film compositions, achieving throughputs over 125 measurements per hour. Spatially mapping photoconductivity onto each drop-casted film reveals compositional trends and regions of inhomogeneity, valuable for identifying manufacturing process defects. With this self-supervised CNN-driven robotic system, we enable high-precision and reliable automation of contact-based characterization techniques at high throughputs, thereby allowing the measurement of previously inaccessible yet important semiconductor properties for self-driving laboratories.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 66 references that are in the map. First posted on arXiv 15 Nov 2024.

Builds on

13 of 66 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  4. 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
  5. 2021Dynamic Neural Networks: A Surveycited by 405
  6. 2023Fast Segment Anythingcited by 286
  7. 2017A General and Adaptive Robust Loss Functioncited by 236
  8. 2020The Computational Limits of Deep Learningcited by 188
  9. 2017Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networkscited by 108
  10. 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
  11. 2022Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEscited by 58
  12. 2013Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robotscited by 56
1 more
  1. 2023Using Scalable Computer Vision to Automate High-throughput Semiconductor Characterizationcited by 3

Built on by

Not cited yet.