mlsanityData to 7 Oct 2026

Learning-to-learn enables rapid learning with phase-change memory-based in-memory computing

arXiv 2405.05141 ↗First posted 22 Apr 2024cs.NE cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

There is a growing demand for low-power, autonomously learning artificial intelligence (AI) systems that can be applied at the edge and rapidly adapt to the specific situation at deployment site. However, current AI models struggle in such scenarios, often requiring extensive fine-tuning, computational resources, and data. In contrast, humans can effortlessly adjust to new tasks by transferring knowledge from related ones. The concept of learning-to-learn (L2L) mimics this process and enables AI models to rapidly adapt with only little computational effort and data. In-memory computing neuromorphic hardware (NMHW) is inspired by the brain's operating principles and mimics its physical co-location of memory and compute. In this work, we pair L2L with in-memory computing NMHW based on phase-change memory devices to build efficient AI models that can rapidly adapt to new tasks. We demonstrate the versatility of our approach in two scenarios: a convolutional neural network performing image classification and a biologically-inspired spiking neural network generating motor commands for a real robotic arm. Both models rapidly learn with few parameter updates. Deployed on the NMHW, they perform on-par with their software equivalents. Moreover, meta-training of these models can be performed in software with high-precision, alleviating the need for accurate hardware models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 57 references that are in the map. First posted on arXiv 22 Apr 2024.

Builds on

17 of 57 references.

References · 17

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2016Matching Networks for One Shot Learningcited by 2,246
  4. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  5. 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 566
  6. 2018Meta-Learning with Latent Embedding Optimizationcited by 476
  7. 2018Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rulescited by 64
  8. 2016One-shot Learning with Memory-Augmented Neural Networkscited by 60
  9. 2023Hardware-aware training for large-scale and diverse deep learning inference workloads using in-memory computing-based acceleratorscited by 42
  10. 2020Meta-learning in natural and artificial intelligencecited by 39
  11. 2020Robust High-dimensional Memory-augmented Neural Networkscited by 31
  12. 2020Brain-inspired global-local learning incorporated with neuromorphic computingcited by 28
5 more
  1. 2019Biologically inspired alternatives to backpropagation through time for learning in recurrent neural netscited by 20
  2. 2022In-memory Realization of In-situ Few-shot Continual Learning with a Dynamically Evolving Explicit Memorycited by 9
  3. 2023Online Spatio-Temporal Learning with Target Projectioncited by 9
  4. 2019Neuromorphic Hardware learns to learncited by 8
  5. 2022An MPSoC-based on-line Edge Infrastructure for Embedded Neuromorphic Robotic Controllerscited by 1

Built on by

Not cited yet.