Can I read Gradient-based Neuromorphic Learning on Dynamical RRAM Arrays on EtoBox?

Gradient-based Neuromorphic Learning on Dynamical RRAM Arrays by Zhou, Peng; Eshraghian, Jason K.; Choi, Dong-Uk; Lu, Wei D.; Kang, Sung-Mo is a scholarly article available to read on EtoBox.

What is Gradient-based Neuromorphic Learning on Dynamical RRAM Arrays about?

We present MEMprop, the adoption of gradient-based learning to train fully memristive spiking neural networks (MSNNs). Our approach harnesses intrinsic device dynamics to trigger naturally arising voltage spikes. These spikes emitted by memristive dynamics are analog in nature, and thus fully differentiable, which eliminates the need for surrogate gradient methods that are prevalent in the spiking neural network (SNN) literature. Memristive neural networks typically either integrate memristors as synapses that map offline-trained networks, or otherwise rely on associative learning mechanisms to train networks of memristive neurons. We instead apply the backpropagation through time (BPTT) training algorithm directly on analog SPICE models of memristive neurons and synapses. Our implementation is fully memristive, in that synaptic weights and spiking neurons are both integrated on resistive RAM (RRAM) arrays without the need for additional circuits to implement spiking dynamics, e.g., analog-to-digital converters (ADCs) or thresholded comparators. As a result, higher-order electrophysical effects are fully exploited to use the state-driven dynamics of memristive neurons at run time.

Author

Zhou, Peng; Eshraghian, Jason K.; Choi, Dong-Uk; Lu, Wei D.; Kang, Sung-Mo

Published

2022

Language

EN