Can I read Online Training of Hopfield Networks using Predictive Coding on EtoBox?

Online Training of Hopfield Networks using Predictive Coding by Ganjidoost, Ehsan; Snow, Mallory; Orchard, Jeff is a scholarly article available to read on EtoBox.

What is Online Training of Hopfield Networks using Predictive Coding about?

Neuroscience and Artificial Intelligence (AI) have progressed in tandem, each contributing to our understanding of the brain, and inspiring recent developments in biologically-plausible neural networks (NNs) and learning rules. Predictive coding (PC), and its learning rule, have been shown to approximate error backpropagation in a biologically relevant manner, with local weight updates that depend only on the activity of the pre- and post-synaptic neurons. Unlike traditional feedforward NNs where the flow of information goes in one direction, PC models mimic the brain more accurately by passing information bidirectionally: prediction in one direction, and correction/error in the other. PC models learn by clamping some neurons to target values and running the network to equilibrium. At equilibrium, the network calculates its own error gradients right at the location where they are used for weight updates. Traditional backprop requires the computation graph to be feedforward. However, the PC version of backprop does not have this requirement. Amazingly, no one has demonstrated the application of PC learning directly to recurrent neural networks (RNNs). Hopfield networks (HNs) are RNN

Author

Ganjidoost, Ehsan; Snow, Mallory; Orchard, Jeff

Published

2024

Language

EN