Skip to content

Opening book details…

About this scholarly article

Hocus-Socus: An Error Catastrophe for Complex Hebbian Learning Implies Neocortical Proofreading by Cox, Kingsley J. A.; Adams, Paul R. is a scholarly article available to read on EtoBox.

The neocortex is widely believed to be the seat of intelligence and "mind". However, it's unclear what "mind" is, or how the special features of neocortex enable it, though likely "connectionist" principles are involved *A. The key to intelligence1 is learning relationships between large numbers of signals (such as pixel values), rather than memorizing explicit patterns. Causes (such as objects) can then be inferred from a learned internal model. These relationships fall into 2 classes: simple pairwise or second-order correlations (socs), and complex, and vastly more numerous, higher-order correlations (hocsB), such as the product of 3 or more pixels averaged over a set of images. Thus if 3 pixels correlate, they may give an "edge". Neurons with "Hebbian" synapses (changing strength in response to input-output spike-coincidences) are sensitive to such correlations, and it's likely that learned internal models use such neurons. Because output firing depends on input firing via the relevant connection strengths, Hebbian learning provides, in a feedback manner, sensitivity to input correlations. Hocs are vital, since they express "interesting" structure2 (e.g. edges), but their detect

Author
Cox, Kingsley J. A.; Adams, Paul R.
Published
2010
Language
EN