Memory capacity of networks with stochastic binary synapses.
Repository Usage Stats
In standard attractor neural network models, specific patterns of activity are stored in the synaptic matrix, so that they become fixed point attractors of the network dynamics. The storage capacity of such networks has been quantified in two ways: the maximal number of patterns that can be stored, and the stored information measured in bits per synapse. In this paper, we compute both quantities in fully connected networks of N binary neurons with binary synapses, storing patterns with coding level [Formula: see text], in the large [Formula: see text] and sparse coding limits ([Formula: see text]). We also derive finite-size corrections that accurately reproduce the results of simulations in networks of tens of thousands of neurons. These methods are applied to three different scenarios: (1) the classic Willshaw model, (2) networks with stochastic learning in which patterns are shown only once (one shot learning), (3) networks with stochastic learning in which patterns are shown multiple times. The storage capacities are optimized over network parameters, which allows us to compare the performance of the different models. We show that finite-size effects strongly reduce the capacity, even for networks of realistic sizes. We discuss the implications of these results for memory storage in the hippocampus and cerebral cortex.
Published Version (Please cite this version)10.1371/journal.pcbi.1003727
Publication InfoDubreuil, AM; Amit, Y; & Brunel, Nicolas (2014). Memory capacity of networks with stochastic binary synapses. PLoS Comput Biol, 10(8). pp. e1003727. 10.1371/journal.pcbi.1003727. Retrieved from http://hdl.handle.net/10161/15122.
This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.
More InfoShow full item record
Professor of Neurobiology
We use theoretical models of brain systems to investigate how they process and learn information from their inputs. Our current work focuses on the mechanisms of learning and memory, from the synapse to the network level, in collaboration with various experimental groups. Using methods fromstatistical physics, we have shown recently that the synapticconnectivity of a network that maximizes storage capacity reproducestwo key experimentally observed features: low connection proba