Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published 1988 | Published
Book Section - Chapter Open

Connectivity Versus Entropy

Abstract

How does the connectivity of a neural network (number of synapses per neuron) relate to the complexity of the problems it can handle (measured by the entropy)? Switching theory would suggest no relation at all, since all Boolean functions can be implemented using a circuit with very low connectivity (e.g., using two-input NAND gates). However, for a network that learns a problem from examples using a local learning rule, we prove that the entropy of the problem becomes a lower bound for the connectivity of the network.

Additional Information

© 1988 AIP.

Attached Files

Published - 63-connectivity-versus-entropy.pdf

Files

63-connectivity-versus-entropy.pdf
Files (1.3 MB)
Name Size Download all
md5:878966dc4d2557984982e1915f414944
1.3 MB Preview Download

Additional details

Created:
August 19, 2023
Modified:
October 25, 2023