Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published June 1991 | Published
Book Section - Chapter Open

Objective Functions For Neural Network Classifier Design

Abstract

Backpropagation was originally derived in the context of minimizing a mean-squared error (MSE) objective function. More recently there has been interest in objective functions that provide accurate class probability estimates. In this talk we derive necessary and sufficient conditions on the required form of an objective function to provide probability estimates. This leads to the definition of a general class of functions which includes MSE and cross entropy (CE) as two of the simplest cases. We establish the equivalence of these functions to Maximum Likelihood estimation and the more general principle of Minimum Description Length models. Empirical results are used to demonstrate the tradeoffs associated with the choice of objective functions which minimize to a probability.

Additional Information

© 1991 IEEE. The research described in this talk was carried out in part by the Jet Propulsion Laboratories, California Institute of Technology, under a contract with the National Aeronautics and Space Administration. In addition this work was supported in part by the Air Force Office of Scientific Research under grant number AFOSR-90-0199.

Attached Files

Published - 00695143.pdf

Files

00695143.pdf
Files (142.6 kB)
Name Size Download all
md5:7143adf44827bdca95c4fea8f5368ef2
142.6 kB Preview Download

Additional details

Created:
August 20, 2023
Modified:
October 26, 2023