Smooth on-line learning algorithms for hidden Markov models
- Creators
- Baldi, Pierre
- Chauvin, Yves
Abstract
A simple learning algorithm for Hidden Markov Models (HMMs) is presented together with a number of variations. Unlike other classical algorithms such as the Baum-Welch algorithm, the algorithms described are smooth and can be used on-line (after each example presentation) or in batch mode, with or without the usual Viterbi most likely path approximation. The algorithms have simple expressions that result from using a normalized-exponential representation for the HMM parameters. All the algorithms presented are proved to be exact or approximate gradient optimization algorithms with respect to likelihood, log-likelihood, or cross-entropy functions, and as such are usually convergent. These algorithms can also be casted in the more general EM (Expectation-Maximization) framework where they can be viewed as exact or approximate GEM (Generalized Expectation-Maximization) algorithms. The mathematical properties of the algorithms are derived in the appendix.
Additional Information
© 1994 Massachusetts Institute of Technology. Received January 8, 1993; accepted July 9, 1993. Posted Online April 10, 2008. We would like to thank David Haussler, Anders Krogh, Yosi Rinott, and Esther Levin for useful discussions. The work of P. B. is supported by grants from the AFOSR and the ONR.Attached Files
Published - BALnc94.pdf
Files
Name | Size | Download all |
---|---|---|
md5:a083e291c7cdc519c944ff2620e733dc
|
607.6 kB | Preview Download |
Additional details
- Eprint ID
- 13667
- Resolver ID
- CaltechAUTHORS:BALnc94
- Air Force Office of Scientific Research
- Office of Naval Research
- Created
-
2009-06-25Created from EPrint's datestamp field
- Updated
-
2021-11-08Created from EPrint's last_modified field