Maximum Entropy Relaxation for Graphical Model Selection given Inconsistent Statistics
Abstract
We develop a novel approach to approximate a specified collection of marginal distributions on subsets of variables by a globally consistent distribution on the entire collection of variables. In general, the specified marginal distributions may be inconsistent on overlapping subsets of variables. Our method is based on maximizing entropy over an exponential family of graphical models, subject to divergence constraints on small subsets of variables that enforce closeness to the specified marginals. The resulting optimization problem is convex, and can be solved efficiently using a primal-dual interiorpoint algorithm. Moreover, this framework leads naturally to a solution that is a sparse graphical model.
Additional Information
© 2007 IEEE. Date of Current Version: 17 September 2007.Attached Files
Published - 04301334.pdf
Submitted - cjw_mer_ssp07.pdf
Files
Name | Size | Download all |
---|---|---|
md5:5d3f21471909a304b36c451a1b061c3f
|
370.7 kB | Preview Download |
md5:4e41f70a6cbc70a8048caa097220ba81
|
395.5 kB | Preview Download |
Additional details
- Eprint ID
- 34769
- Resolver ID
- CaltechAUTHORS:20121009-080604998
- Created
-
2012-10-09Created from EPrint's datestamp field
- Updated
-
2021-11-09Created from EPrint's last_modified field