| ECVision indexed and annotated bibliography of cognitive computer vision publications This bibliography was created by Hilary Buxton and Benoit Gaillard, University of Sussex, as part of ECVision Specific Action 8-1 The complete text version of this BibTeX file is available here: ECVision_bibliography.bib
T. Jebara and A. Pentland
ABSTRACT
Jensen’s inequality is a powerful mathematical tool and one of the workhorses in statistical learning. Its applications therein include the EM algorithm, Bayesian estimation and Bayesian inference. Jensen computes simple lower bounds on otherwise intractable quantities such as products of sums and latent log-likelihoods. This simplification then permits operations like integration and maximization. Quite often (i.e. in discriminative learning) upper bounds are needed as well. We derive and prove an efficient analytic inequality that provides such variational upper bounds. This inequality holds for latent variable mixtures of exponential family distributions and thus spans a wide range of contemporary statistical models. We also discuss applications of the upper bounds including maximumconditional likelihood, largemargin discriminativemodels and conditional Bayesian inference. Convergence, efficiency and prediction results are shown. 1 |
|
| Site generated on Friday, 06 January 2006
|