Maximum Entropy Modelling of Mixture Distributions

Welcome:
Guest

Kybernetes

ISSN: 0368-492X

Online from: 1972

Subject Area: Electrical & Electronic Engineering

Content: Latest Issue | Latest Issue RSS | Previous Issues

Options: To add Favourites and Table of Contents Alerts please take a Emerald profile

Document Information:
Title:	Maximum Entropy Modelling of Mixture Distributions
Author(s):	Dimitris N. Politis, (Purdue University, West Lafayette, Indiana, USA)
Citation:	Dimitris N. Politis, (1994) "Maximum Entropy Modelling of Mixture Distributions", Kybernetes, Vol. 23 Iss: 1, pp.49 - 54
Keywords:	Image processing, Statistics
Article type:	Conceptual Paper
DOI:	10.1108/03684929410050577 (Permanent URL)
Publisher:	MCB UP Ltd
Abstract:	Shannon’s entropy is usually defined separately for discrete, and for (absolutely) continuous random variables. However, many random variables encountered in practice have mixed (discrete-continuous) distributions. A simple expression for the entropy of random variables with mixed (discrete-continuous) distributions is derived in terms of the usual entropy definitions. In addition, the maximum entropy problem in the general setting of mixture distributions is discussed.