conditional entropy

Hello, you have come here looking for the meaning of the word conditional entropy. In DICTIOUS you will not only get to know all the dictionary meanings for the word conditional entropy, but we will also tell you about its etymology, its characteristics and you will know how to say conditional entropy in singular and plural. Everything you need to know about the word conditional entropy you have here. The definition of the word conditional entropy will help you to be more precise and correct when speaking or writing your texts. Knowing the definition ofconditional entropy, as well as those of other words, enriches your vocabulary and provides you with more and better linguistic resources.

English

English Wikipedia has an article on:

conditional entropy

Noun

conditional entropy (plural conditional entropies)

(information theory) The portion of a random variable's own Shannon entropy which is independent from another, given, random variable.
The conditional entropy of random variable $Y$ given $X$ (i.e., conditioned by $X$ ), denoted as $H(Y|X)$ , is equal to $H(Y)-I(Y;X)$ where $I(Y;X)$ is the mutual information between $Y$ and $X$ .

Related terms

conditional probability

Wikious

Boobota

Sagapedia