Information Inequalities

• Raymond W. Yeung
Chapter
Part of the Information Technology: Transmission, Processing and Storage book series (PSTE)

Abstract

An information expression f refers to a linear combination1 of Shannon’s information measures involving a finite number of random variables. For example,
$$H(X,Y) + 2I(X;Z)$$
(12.1)
and
$$I(X;Y) - I(X;Y|Z)$$
(12.2)
are information expressions. An information inequality has the form
$$f \geqslant c,$$
(12.3)
where the constant c is usually equal to zero.

Keywords

Joint Distribution Canonical Form Full Rank Conditional Independency Information Expression
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.