Advertisement

Information Inequalities

  • Raymond W. Yeung
Chapter
  • 595 Downloads
Part of the Information Technology: Transmission, Processing and Storage book series (PSTE)

Abstract

An information expression f refers to a linear combination1 of Shannon’s information measures involving a finite number of random variables. For example,
$$H(X,Y) + 2I(X;Z)$$
(12.1)
and
$$I(X;Y) - I(X;Y|Z)$$
(12.2)
are information expressions. An information inequality has the form
$$f \geqslant c,$$
(12.3)
where the constant c is usually equal to zero.

Keywords

Joint Distribution Canonical Form Full Rank Conditional Independency Information Expression 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media New York 2002

Authors and Affiliations

  • Raymond W. Yeung
    • 1
  1. 1.The Chinese University of Hong KongHong Kong

Personalised recommendations