Information entropy

Entropy is a concept in thermodynamics (see thermodynamic entropy), statistical mechanics and information theory. The concepts of information and entropy have deep links with one another, although it took many years for the development of the theories of statistical mechanics and information theory to make this apparent. This article is about information entropy, the information-theoretic formulation of entropy.

Related Topics:
Thermodynamics - Thermodynamic entropy - Statistical mechanics - Information theory - Entropy

~ ~ ~ ~ ~ ~ ~ ~ ~ ~