Shannon entropy

== English == === Etymology === Named after Claude Shannon, the "father of information theory". === Noun === Shannon entropy (countable and uncountable, plural Shannon entropies) information entropy ==== Related terms ==== joint entropy conditional entropy Shannon information === See also === mutual information