Information Theory

An influential discipline involving the transmission of messages over channels where noise is present. Invented by ClaudeShannon at BellLabs in the 1940s (see http://galaxy.ucsd.edu/new/external/shannon.pdf for the original paper) it has been applied in endeavors as diverse as

• thermodynamics
• theoretical computer science
• CommunicationsTheory?
• theoretical biology
• learning theory & NeuralNetworks
• CostEstimation?

Also

• WhatIsEntropy
• http://masi.cscs.lsa.umich.edu/~crshalizi/notebooks/information-theory.html

---

CategoryExternalLink CategoryMath