William Poundstone Inspirational Quotes (26)

The more improbable the message, the less compressible it is, and the more bandwidth it requires. This is Shannon's point: the essence is its improbability.

Use entropy and you can never lose a debate, von Neumann told Shannon - because no one really knows what entropy is.