It was our use of probability theory as logic that has enabled us to do so easily what was impossible for those who thought of probability as a physical phenomenon associated with randomness. Quite the opposite we have thought of probability distributions as carriers of information.

Edwin Thompson Jaynes