###### Information-Theory

## The Maximum Entropy Principle – The distribution with the maximum entropy is the distribution nature chooses

In a previous article entropy was defined as the expected number of bits in a binary number required to enumerate all the outcomes. This was expressed as follows: entropy= H(x)= In physics ( nature ) it is found that the probability distribution that represents a physical process is the Read more…