Information-Theory

What is Entropy?

There are many mathematical definitions of entropy.  The mental picture I find most useful is to imagine the following:   you are put in a room and your job is to label everything in the room with a sharpy indelible marker and masking tape.   You are asked to label everything in Read more…

By Fudgy McFarlen, ago