Entropy

Average amount of information that you get from a message. https://youtu.be/ErfnhcEV1O8?t=240

• Cross Entropy
• Negative Entropy