Information, Communication, and Entropy

Define information in Shannon's mathematical sense and distinguish it from everyday usage.

Calculate the entropy of a simple discrete probability distribution.

Describe Shannon's model of a communication system and identify its components.

Explain the role of redundancy and noise in communication channels.

Relate Shannon's information theory to cybernetic concepts of communication and control.