Information Theory
  The linear model of communication              
Info Source-Message-Transmitter-Signal-Noise Source-Receive Signal-Reciever-Message-Destination
 

Information
The amount of uncertainty a message eliminates
      =
Opportunity to Reduce Uncertainty
      =
Reducing Entropy
A measure of the degree or randomness, chaos,
and disorde
 

NOISE
Definition: Noise is anything added to
the signal that’s not intended by
the source.
Purpose: Noise reduces information by
increasing uncertainty.
Question: What are some examples of noise?

REDUNDANCY
Definition: Predictability or repetition
of the message.
Purpose: Reduces loss of information
due to noise.
Question: Where does redundancy fall on the linear model

Norbert Weiner’s concept of  FEEDBACK
Definition: A method of adjusting future
action by analysis of past performance
Purpose: Feedback adds the concept of
learning to information theory.
Question: Where does feedback fall on the linear model

Application Questions