Information Theroy Flashcards
1
Q
What is info?
A
Something that makes you aware of something you previously wasn’t (a measure of surprise)
2
Q
What is surprise?
A
the more unexpected an event is the more info it contains
3
Q
What are the 5 main parts of a communication system?
A
Source
Transmitter
Channel
Receiver
Destination
4
Q
What is bandwidth?
A
Range of frequency of signals. Caused by energy limitations of systems
5
Q
What is noise?
A
Unwanted signal fluxiations
6
Q
What is entropy(H)?
A
Iav
7
Q
What is information compression?
A
A way of reducing the time for a message to be sent
8
Q
How is this done?
A
By reducing redundancy
9
Q
What is Shannon’s first?
A
if noiseless, I transmitted = I recieved.
10
Q
What is Shannon’s second?
A
