Information theory Flashcards
1
Q
What is information theory?
A
It is the mathematical study of the coding of information
in the form of sequences of symbols, impulses, etc., and
of how rapidly and reliably such information can be
transmitted via a communiacation channel.
2
Q
Probability
A
- frequency of outcomes in random experiments
- degree of belief is a certain proposition
- a formula???
3
Q
An ensemble X is ….
A
- a triple (x, Ax, Px), where the outcome x is the value of a random variable, which takes on one of the sets possible values.
4
Q
A joint ensemble XY is …
A
- an ensemble in which each outcome is and ordered pair x,y
