Quantifying information

Question 1

How is information measured?

Answer 1

Information is measured by unexpectedness or surprise; an unexpected event has a
low probability of occurrence.

Question 2

The equation for the relationship between prob of an event and Infomation?

Answer 2

Question 3

The equation for the measure of information?

Answer 3

Question 4

The equation for information when there are different probabilities?

Answer 4

Question 5

The equation for average information(Entropy)?

Answer 5

Question 6

Entropy equation?

Answer 6

Question 7

Define information rate?

Answer 7

Question 8

When will the information rate be at a maximum?

Answer 8

when a binary signal (with equiprobable symbols) is transmitted, units bits
per second (b/s)

Question 9

The unit Shannon?

Answer 9

The same as bits per second. (b/s)

Question 10

What is an anti-aliasing filter?

Question 11

Describe the channel capacity?

Answer 11

Given an ideal low-pass channel with bandwidth B the maximum rate at which pulses
can be transmitted is 2B pulses per second. If Q equiprobable pulse levels (symbols)
are discernible at the channel output, then information can be transmitted through the
channel at a rate given by the channel capacity

Question 12

The equation for channel capacity?

Answer 12

C = 2B log₂ Q binits/s

Question 13

The equation for the Shannon Hartley law?

Answer 13

Question 14

The equation for code efficiency?

Answer 14

Question 15

The equation for redundancy?

Answer 15