Test Flashcards
What is an outcome or an elementary event?
- one of the possible things that can happen.
For example, suppose that we are interested in the (UK) shoe size of the next customer to come into a shoe shop. Possible outcomes: “eight” “twelve” “nine and a half”
In any experiment, one, and only one, outcome occurs.
What is the sample space
- the set of all possible outcomes. For example, it could be the set of all shoe sizes
What does mutually exclusive mean?
Two events are said to be mutually exclusive if both cannot
occur simultaneously: The outcomes success and failure are mutually exclusive.
What does it mean if 2 events are independent?
Two events are said to be independent if the occurrence of
one does not affect the probability of the second occurring.
For example, if you toss a coin and look out of the window, it
would be reasonable to suppose that the events “get heads”
and “it is raining” would be independent.
There are three main ways in which we can measure
probability:
- The classical interpretation
- The frequentist interpretation
- The subjective or Bayesian interpretation
The Classical Interpretation
When do we use it?
Example?
What is the underlying idea behind the view?
What probability do the outcomes have?
What is the general equation?
If all possible outcomes are “equally likely” then we can adopt the classical approach to measuring probability.
For example, if we tossed a fair coin, there are only two
possible outcomes – a head or a tail – both of which are equally likely
The underlying idea behind this view of probability is
symmetry.
In this example, there is no reason to think that the outcome
Head and the outcome Tail have different probabilities and so they should have the same probability.
Since there are two outcomes and one of them must occur,
both outcomes must have probability 1/2.
Generally,
P (Event) = Total number of outcomes in which event occurs/Total number of possible outcomes
The frequentist approach
When do we use it?
What do we do?
Example?
What 2 factors do we use?
What is the general equation?
When the outcomes of an experiment are not equally likely, we can conduct experiments to give us some idea of how likely the different outcomes are.
For example, suppose we were interested in measuring the
probability of producing a defective item in a manufacturing
process.
- Monitor the process over a long period
- Calculate the proportion of defective items
However what constitutes a “long period of time”?
Generally,
P(Event) = Number of times an event occurs/Total number of times experiment done
The Subjective/Bayesian interpretation
Examples?
Difference between this and the frequentist interpretation?
When we board a plane, we judge the probability of it
crashing to be sufficiently small that we are happy to
undertake the journey.
Similarly, the odds given by bookmakers on a horse race
reflect people’s beliefs about which horse will win.
This probability does not fit within the frequentist definition as the same race cannot be run a large number of times.
Laws of Probability: Multiplication law
The probability of two independent events E1 and E2 both
occurring can be written as…
And it is known as?
The probability of two independent events E1 and E2 both
occurring can be written as…
P(E1 and E2) = P(E1) × P(E2),
and this is known as the multiplication law of probability.
Laws of probability: Addition Law
What does it describe?
The addition law for two events E1 and E2 is
What is the more basic version and when can we use it?
Why can we use that?
The addition law describes the probability of any of two or
more events occurring.
The addition law for two events E1 and E2 is
P(E1 or E2) = P(E1) + P(E2) − P(E1 and E2)
A more basic version of the rule works where events are
mutually exclusive.
If events E1 and E2 are mutually exclusive then
P(E1 or E2) = P(E1) + P(E2)
This simplification occurs because when two events are
mutually exclusive they cannot happen together and so
P(E1 and E2) = 0.
The binomial distribution
What is the probability of rolling a dice three times
What about the probability that we get two sixes — i.e. P (X = 2)?
Each roll of the dice is an experiment or trial which gives a “six” (success, or s) or “not a six” (failure, or f ). The probability of a success is p = P (six) = 1/6. We have n = 3 independent experiments or trials (rolls of the dice). Let X be the number of sixes obtained.
We can now obtain the full probability distribution of X; a probability distribution is a list of all the possible outcomes for X with along with their associated probabilities.
For example, suppose we want to work out the probability of obtaining three sixes (three “successes” — i.e. sss — or P (X = 3)). Since the rolls of the die can be considered independent, we get
P (sss) = P (s) × P (s) × P (s) = 1/6 × 1/6 × 1/6 = (1/6)^3
That one’s easy! What about the probability that we get two sixes — i.e. P (X = 2)?
This one’s a bit more tricky, because that means we need two s’s and one f — i.e. two sixes and one “not six” — but the “not six” could appear on the first roll, or the second roll, or the third! Thinking about it, there are actually eight possible outcomes for the three rolls of the die
Experiment
An experiment is an activity where we do not know for certain what will happen, but we will observe what happens.
Event
An event is a set of outcomes. For example “the shoe size of the next customer is less than 9” is an event. It is made up of all of the outcomes where the shoe size is less than 9. Of course an event might contain just one outcome.
Random variables (definition)
The quantities measured in a study
Data (definition)
A collection of such observations
Observation (definition)
A particular outcome