Re-Study Flashcards
In a long run, probability can be viewed as what?
The proportion of times an event happens, or its relative frequency.
What is a sample space?
A collection of all elementary results, or outcomes of an experiment.
What is an event?
Any set of outcomes, and a subset of the sample space.
A sample space of N possible outcomes yields how many possible events?
2n possible events.
What is the notation for the sample space?
The Capital Omega
What is the notation for the empty event?
Ø
What is the notation for the probability of the event E?
P{E}
A union of events A, B, C, is an event consisting of what? What word does this correspond to?
all the outcomes in all these events. It corresponds to the word or.
A complement of an event A is what? What word does it correspond to?
an event that occurs every time when A does not occur. It corresponds to the word not.
An intersection of events A, B, C… is what and corresponds to what word?
an event consisting of outcomes that are common in all these events. It occurs if each A, B, C, … occurs, and therefore corresponds to the word and.
A difference of events A and B consists of what, and corresponds to what phrase?
all outcomes included in A but excluded from B, and corresponds to the words “but not.” A but not B.
Events A and B are disjoint if
their interesection is empty
If any two events are disjoint in a set of events, they are?
Mutually exclusive
Another term for mutually exclusive
Pairwise disjoint
Events A B and C are exhaustive if
their union equals the whole sample space.
Occurrence of a mutually exclusive event does what?
Eliminates the chance of any other mutually exclusive event occuring.
A single event A and it’s compliment is a classical example of what?
A collection of disjoint, and exhaustive events.
If a collection of events is exhaustive then
One event must occur.
The compliment of a union of two events is
the intersection of the compliments of both events.
Notation for the difference of A and B
A/B
What is the sigma-algebra?
a collection of events whose probabilities we can consider in our problem.
What makes a collection of events a sigma-algebra on a sample space?
It includes the sample space.
It includes every event, and its compliment.
Every coutable collection of events in the sigma-algebra is contained along with their unions.
What is the minimal collection of a sigma-algebra?
The sample space, and the empty event.
What is the minimal collection of evens for a sigma-algebra known as?
The degenerate Sigma-algebra.
What is the power set of the sigma algebra, and what is its size?
The collection of all events and their unions. Its size is 2Omega
What is the sigma additivity problem?
for any finite or countable collection of mutually exclusive events, P{E1 U E2…..} = P(E1) + P(E2)…
What is the formal definition of probability?
Probability is a function of events with the domain sigma-algebra and the range [0,1] that satisfies the sigma-additive property, and the sample space has unit probability or P(sampel space) = 1.
What is the probability of an empty event?
0
The probability of an event is equal to what?
The sum of all of the mutually exclusive outcomes contained in that event.
Only what kind of events satisfy the Sigma-additivity property?
Mutually exclusive events.
How do you calculate the probability of events that are not mutually exclusive?
What is the compliment rule?
How do you calculate the probability of independent events?
When are events independent?
When the occurence of one event does not affect the probabilities of other events occuring.
What is the notation for the sigma algebra?
What is a random variable?
A variable that depends on chance.
What is a stochastic process?
A experiment model in which the random variables depend on time.
What is fundamental to correctly determining the likelihood of an experiment’s outcomes?
Precisely defining the experiment is fundament to determining
When can we say for certain the value of a random variable?
We can’t, we can only talk about the distribution or all possible values of a random variable with the likelihood of occurence.
What are the three interpretations of probability?
Classical, subjective or bayesian, and frequentist
What is the classical interpretation of probability?
We have an intuitive idea of probability and in some situations already know how to compute it. Such as rolling a 6 sided dice with equally likely outcomes.
What is the frequentist interpretation of probability?
We have an intuitive idea of probability in some situations that we do not compute on our own, but is based on past observations.
What is the subjective or Bayesian interpretation of probability?
Probability is a degree of belief. We have an intuitive idea of probability that may not fit the classical or frequentist interpretations.
What is an example of Bayesian interpretation of probability?
One in which the experiment can not be made, it is destructive. What is the probability of that bridge collapsing?
When do we say an event occurred?
When the outcome of an experiment is a member of that event.
An experiment will have how many outcomes?
Exactly one.
What does it mean that ¬A is relative to the sample space?
It means that ¬A includes everything in the sample space not in A.
What is the probability of each outcome when the sample space consists of n equally likely outcomes?
1/n
How is the probability of an event calculated?
(# of out comes in event)/(# of outcome in sample space) * for equally likely outcomes.
In reality most situations do not have what?
Do not have equally likely outcomes.
Equally likely outcomes are usually associated with the phrases
“fair game” or randomly selected.
Outcomes forming an event are often called what?
Favorable outcomes.
What does sampling with replacement mean?
means that every sampled item is replaced into the initial set, so that any of the objects can be selected with probability 1/n at any time.
What provides special techniques for the computation of favorable outcomes and total outcomes?
Combinatorics.
When sampling with replacement, the same object may what?
Be sampled more than once.
What does sampling without replacement mean?
every sampled item is removed from further sampling, so the set of possibilities reduces by 1 after each selection.
When are objects distinguishable?
if sampling of exactly the same objects in a different order yields a different outcome, that is, a different element of the sample.
When are objects indistinguishable?
if the order is not important, it only matters which objects are sampled and which ones are not. Indistinguishable objects arranged in a different order do not generate a new outcome.
What is an example of is an example of distinguishable objects without replacement?
A password.
How are permutations with replacement calculated?
Where n is the possible selections, and k is how many selections.
How are permutations calculated without replacement?
What are permutations?
Possible selections of k distinguishable objects from a set of n are called
How do you calculate combinations without replacement?
The numbe of permutations of k, n is equal to what?
the number of possible allocations of k distinguishable objects among n available slots.
What are combinations?
Possible selections of k indistinguishable objects from a set of n
What is an example of a combination?
An antivirus software reports that 3 folders out of 10 are infected, how many possibilities are there? Order in this case does not matter, A, B, C is the same outcome as B, A, C.
What is conditional probability?
event A given event B is the probability that A occurs when B is known to occur.
How is conditional probability denoted?
How is Conditional probability of A given B calculated?
How can Conditional probability of A given B be simplified to give us the probability of the general intersection?
How can independence be mathematically defined?
How do we know if events are independent?
If
is the probability of A given B equal to the probability of B given A?
What can be used to find
Bayes Rule
What is Bayes Rule?
What is independence?
Events A and B are independent if occurrence of B does not affect the probability of A
In the case of two conditional events A and B how is the probability of A calculated using the law of total probability?
How is Bayes rule for two events calculated using the law of total probability for A?
What is often used to calculate the denominator in Bayes Rule?
The law of total probability.
What does the law of total probability do?
It relates the unconditional probability of an event A with its conditional probabilities
When is law of total probability used?
when it is easier to compute conditional probabilities of A given additional information.
A random variable X is a function of what?
It is the function of an outcome σ of an experiment, X = f(σ), in other words it is a variable that depends on chance. We can not know what X is until an experiment has an outcome.
What is the domain of a random variable.
The sample space is its domain.
What is the range of a random variable?
It an be the set of all real number or any subset of the real numbers, only dependent on what values a random variable can take.
When working with a random variable X, what do we chart?
We chart all of the possible values x, and their corresponding probabilities.
What is known as the distribution of X?
The collection of all probabilities related to X.
What is the set of all possible values of X called?
The support of the distribution.
What is the cumulative distribution function?
What is the probability mass function of a value x?
What are discrete random variables?
variables whose range is finite or countable.
What A is an inteval from a to b, how can its probability be computed directly from the cumulative distributive property?
What is the set
exhaustive and mutually exclusive events for different pairs (x, y).
What is the addition rule for when using two random variables?
When are two random variables independent?
What are continuous random variables?
variables whose range assume a whole interval of values. This could be a bounded interval (a, b), or an unbounded interval .
Expected value is denoted with what?
What is the general formula for the expectation?
What is an example of a continous random variable?
A long jump is formally a continuous random variable because an athlete can jump any distance within some range.
How is the variance of a random variable calculated?
When does the variance equal zero?
What is the expectation of a random variable?
its mean, the average value
How is the correlation coefficient calculated?
What is Chebyshev’s inequality?
Suppose the number of error in a new software has Exp(X) = 20, and the standard deviation of 2, the probability of the software having more than 30 errors is
If X and Y are integers what can their expectations be?
Any real number.
What does expectation show?
where the average value of a random variable is located, or where the variable is expected to be, plus or minus some error.
How is the variability of a random variable’s value measured?
Measured by its distance from the Expectation.
How is standard deviaton denoted?
σ
How is standard deviation calculated?
It is the square root, +/-, of the Variance.
What is covariance?
summarizes interrelation of two random variables.
What does it mean if Cov(X, Y) = 0?
There is no correlation between the two variables.
What does the correlation coefficient do?
tells how strongly two variables are correlated, values near 1 indicate strong positive correlation, values near -1 show strong negative correlation, and values near 0 show weak correlation or no correlation.
For independent X and Y, Cov(X, Y) equals what?
It equals zero.
The probability of at least 2 is the compliment of what?
1 or less, at most 1
What is the probability of Event 1 and Event 2 when Event 2 is a member of Event 1
The probability is the probability of Event 2
What is a Bernoullie variable?
A random variable that can only take on two possible values, 0 and 1.
What is a Bernoulli trial?
An experiment with a binary outcome.
What are some examples of Bernoulli trials?
- Pass or fail tests
- Heads, or tails
- Boys or girls
What are the two generic names used for the outcomes of Bernoulli trials?
Successes and Failures; however successes do not have to be good and failures do not have to be bad.
In a Bernoulli distribution, if P(1) = p, what is P(0)?
1-p
The expectation of a Bernoulli trial is always what?
The proability of a success.
The variability of a Bernoulli variable is always what?
the product of the probabilities of succes and failure.
The number of Bernoulli trials needed to get the first success has what kind of distribution?
It has geometric distribution
What is an example of an experiment with geometric distribution?
A search engine goes through a list of sites looking for a given key phrase, and terminates as soon as the key phrase is found. The number of sites visited is geometric.
Geometric Random Variables can take what?
Any integer value from one to infinity
What is the probability mass function for a geometric distribution?
How is the probability of a Binomial distribution described?
How many success in n trials.
What kind of Variable has Binomial distribution?
A variable described as the number of successes in a sequence of independent Bernoulli trials.
What is the PMF of a Binomial distribution?
What do works like least and most usually mean?
They usually mean that the CDF should be sought for.
What table has the CDF of Binomial Distrubutions?
Table A2
What is the expectation of a binomial distribution?
np, where n is the number of trials.
What is the variance of a Binomial distribution?
npq, where q is 1-p
What is the geometric distribution?
What has negative binomial distribution
the number of trials needed to obtain k successes
What are Poissonian events?
events that are extremely unlikely to occur simultaneously or within a very short period of time.
Binomial varibles count what?
the number of successes in a fixed number of trials
Negative Binomial variables count what?
the number of trials needed to see a fixed number of successes.
What is the Poisson distibution?
What has Poisson distibution?
The numer of rare events occuring within a fixed period of time
What are examples of Poissonian events?
traffic accidents, arrivals of jobs, telephone calls, virus attacks, floods, and earthquakes.
What table has the values of CDFS of Poissonian distributions?
Table A3
If the period of time changes in a problem using Poisson distribution what needs to be adjusted?
only the frequency to what the average would be over the new time period.
what is the Expectation of a negative binomial distribution?
k/p where k is how many successes
What is the variance of a negative binomial distribution?
How do you calculate the PMF of a negative binomial distribution? part 1
How do you calculate the PMF of a negative binomial distribution? part 2
How do you calculate the PMF of a negative binomial distribution? part 3
What is Poisson Approximation of a Binomial distribution?
For all continuous variables, P(x) = ?
zero.
In both continuous and discrete cases, the CDF is what?
a non-decreasing function that ranges from 0 to 1.
What is different about the CDF with continuous variables from discrete variables?
The CDF is a continuous function, and there are no jumps in the CDF.
With continuous variables, probabilities are what?
Areas under a density curve.
What is the probability density function?
A derivative of the CDF, f(x) = F’(X)
What is the total area under a pdf equal to?
The total area under a pdf is equal to 1.
What are the four families of continuous distributions discussed in this chapter?
Uniform, Exponential, Gamma, and Normal.
When is Uniform distribution used?
In any situation when a value is picked at random from a given interval.
Uniform distribution has constant what?
Density.
What is the density function for uniform distribution?
f(x) = 1/(b-a)
What must be true for use of a Uniform distribution?
|b-a| must be a finite countable number
What does [a, b] represent in uniform distribution?
the domain of the uniform density function.
What is an example of a situation with uniform density?
If a flight is scheduled to arrive at 5pm actually arrives at a Uniformly distributed time between 4:50 and 5:10, then it is equally likely to arrive before five and after five.
What is the uniform property?
the probability is only determined by the length of the interval, not by its location.
How is the variance of a continuous random variable calculated?
\int x^2f(x)dx - E(x)^2
How is the expectation of a continuous variable calculated?
\int xf(x)dx
What is the Uniform Distribution?
What is exponential distribution often used for?
To model time.
What are some examples of exponential distributions?
waiting time, interarrival time, hardware lifetime
When is the time between events exponential?
when the number of events is Poisson
if X is time, measured in minutes, what is lambda?
The frequency, number in a time.
If arrival occurs every half minute what is the expectation?
E(X), so it is .5, we expect to get one every .5 minutes.
If arrivals occur every half a minute what is lambda?
lambda is 1/.5, so 2.
What does it mean that Exponential variables are memoryless?
It means that having waited for t minutes gets “forgotten,” and does not affect the future waiting time.