Week 1: Probability Flashcards
What is a random variable?
A function which assigns a number to events in the sample space.
What is the probability of a random variable taking a given value expressed as?
P(X = value)
In the case of continuous random variables, what is the probability of any given value?
Zero
What is a probability distribution?
A function that satisfies p(x) ≥ 0 and sums to one for discrete variables or integrates to one for continuous variables.
What does the cumulative distribution function (CDF) represent?
The probability that X is less than or equal to a given value.
How is the CDF related to the probability density function (PDF)?
p(x) = dF(x)/dx
What is the expectation of a random variable?
A weighted average where the weight of each event is equal to its probability.
What is the formula for the expected value in the discrete case?
E[f(X)] = Σ f(xk)p(xk)
What is the mean of a distribution?
The expectation of the random variable itself, µ = E[X]
What are moments of a distribution?
The expectation of powers of the random variable.
What does variance measure?
Dispersion based on the second moment.
How is variance calculated?
Var(X) = E[(X - µ)²]
What are skewness and kurtosis?
Skewness measures asymmetry; kurtosis measures tail weights.
What is the covariance of two random variables?
Cov(X, Y) = E[(X - µx)(Y - µy)] = E[XY] - µxµy
What does correlation measure?
The strength and direction of a linear relationship between two random variables.
What is the range of correlation coefficients?
-1 ≤ ρ(X, Y) ≤ 1
What characterizes a uniform distribution?
p(x) = 1 for x in [0, 1] and 0 otherwise.
What is the mean of a uniform distribution?
µ = 0.5
What defines a binomial distribution?
Two possible outcomes: success or failure, with parameters n (number of trials) and p (probability of success).
What is the probability mass function of a binomial distribution?
f(k; n, p) = (n choose k) * p^k * q^(n-k) where q = 1 - p.
What is the mean of a binomial distribution?
µ = np
What is a Gaussian distribution also known as?
Normal distribution
What parameters define a Gaussian distribution?
Mean (µ) and variance (σ²)
What is the probability density function of a Gaussian distribution?
p(x) = (1/(√(2πσ²))) * e^(-(x-µ)²/(2σ²))