Time Series. Flashcards
Time series
A set of observations made at ordered time-points.
The index set
Time points at which the process is defined
State space
set of values that the random variables Xt may take
Aims of time series
- Draw inferences from time series 2. Examining the process generating the data 3. Forecasting
What is White Noise
- E(εt)=02. Cov(εt,εs) = σε iff t=0 else 0
Gaussian Stochastic process
All of its marginal distributions (any part of distribution) are Gaussian
What is Gaussian White Noise
If WN is also Gaussian
Are white noise shocks independent
White Noise shocks are only uncorrelated but not independent. Can have some dependents between absolute/squared shocks
Why is Gaussian WN is independent
Normally distributed random variables are uncorrelated if and only if they are independent
What is Random Walk
Xt=Xt-1+εt
Random walk with drift
Xt=a0+Xt-1+εt
Weak Stationarity
- Xt has finite moments of second order for all t in Z2. E(Xt) = E(Xs) for all t,s in R3. Cov(Xt, Xs) = Cov (Xt+h,Xs+h) for all h in NIn Words First/Second order process variables don’t depend on time
Strong stationarity
Joint distribution doesn’t depend on time For any consecutive m (from Z) and a lag h (from N) Xt1,…,Xtm and Xt1+h,…Xtm+h are identical
ACVF (AutoCoVariance Function)
γ(h)=Cov(Xt,Xt+h)
ACF (AutoCorrelation Function)
ρ(h)=Corr(Xt,Xt+h)
Properties of ACF and ACVF
- Positive semidefinite 2. Symmetric
What does it mean if an ACF or ACVF matrix is not positive semidefinite
Process is not stationary
What do ACF and ACVF measure
Degree of dependence among the values of a time series at different times
What is the general approach to Time Series Modelling
- Plot the series and examine the main features of the graph, checking in particular whether there is: a) trend b)seasonal component c)any apparent sharp changes in behaviour d)any outlying observations2. Remove the trend and seasonal components to get stationary residuals 3. Choose model to fit the residuals 4. Forecasting will be achieved by forecasting the residuals and the inverting any transformations to arrive at forecasts of the original series
Classical decomposition model
Xt=mt+st+Ytmt = trend functionst = seasonal componentYt=zero-mean random noise component
What are deterministic component/s (signal) and what are stochastic component/s in the Classical decomposition model
mt and st are signalYt is noise
What should do if Var increases
Apply preliminary transformations e.g. Log
If models with trend, but no seasonality (Xt = mt + Yt) how estimate trend
Method 1: Trend estimation:a)Nonparametric: 1. Moving Average 2. Exponential smoothing b)Model based:Fitting a polynomial trendMethod 2: Trend elimination by differencing
Constant Mean Model (CMM)
Xt = m + Yt where m is a constant. Big problem is that assigned weights are equal
What is the usual trade of between choosing large or small q
If mall - Faster reactionIf large - smaller variability
What method is used to estimate parameters in the polynomial trend model
Method of least squares
The lag-1 difference operator
∇Xt=Xt-Xt-1=(1-B)Xt
Backward shift operator
BXt=Xt-1
What is the problem of applying difference operator for a small sample size
Reduce sample size by 1 with each differencing
∇^2Xt
Xt-2Xt-1+Xt-2