chapter-ARIMA Modelyguyfvutđxrđ t7ftfvvhbgh
chapter-ARIMA Modelyguyfvutđxrđ t7ftfvvhbgh
ARCH−GARCH Models
CHAPTER CONTENTS
Introduction 310
The ARCH model 311
The GARCH model 321
Alternative specifications 323
Application: a GARCH model of UK GDP and the effect of
socio-political instability 338
Questions and exercises 342
LEARNING OBJECTIVES
After studying this chapter you should be able to:
1 Understand the concept of conditional variance.
2 Detect ‘calm’ and ‘wild’ periods in a stationary time series.
3 Understand the autoregressive conditional heteroskedasticity (ARCH) model.
4 Perform a test for ARCH effects.
5 Estimate an ARCH model.
6 Understand the GARCH model and the difference between the GARCH and ARCH
specifications.
7 Understand the distinctive features of the ARCH-M and GARCH-M models.
8 Understand the distinctive features of the TGARCH and EGARCH models.
9 Estimate all ARCH-type models using appropriate econometric software.
309
310 Time series econometrics
Introduction
Recent developments in financial econometrics have led to the use of models and tech-
niques that can model the attitude of investors not only towards expected returns but
also towards risk (or uncertainty). These require models that are capable of dealing
with the volatility (variance) of the series. Typical are the autoregressive conditional
heteroskedasticity (ARCH) family of models, which are presented and analysed in
this chapter.
Conventional econometric analysis views the variance of the disturbance terms
as being constant over time (the homoskedasticity assumption that was analysed in
Chapter 7). However, often financial and economic time series exhibit periods of
unusually high volatility followed by more tranquil periods of low volatility (‘wild’
and ‘calm’ periods, as some financial analysts like to call them).
Even from a quick look at financial data (see, for example, Figure 14.1, which
plots the daily returns of the FTSE-100 index from 1 January 1990 to 31 December
1999) we can see there are certain periods that have a higher volatility (and are there-
fore riskier) than others. This means that the expected value of the magnitude of the
disturbance terms may be greater at certain periods compared with others. In addition,
these riskier times seem to be concentrated and followed by periods of lower risk (lower
volatility) that again are concentrated. In other words, we observe that large changes
in stock returns seem to be followed by further large changes. This phenomenon is
what financial analysts call volatility clustering. In terms of the graph in Figure 14.1,
it is clear that there are subperiods of higher volatility; it is also clear that after 1997
the volatility of the series is much higher than it used to be.
Therefore, in such cases, it is clear that the assumption of homoskedasticity (or
constant variance) is very limiting, and in such instances it is preferable to examine
patterns that allow the variance to depend on its history. Or, to use more appropri-
ate terminology, it is preferable to examine not the unconditional variance (which
is the long-run forecast of the variance and can be still treated as constant) but the
conditional variance, based on our best model of the variable under consideration.
0.06
0.04
0.02
0.00
– 0.02
– 0.04
– 0.06
1/01/90 12/02/91 11/01/93 10/02/95 9/01/97 8/02/99
R_FTSE
Figure 14.1 Plot of the returns of FTSE-100, 1 January 1990 to 31 December 1999
Modelling the variance: ARCH–GARCH models 311
Yt = a + β Xt + ut (14.1)
Engle’s idea begins by allowing the variance of the residuals (σ 2 ) to depend on history,
or to have heteroskedasticity because the variance will change over time. One way to
allow for this is to have the variance depend on one lagged period of the squared error
terms as follows:
Yt = a + β Xt + ut (14.4)
ut | t ∼ iid N(0, ht )
ht = γ0 + γ1 u2t−1 (14.5)
where t is the information set. Here Equation (14.4) is called the mean equation
and Equation (14.5) the variance equation. Note that we have changed the nota-
tion of the variance from σt2 to ht . This is to keep the same notation from now
on, throughout this chapter. (The reason it is better to use ht rather than σt2 will
become clear through the more mathematical explanation provided later in the
chapter.)
The ARCH(1) model says that when a big shock happens in period t − 1, it is
more likely that the value of ut (in absolute terms because of the squares) will
also be bigger. That is, when u2t−1 is large/small, the variance of the next inno-
vation ut is also large/small. The estimated coefficient of γ1 has to be positive for
positive variance.
Therefore, the ARCH(q) model will simultaneously examine the mean and the variance
of a series according to the following specification:
Y t = a + β X t + ut (14.9)
ut | t ∼ iid N(0, ht )
q
ht = γ0 + γj u2t−j (14.10)
j=1
Again, the estimated coefficients of the γ s have to be positive for positive variance.
Yt = a + β Xt + ut (14.11)
by OLS as usual (note that the mean equation can also have, as explanatory variables in
the Xt vector, autoregressive terms of the dependent variable), to obtain the residuals
ût , and then run an auxiliary regression of the squared residuals (û2t ) on the lagged
squared terms (û2t−1 , . . . , û2t−q ) and a constant as in:
r_ftse c r_ftse(−1)
Test equation:
Dependent variable: RESID∧ 2
Method: least squares
Date: 12/26/03 Time: 15:27
Sample(adjusted): 1/02/1990 12/31/1999
Included observations: 2609 after adjusting endpoints
homoskedasticity, and conclude that ARCH(1) effects are present. Testing for higher-
order ARCH effects (for example order 6) the results appear as shown in Table 14.3.
This time the T ∗ R2 statistic is even higher (205.24), suggesting a massive rejection
of the null hypothesis. Observe also that the lagged squared residuals are all highly
statistically significant. It is therefore clear for this equation specification that an ARCH
model will provide better results.
To estimate an ARCH model, click on Estimate in the equation results window to
go back to the Equation Specification window (or in a new workfile, by clicking on
Quick/Estimate Equation to open the Equation Specification window) and this time
change the estimation method by clicking on the down arrow in the method setting
316 Time series econometrics
Test equation:
Dependent variable: RESID∧ 2
Method: least squares
Date: 12/26/03 Time: 15:31
Sample(adjusted): 1/09/1990 12/31/1999
Included observations: 2604 after adjusting endpoints
r_ftse c rftse(−1)
making sure that the ARCH-M part selects None, which is the default EViews case. For
the ARCH specification choose GARCH/TARCH from the drop-down Model: menu,
which is again the default EViews case, and in the small boxes type 1 for the Order
ARCH and 0 for the GARCH. The Threshold Order should remain at zero (which is
the default setting). By clicking OK the results shown in Table 14.4 will appear.
Note that it took ten iterations to reach convergence in estimating this model. The
model can be written as:
Variance equation
with values of z-statistics in parentheses. Note that the estimate of γ1 is highly signifi-
cant and positive, which is consistent with the finding from the ARCH test above. The
estimates of a and β from the simple OLS model have changed slightly and become
more significant.
To estimate a higher-order ARCH model, such as the ARCH(6) examined above,
again click on Estimate and this time change the Order ARCH to 6 (by typing 6 in
the small box) leaving 0 for the GARCH. The results for this model are presented in
Table 14.5.
Again, all the γ s are statistically significant and positive, which is consistent
with the findings above. After estimating ARCH models in EViews you can view
the conditional standard deviation or the conditional variance series by clicking on
the estimation window View/Garch Graphs/Conditional SD Graph or View/Garch
Graphs/Conditional Variance Graph, respectively. The conditional standard devia-
tion graph for the ARCH(6) model is shown in Figure 14.2.
You can also obtain the variance series from EViews by clicking on Procs/Make
GARCH Variance Series. EViews automatically gives names such as GARCH01,
GARCH02 and so on for each of the series. We renamed our obtained variance series
as ARCH1 for the ARCH(1) series model and ARCH6 for the ARCH(6) model. A plot of
these two series together is presented in Figure 14.3.
From this graph we can see that the ARCH(6) model provides a conditional vari-
ance series that is much smoother than that obtained from the ARCH(1) model.
This will be discussed more fully later. To obtain the conditional standard deviation
series plotted above, take the square root of the conditional variance series with the
following command:
Variance equation
A plot of the conditional standard deviation series for both models is presented in
Figure 14.4.
Y t = a + β X t + ut (14.15)
It is usual to treat the variance of the error term var(ut ) = σ 2 as a constant, but the vari-
ance can be allowed to change over time. To explain this more fully, let us decompose
the ut term into a systematic component and a random component, as:
ut = zt ht (14.16)
where zt follows a standard normal distribution with zero mean and variance one, and
ht is a scaling factor.
In the basic ARCH(1) model we assume that:
ht = γ0 + γ1 u2t−1 (14.17)
Modelling the variance: ARCH–GARCH models 319
0.025
0.020
0.015
0.010
0.005
1/01/90 11/01/93 9/01/97
Figure 14.2 Conditional standard deviation graph for an ARCH(6) model of the FTSE-100
0.0006
0.0005
0.0004
0.0003
0.0002
0.0001
0.0000
1/01/90 11/01/93 9/01/97
ARCH1 ARCH6
0.025
0.020
0.015
0.010
0.005
1/01/90 11/01/93 9/01/97
SD_ARCH1 SD_ARCH6
yt = a + β xt + zt γ0 + γ1 u2t−1 (14.18)
and from this expression it is easy to see that the mean of the residuals will be zero
(E(ut ) = 0), because E(zt ) = 0. Additionally, the unconditional (long-run) variance of
the residuals is given by:
γ0
var(ut ) = E z2t E(ht ) = (14.19)
1 − γ1
which means that we simply need to impose the constraints γ0 > 0 and 0 < γ1 < 1 to
obtain stationarity.
The intuition behind the ARCH(1) model is that the conditional (short-run) variance
(or volatility) of the series is a function of the immediate past values of the squared
error term. Therefore the effect of each new shock zt depends on the size of the shock
in one lagged period.
An easy way to extend the ARCH(1) process is to add additional, higher-order
lagged parameters as determinants of the variance of the residuals to change
Equation (14.17) to:
q
ht = γ0 + γj u2t−j (14.20)
j=1
Modelling the variance: ARCH–GARCH models 321
which denotes an ARCH(q) process. ARCH(q) models are useful when the variability
of the series is expected to change more slowly than in the ARCH(1) model. However,
ARCH(q) models are quite often difficult to estimate, because they frequently yield
negative estimates of the γj s. To resolve this issue, Bollerslev (1986) developed the idea
of the GARCH model, which will be examined in the next section.
Y t = a + β Xt + ut (14.21)
ut | t ∼ iid N(0, ht )
p q
ht = γ0 + δi ht−i + γj u2t−j (14.22)
i=1 j=1
which says that the value of the variance scaling parameter ht now depends both on
past values of the shocks, which are captured by the lagged squared residual terms, and
on past values of itself, which are captured by lagged ht terms.
It should be clear by now that for p = 0 the model reduces to ARCH(q). The simplest
form of the GARCH(p, q) model is the GARCH(1,1) model, for which the variance
equation has the form:
This model specification usually performs very well and is easy to estimate because it
has only three unknown parameters: γ0 , γ1 and δ1 .
ht = γ0 + δht−1 + γ1 u2t−1
···
γ0
= + γ1 u2t−1 + δu2t−2 + δ 2 γ1 u2t−3 + · · ·
1−δ
∞
γ0
= + γ1 δ j−1 u2t−j (14.24)
1−δ
j=1
which shows that the GARCH(1,1) specification is equivalent to an infinite order ARCH
model with coefficients that decline geometrically. For this reason, it is essential to
estimate GARCH(1,1) models as alternatives to high-order ARCH models, because with
the GARCH(1,1) there are fewer parameters to estimate and therefore fewer degrees
of freedom are lost.
r_ftse c rftse(−1)
making sure that within the ARCH-M part None is selected, which is the default in
EViews. For the ARCH/GARCH specification choose GARCH/TARCH from the drop-
down Model: menu, which is again the default EViews case, and in the small boxes
type 1 for the Order ARCH and 1 for the GARCH. It is obvious that for higher orders,
for example a GARCH(4,2) model, you would have to change the number in the small
boxes by typing 2 for the Order ARCH and 4 for the GARCH. After specifying the
number of ARCH and GARCH and clicking OK the required results appear. Table 14.6
presents the results for a GARCH(1,1) model.
Note that it took only five iterations to reach convergence in estimating this model.
The model can be written as:
Variance equation
with values of z-statistics in parentheses. Note that the estimate of δ is highly signifi-
cant and positive, as well as the coefficient of the γ1 term. Taking the variance series
for the GARCH(1,1) model (by clicking on Procs/Make GARCH Variance Series) it has
been renamed as GARCH11 and this series has been plotted together with the ARCH6
series to obtain the results shown in Figure 14.5.
From this we observe that the two series are quite similar (if not identical), because
the GARCH term captures a high order of ARCH terms as was proved earlier. Therefore,
again, it is better to estimate a GARCH instead of a high order ARCH model because of
its easier estimation and the least possible loss of degrees of freedom.
Changing the values in the boxes of the ARCH/GARCH specification to 6 in order
to estimate a GARCH(6,6) model, the results shown in Table 14.7 are obtained, where
the insignificance of all the parameters apart from the ARCH(1) term suggests that it is
not an appropriate model.
Similarly, estimating a GARCH(1,6) model gives the results shown in Table 14.8,
where now only the ARCH(1) and the GARCH(1) terms are significant; also some of
the ARCH lagged terms have a negative sign. Comparing all the models from both the
ARCH and the GARCH alternative specifications, we conclude that the GARCH(1,1) is
preferred, for the reasons discussed above.
Alternative specifications
There are many alternative specifications that could be analysed to model conditional
volatility, and some of the more important variants are presented briefly in this section.
(Berra and Higgins (1993) and Bollerslev et al. (1994) provide very good reviews of
these alternative specifications, while Engle (1995) collects some important papers in
the ARCH/GARCH literature.)
324 Time series econometrics
0.0006
0.0005
0.0004
0.0003
0.0002
0.0001
0.0000
1/01/90 11/01/93 9/01/97
ARCH6 GARCH1,1
Figure 14.5 Plots of the conditional variance series for ARCH(6) and GARCH(1,1)
Y t = a + β Xt + θ h t + ut (14.27)
ut | t ∼ iid N(0, ht )
p q
h t = γ0 + δi ht−i + γj u2t−j (14.28)
i=1 j=1
Another variant of the GARCH-M type model is to capture risk not through the
variance series but by using the standard deviation of the series having the following
specification for the mean and the variance equation:
Y t = a + β X t + θ h t + ut (14.29)
ut | t ∼ iid N(0, ht )
Modelling the variance: ARCH–GARCH models 325
Variance equation
p q
ht = γ0 + δi ht−i + γj u2t−j (14.30)
i=1 j=1
GARCH-M models can be linked with asset-pricing models such as the capital asset-
pricing models (CAPM) with many financial applications (for more, see Campbell et al.
1997; Hall et al. 1990).
Variance equation
r_ftse c rftse(−1)
and this time click on either Std.Dev or the Var selections from the ARCH-M part for
versions of the mean Equations (14.29) and (14.27), respectively.
For the ARCH/GARCH specification choose GARCH/TARCH from the drop-down
Model: menu, which is again the default EViews case, and in the small boxes specify
by typing the number of the q lags (1, 2, . . . , q) for the Order ARCH and the number of
p lags (1, 2, . . . , p) for the GARCH. Table 14.9 presents the results for a GARCH-M(1,1)
model based on the specification that uses the variance series to capture risk in the
mean equation, as given by Equation (14.27).
Note that the variance term (GARCH) in the mean equation is slightly significant
but its inclusion substantially increases the significance of the GARCH term in the
variance equation. Re-estimate the above model but this time clicking on the Std.Dev
from the ARCH-M part to include the conditional standard deviation in the mean
equation. The results are presented in Table 14.10, where this time the conditional
Modelling the variance: ARCH–GARCH models 327
Variance equation
Variance equation
where dt takes the value of 1 for ut < 0, and 0 otherwise. So ‘good news’ and ‘bad
news’ have different impacts. Good news has an impact of γ , while bad news has an
impact of γ + θ. If θ > 0 we conclude there is asymmetry, while if θ = 0 the news
impact is symmetric. TGARCH models can be extended to higher order specifications
by including more lagged terms, as follows:
q q
ht = γ0 + (γi + θi dt−i )u2t−i + δj ht−j (14.32)
i=1 j=1
r_ftse c rftse(−1)
Modelling the variance: ARCH–GARCH models 329
Variance equation
ensuring also that None was clicked in the ARCH-M part of the mean equation
specification.
For the ARCH/GARCH specification, choose GARCH/TARCH from the drop-down
Model: menu, and specify the number of q lags (1, 2, . . . , q) for the Order ARCH,
the number of p lags (1, 2, . . . , p) for the Order GARCH, and the Threshold Order
by changing the value in the box from 0 to 1 to have the TARCH model in action.
Table 14.11 presents the results for a TGARCH(1,1) model.
Note that because the coefficient of the (RESID < 0)∗ ARCH(1) term is positive and
statistically significant, indeed for the FTSE-100 there are asymmetries in the news.
Specifically, bad news has larger effects on the volatility of the series than good news.
q q p
ut−j ut−j
log(ht ) = γ + ζj + ξj + δi log(ht−i ) (14.33)
j=1 ht−j j=1 ht−j i=1
where γ , the ζ s, ξ s and δs are parameters to be estimated. Note that the left-hand side
is the log of the variance series. This makes the leverage effect exponential rather than
quadratic, and therefore the estimates of the conditional variance are guaranteed to
be non-negative. The EGARCH model allows for the testing of asymmetries as well
330 Time series econometrics
as the TGARCH. To test for asymmetries, the parameters of importance are the ξ s. If
ξ1 = ξ2 = · · · = 0, then the model is symmetric. When ξj < 0, then positive shocks
(good news) generate less volatility than negative shocks (bad news).
r_ftse c rftse(−1)
again making sure that None is clicked in the ARCH-M part of the mean equation spec-
ification.
For the ARCH/GARCH specification now choose EGARCH from the drop-down
Model: menu, and in the small boxes specify the number of the q lags (1, 2, . . . , q)
for the Order ARCH and the number of p lags (1, 2, . . . , p) for the GARCH. Table 14.12
presents the results for an EGARCH(1,1) model.
Variance equation