A METHOD FOR DIAGNOSTIC CHECKING OF TIME SERIES MODELS

Abstract. Suppose a tentative ARMA ( p, q )-model has been fitted to a stationary time series. A diagnostic check for this model is suggested, using the estimated cross correlation function (CCF) between the observed series and the residuals. The CCF may also indicate how the model can be improved. The method is applied to the Wolfer sunspot series. For AR ( p )-processes the asymptotic covariance matrix of the estimated cross correlations is obtained.     

DIAGNOSTIC CHECKING OF PERIODIC AUTOREGRESSION MODELS WITH APPLICATION

Abstract. An overview of model building with periodic autoregression (PAR) models is given emphasizing the three stages of model development:identification, estimation and diagnostic checking. New results on the distribution of residual autocorrelations and suitable diagnostic checks are derived. The validity of these checks is demonstrated by simulation. The methodology discussed is illustrated with an application. It is pointed out that the PAR approach to model development offers some important advantages over the more general approach using periodic autoregressive moving-average models.     

APPROXIMATE SIMULTANEOUS SIGNIFICANCE INTERVALS FOR RESIDUAL AUTOCORRELATIONS OF AUTOREGRESSIVE MOVING-AVERAGE TIME SERIES MODELS

Abstract. Bonferroni-type inequalities are used to approximate probabilities of the joint distribution of residual autocorrelation coefficients from an autoregressive moving-average time series model. The approximations are useful for testing the goodness of fit of the model:they can be used to find critical values of a test of whether the largest residual autocorrelation is significantly different from zero. The approximation based on the first-order Bonferroni inequality is simple to use and adequate in practice.     

Portmanteau tests for ARMA models with infinite variance

Abstract. Autoregressive and moving‐average (ARMA) models with stable Paretian errors are some of the most studied models for time series with infinite variance. Estimation methods for these models have been studied by many researchers but the problem of diagnostic checking of fitted models has not been addressed. In this article, we develop portmanteau tests for checking the randomness of a time series with infinite variance and for ARMA diagnostic checking when the innovations have infinite variance. It is assumed that least squares or an asymptotically equivalent estimation method, such as Gaussian maximum likelihood, is used. It is also assumed that the distribution of the innovations is identically and independently distributed (i.i.d.) stable Paretian. It is seen via simulation that the proposed portmanteau tests do not converge well to the corresponding limiting distributions for practical series length so a Monte Carlo test is suggested. Simulation experiments show that the proposed Monte Carlo test procedure works effectively. Two illustrative applications to actual data are provided to demonstrate that an incorrect conclusion may result if the usual portmanteau test based on the finite variance assumption is used.     

ON SOME AMBIGUITIES ASSOCIATED WITH THE FITTING OF ARMA MODELS TO TIME SERIES

Abstract. Examples are presented illustrating some ambiguities associated with the application of ARMA models to problems of signal extraction, multistep-ahead forecasting, spectrum approximation and linear quadratic control. Except in the signal extraction example, the ambiguities arise either from lack of sufficient autocovariance data to completely determine the process, or, often relatedly, from the approximate nature of the models used.     

A TEST FOR CONDITIONAL HETEROSKEDASTICITY IN TIME SERIES MODELS

Abstract. When testing for conditional heteroskedasticity and nonlinearity, the power of the test in general depends on the functional forms of conditional heteroskedasticity and nonlinearity that are allowed under the alternative hypothesis. We suggest a test for conditional heteroskedasticity and nonlinearity with the nonlinear autoregressive conditional heteroskedasticity model of Higgins and Bera as the alternative. Standard testing procedures are not applicable since our nonlinear autoregressive conditional heteroskedasticity (ARCH) parameter is not identified under the null hypothesis. To resolve this problem, we apply the procedure recently proposed by Davies. Power and size of the suggested test are investigated through simulation, and an empirical application of testing for ARCH in exchange rates is also discussed.     

SOME DOUBLY STOCHASTIC TIME SERIES MODELS

Abstract. We consider time series models obtained by replacing the parameters of autoregressive models by stochastic processes. Special attention is given to the problem of finding conditions for stationarity and to the problem of forecasting. For the first problem we are only able to obtain solutions in special cases, and the emphasis is on techniques rather than obtaining the most general results in each case. For the second problem more complete results are obtained by exploiting similarities with discrete time (nonlinear) filtering theory. The methods introduced are illustrated on two standard examples, one of state space type and one where the parameter process is a Markov chain.     

ESTIMATION FOR NON-LINEAR TIME SERIES MODELS USING ESTIMATING EQUATIONS

Godambe's (1985) theorem on optimal estimating equations for stochastic processes is applied to non-linear time series estimation problems. Examples are considered from the usual classes of non-linear time series models. A recursive estimation procedure based on optimal estimating equations is provided. It is also shown that pre-filtered estimates can be used to obtain the optimal estimate from a non-linear state-space model.     

ON THE SQUARED RESIDUAL AUTOCORRELATIONS IN NON-LINEAR TIME SERIES WITH CONDITIONAL HETEROSKEDASTICITY

Abstract. Time series with a changing conditional variance have been found useful in many applications. Residual autocorrelations from traditional autoregressive moving-average models have been found useful in model diagnostic checking. By analogy, squared residual autocorrelations from fitted conditional heteroskedastic time series models would be useful in checking the adequacy of such models. In this paper, a general class of squared residual autocorrelations is defined and their asymptotic distribution is obtained. The result leads to some useful diagnostic tools for statisticians using conditional heteroskedastic time series models. Some simulation results and an illustrative example are also reported.     

MARGINALS OF MULTIVARIATE FIRST-ORDER AUTOREGRESSIVE TIME SERIES MODELS

This paper is concerned with the marginal models associated with a given multivariate first-order autoregressive model. A general theory is developed to determine when reductions in the known orders of the marginal models will occur. When the auto-regressive coefficient matrix has repeated eigenvalues, there may be global reductions in the marginal models. Zeros in the eigenvectors and generalized eigenvectors of the auto-regressive coefficient matrix lead to local reductions in the marginal models. The case when the autoregressive parameter matrix has systematic zeros is also investigated.     

A JOINT PORTMANTEAU TEST FOR CONDITIONAL MEAN AND VARIANCE TIME‐SERIES MODELS

In this article, we propose a new joint portmanteau test for checking the specification of parametric conditional mean and variance functions of linear and nonlinear time‐series models. The use of a joint test is motivated for complete control of the asymptotic size since marginal tests for the conditional variance may lead to misleading conclusions when the conditional mean is misspecified. The new test is based on an asymptotically distribution‐free transformation on the sample autocorrelations of both normalized residuals and squared normalized residuals. This makes it unnecessary to full detail the asymptotic properties of the estimates used to obtain residuals, which could be inefficient two‐step ones, avoiding also choices of maximum lag parameters increasing with sample length to control asymptotic size. The robust versions of the new test also properly account for higher‐order moment dependence at a reduced cost. The finite‐sample performance of the new test is compared with that of well‐known tests through simulations.     

DIFFERENTIAL GEOMETRY OF ARMA MODELS

Abstract. A general approach for the development of a statistical inference on autoregressive moving-average (ARMA) models is presented based on geometric arguments. ARMA models are characterized as members of the curved exponential family. Geometric properties of ARMA models are computed and used to suggest parameter transformations that satisfy predetermined properties. In particular, the effect on the asymptotic bias of the maximum likelihood estimator of model parameters is illustrated. Hypothesis testing of parameters is discussed through the application of a modified form of the likelihood ratio test statistic.     

SOME ASPECTS OF THE PERFORMANCE OF DIAGNOSTIC CHECKS IN BIVARIATE TIME SERIES MODELS

Abstract. This paper is concerned with the use of score, or Lagrangian multiplier and portmanteau tests of fitted model adequacy in vector autoregressive-moving average processes. The relation between these alternative diagnostic checking devices is discussed from an asymptotic theoretic standpoint. Some finite sample properties of the tests are investigated in the context of bivariate models using Monte Carlo methods. Asymptotic theory is used to help determine the simulation design and also proves useful in appraising the experimental outcomes. The results provide evidence on the likely relative performance of the two procedures in practice and suggest that the score test is to be preferred.     

MULTIPLICATIVE EXPONENTIAL MODELS FOR STATIONARY TIME SERIES

Abstract. A class of models for one dimensional time series is presented. The spectrum of such a model is obtained by raising the spectrum of a known parameterized model to an exponent, allowed to attain arbitrary real values. For a moving average model this for example means that the roots of the moving average operator are allowed to have any real order. This method adds a further flexibility to the model which for example allows us to model long memory time series using only a few parameters. The exponent is parameterized in a special way to make the estimation of the parameter determining the exponent asymptotically independent of the estimation of the other model-parameters. The asymptotic distribution of the estimators is derived. The idea is also used for multiplicative models with an exponent for each seasonal factor. In this case the estimators are only approximately independent for a large season length. Finally an application of the model is given using the Beveridge wheat price index.     

MULTIPLE BILINEAR TIME SERIES MODELS

Abstract. A definition of multiple bilinear time series models is given. Sufficient conditions are obtained for the existence of strictly stationary solutions conforming to the model, and a brief discussion of the first and second order structure is included.     

THRESHOLD TIME SERIES MODELS AS MULTIMODAL DISTRIBUTION JUMP PROCESSES

Abstract. Recent contributions by Tong and others in modelling time series exhibiting threshold points have generally been based on approximating non-linear processes by piecewise linear time series models. In this paper we provide an alternative framework in which to model time series displaying jump behaviour by using a multimodal conditional distribution to capture the jump process. Each subordinate model of the distribution is determined by an autoregressive process, and jump behaviour occurs when the relative heights of the modes of the distribution change whilst the threshold points are identified by the antimodes of the distribution. This class of models is referred to as multipredictor autoregressive time series (MATS).     

FORECASTING TIME SERIES:A COMPARATIVE ANALYSIS OF ALTERNATIVE CLASSES OF TIME SERIES MODELS

Abstract. Performance of the state dependent model developed by Priestley is evaluated relative to that of bilinear and standard linear models using two well-known time series. The results indicate the use of broader classes of time series models beyond the conventional ARMA class is likely to lead to significant reductions in forecasting error. However, there are difficult problems relating to the identification of the order of the model, estimation of the parameters, and determination of the correct nonlinear model.     

NONPARAMETRIC ESTIMATORS FOR TIME SERIES

Abstract. Kernel multivariate probability density and regression estimators are applied to a univariate strictly stationary time series X _r We consider estimators of the joint probability density of X _t at different t -values, of conditional probability densities, and of the conditional expectation of functionals of X _v given past behaviour. The methods seem of particular relevance in light of recent interest in non-Gaussian time series models. Under a strong mixing condition multivariate central limit theorems for estimators at distinct points are established, the asymptotic distributions being of the same nature as those which would derive from independent multivariate observations.     

ON THE SELECTION OF SUBSET AUTOREGRESSIVE TIME SERIES MODELS

Abstract. The estimation of subset autoregressive time series models has been a difficult problem because of the large number of possible alternative models involved. However, with the advent of model selection criteria based on the maximum likelihood, subset model fitting has become feasible. Using an efficient technique for evaluating the residual variance of all possible subset models, a method is proposed for the fitting of subset autoregressive models. The application of the method is illustrated by means of real and simulated data.     

EFFICIENT METHOD OF MOMENTS ESTIMATORS FOR INTEGER TIME SERIES MODELS

The parameters of integer autoregressive models with Poisson, or negative binomial innovations can be estimated by maximum likelihood where the prediction error decomposition, together with convolution methods, is used to write down the likelihood function. When a moving average component is introduced this is not the case. To address this problem an efficient method of moment estimator is proposed where the estimated standard errors for the parameters are obtained using subsampling methods. The small sample properties of the estimator are investigated using Monte Carlo methods, while the approach is demonstrated using two well‐known examples from the time series literature.