Statistical Inference for Unified Garch–Itô Models with High‐Frequency Financial Data

The existing estimation methods for the model parameters of the unified GARCH–Itô model (Kim and Wang, 2014 ) require long period observations to obtain the consistency. However, in practice, it is hard to believe that the structure of a stock price is stable during such a long period. In this article, we introduce an estimation method for the model parameters based on the high‐frequency financial data with a finite observation period. In particular, we establish a quasi‐likelihood function for daily integrated volatilities, and realized volatility estimators are adopted to estimate the integrated volatilities. The model parameters are estimated by maximizing the quasi‐likelihood function. We establish asymptotic theories for the proposed estimator. A simulation study is conducted to check the finite sample performance of the proposed estimator. We apply the proposed estimation approach to the Bank of America stock price data.     

Estimation of GARCH Models from the Autocorrelations of the Squares of a Process

This paper shows how the parameters of a stable GARCH(1, 1) model can be estimated from the autocorrelations of the squared process. Specifically, the method applies a minimum distance estimator (MDE) to the sample autocorrelations of the squared realization. The asymptotic efficiency of the estimator is calculated from using the first g autocorrelations. The estimator can be surprisingly efficient for quite small numbers of autocorrelations and, in some cases, can be more efficient than the quasi maximum likelihood estimator (QMLE). Also, the estimated process can better fit the pattern of observed autocorrelations of squared returns than those from models estimated by maximum likelihood estimation (MLE). The estimator is applied to a series of hourly exchange rate returns, which are extremely non Gaussian.     

Simulation-based parameter estimation for complex models: a breast cancer natural history modelling illustration

Simulation-based parameter estimation offers a powerful means of estimating parameters in complex stochastic models. We illustrate the application of these ideas in the setting of a natural history model for breast cancer. Our model assumes that the tumor growth process follows a geometric Brownian motion; parameters are estimated from the SEER registry. Our discussion focuses on the use of simulation for computing the maximum likelihood estimator for this class of models. The analysis shows that simulation provides a straightforward means of computing such estimators for models of substantial complexity.     

Treating missing values in INAR(1) models: An application to syndromic surveillance data

Time-series models for count data have found increased interest in recent years. The existing literature refers to the case of data that have been fully observed. In this article, methods for estimating the parameters of the first-order integer-valued autoregressive model in the presence of missing data are proposed. The first method maximizes a conditional likelihood constructed via the observed data based on the k -step-ahead conditional distributions to account for the gaps in the data. The second approach is based on an iterative scheme where missing values are imputed so as to update the estimated parameters. The first method is useful when the predictive distributions have simple forms. We derive in full details this approach when the innovations are assumed to follow a finite mixture of Poisson distributions. The second method is applicable when there are no closed form expression for the conditional likelihood or they are hard to derive. The proposed methods are applied to a dataset concerning syndromic surveillance during the Athens 2004 Olympic Games.     

Change‐Point Detection in Autoregressive Models with no Moment Assumptions

In this paper we consider the problem of detecting a change in the parameters of an autoregressive process where the moments of the innovation process do not necessarily exist. An empirical likelihood ratio test for the existence of a change point is proposed and its asymptotic properties are studied. In contrast to other works on change‐point tests using empirical likelihood, we do not assume knowledge of the location of the change point. In particular, we prove that the maximizer of the empirical likelihood is a consistent estimator for the parameters of the autoregressive model in the case of no change point and derive the limiting distribution of the corresponding test statistic under the null hypothesis. We also establish consistency of the new test. A nice feature of the method is the fact that the resulting test is asymptotically distribution‐free and does not require an estimate of the long‐run variance. The asymptotic properties of the test are investigated by means of a small simulation study, which demonstrates good finite‐sample properties of the proposed method.     

Second-order properties of locally stationary processes

Abstract.  In this article, we investigate an optimal property of the maximum likelihood estimator of Gaussian locally stationary processes by the second-order approximation. In the case where the model is correctly specified, it is shown that appropriate modifications of the maximum likelihood estimator for Gaussian locally stationary processes is second-order asymptotically efficient. We also discuss second-order robustness properties.     

ESTIMATING THE ARCH PARAMETERS BY SOLVING LINEAR EQUATIONS

Abstract. This paper discusses the asymptotics of two-stage least squares estimator of the parameters of ARCH models. The estimator is easy to obtain since it involves solving two sets of linear equations. At the same time, the estimator has the same asymptotic efficiency as that of the widely used quasi-maximum likelihood estimator. Simulation results show that, even for small sample size, the performance of our estimator compared to the quasi-maximum likelihood estimator is better.     

Oracle M‐Estimation for Time Series Models

We propose a thresholding M‐estimator for multivariate time series. Our proposed estimator has the oracle property that its large‐sample properties are the same as of the classical M‐estimator obtained under the a priori information that the zero parameters were known. We study the consistency of the standard block bootstrap, the centred block bootstrap and the empirical likelihood block bootstrap distributions of the proposed M‐estimator. We develop automatic selection procedures for the thresholding parameter and for the block length of the bootstrap methods. We present the results of a simulation study of the proposed methods for a sparse vector autoregressive VAR(2) time series model. The analysis of two real‐world data sets illustrate applications of the methods in practice.     

A hierarchical zero-inflated log-normal model for skewed responses

Although considerable attention has been given to zero-inflated count data, research on zero-inflated lognormal data is limited. In this article, we consider a study to examine human sperm cell DNA damage obtained from single-cell electrophoresis (COMET assay) experiment in which the outcome measures present a typical example of log-normal data with excess zeros. The problem is further complicated by the fact that each study subject has multiple outcomes at each of up to three visits separated by six-week intervals. Previous methods for zero-inflated log-normal data are based on either simple experimental designs, where comparison of means of zero-inflated log-normal data across different experiment groups is of primary interest, or longitudinal measurements, where only one observation is available for each subject at each visit. Their methods cannot be applied when multiple observations per visit are possible and both inter- and intra-subject variations are present. Our zero-inflated model extends the previous methods by incorporating a hierarchical structure using latent random variables to take into account both inter- and intra-subject variations in zero-inflated log-normal data. An EM algorithm has been developed to obtain the Maximum likelihood estimates of the parameters and their standard errors can be estimated by parametric bootstrap. The model is illustrated using the COMET assay data.     

Bayesian analysis of switching ARCH models

We consider a time series model with autoregressive conditional heteroscedasticity that is subject to changes in regime. The regimes evolve according to a multistate latent Markov switching process with unknown transition probabilities, and it is the constant in the variance process of the innovations that is subject to regime shifts. The joint estimation of the latent process and all model parameters is performed within a Bayesian framework using the method of Markov chain Monte Carlo (MCMC) simulation. We perform model selection with respect to the number of states and the number of autoregressive parameters in the variance process using Bayes factors and model likelihoods. To this aim, the model likelihood is estimated by the method of bridge sampling. The usefulness of the sampler is demonstrated by applying it to the data set previously used by Hamilton and Susmel (1994 ) who investigated models with switching autoregressive conditional heteroscedasticity using maximum likelihood methods. The paper concludes with some issues related to maximum likelihood methods, to classical model selection, and to potential straightforward extensions of the model presented here.     

Local Likelihood for non‐parametric ARCH(1) models

Abstract. We propose a non‐parametric local likelihood estimator for the log‐transformed autoregressive conditional heteroscedastic (ARCH) (1) model. Our non‐parametric estimator is constructed within the likelihood framework for non‐Gaussian observations: it is different from standard kernel regression smoothing, where the innovations are assumed to be normally distributed. We derive consistency and asymptotic normality for our estimators and show, by a simulation experiment and some real‐data examples, that the local likelihood estimator has better predictive potential than classical local regression. A possible extension of the estimation procedure to more general multiplicative ARCH(p) models with p > 1 predictor variables is also described.     

Parameter estimation in batch process using EM algorithm with particle filter

This paper investigates a parameter estimation problem for batch processes through the maximum likelihood method. In batch processes, the initial state usually relates to the states of previous batches. The proposed algorithm takes batch-to-batch correlations into account by employing an initial state transition equation to model the dynamics along the batch dimension. By treating the unmeasured states and the parameters as hidden variables, the maximum likelihood estimation is accomplished through the expectation–maximization (EM) algorithm, where the smoothing for the terminal state and the filtering for the initial state are specially considered. Due to the nonlinearity and non-Gaussianity in the state space model, particle filtering methods are employed for the implementation of filtering and smoothing. Through alternating between the expectation step and the maximization step, the unknown parameters along with states are estimated. Simulation examples demonstrate the proposed estimation approach.     

Likelihood analysis of a first-order autoregressive model with exponential innovations

Abstract. This paper derives the exact distribution of the maximum likelihood estimator of a first-order linear autoregression with an exponential disturbance term. We also show that, even if the process is stationary, the estimator is T -consistent, where T is the sample size. In the unit root case, the estimator is T ²-consistent, while, in the explosive case, the estimator is ρ ^T -consistent. Further, the likelihood ratio test statistic for a simple hypothesis on the autoregressive parameter is asymptotically uniform for all values of the parameter.     

Nonlinear Factor-Augmented Predictive Regression Models with Functional Coefficients

This article introduces a new class of functional-coefficient predictive regression models, where the regressors consist of auto-regressors and latent factor regressors, and the coefficients vary with certain index variable. The unobservable factor regressors are estimated through imposing an approximate factor model on high dimensional exogenous variables and subsequently implementing the classical principal component analysis. With the estimated factor regressors, a local linear smoothing method is used to estimate the coefficient functions (with appropriate rotation) and obtain a one-step ahead nonlinear forecast of the response variable, and then a wild bootstrap procedure is introduced to construct the prediction interval. Under regularity conditions, the asymptotic properties of the proposed methods are derived, showing that the local linear estimator and the nonlinear forecast using the estimated factor regressors are asymptotically equivalent to those using the true latent factor regressors. The developed model and methodology are further generalized to the factor-augmented vector predictive regression with functional coefficients. Finally, some extensive simulation studies and an empirical application to forecast the UK inflation are given to examine the finite-sample performance of the proposed model and methodology.     

Estimation and testing for the parameters of ARCH(q) under ordered restriction

Abstract.  In this paper, we study a stationary ARCH( q ) model with parameters α ₀, α ₁, α ₂,…, α _q . It is known that the model requires all parameters α _i to be non-negative, but sometimes the usual algorithm based on Newton–Raphson's method leads us to obtain some negative solutions. So this study proposes a method of computing the maximum likelihood estimator (MLE) of parameters under the non-negative restriction. A similar method is also proposed for the case where the parameters are restricted by a simple order: α ₁≥ α ₂≥⋯≥ α _p . The strong consistency of the above two estimators is discussed. Furthermore, we consider the problem of testing homogeneity of parameters against the simple order restriction. We give the likelihood ratio (LR) test statistic for the testing problem and derive its asymptotic null distribution.     

On-line identification of interacting two-tank system

In order to demonstrate the effectiveness of the process identification algorithm, on-line parameter estimator is evaluated experimentally by using two-tank system with interaction. On-line parameter estimator used in this paper is based on a recursive parameter estimation algorithm. MIMO linear, bilinear and quadratic models based on ARMA model are used to identify two-tank system. A quadratic model for two-tank system with interaction is developed to confirm the propriety of MIMO quadratic model used in identification of two-tank system. The results of on-line identification experiments on the two-tank system show that the estimated parameters of each model converge and the output tracking errors are bounded by disturbance bound. But, the quadratic model showed the best convergence.     

Quasi‐Maximum Likelihood Estimation for a Class of Continuous‐time Long‐memory Processes

Tsai and Chan (2003) has recently introduced the Continuous‐time Auto‐Regressive Fractionally Integrated Moving‐Average (CARFIMA) models useful for studying long‐memory data. We consider the estimation of the CARFIMA models with discrete‐time data by maximizing the Whittle likelihood. We show that the quasi‐maximum likelihood estimator is asymptotically normal and efficient. Finite‐sample properties of the quasi‐maximum likelihood estimator and those of the exact maximum likelihood estimator are compared by simulations. Simulations suggest that for finite samples, the quasi‐maximum likelihood estimator of the Hurst parameter is less biased but more variable than the exact maximum likelihood estimator. We illustrate the method with a real application.     

ON THE PROBABILITY OF ESTIMATING A DETERMINISTIC COMPONENT IN THE LOCAL LEVEL MODEL

Abstract. A local level model has a deterministic level when the signal-to-noise ratio q is zero. In this paper we investigate the properties of the maximum likelihood estimator of q , paying particular attention to the case where its true value is zero. These properties are shown to be crucially dependent on the initial conditions employed.     

Robustness of Zero Crossing Estimator

Zero crossing (ZC) statistic is the number of zero crossings observed in a time series. The expected value of the ZC specifies the first‐order autocorrelation of the processes. Hence, we can estimate the autocorrelation by using the ZC estimator. The asymptotic consistency and normality of the ZC estimator for scalar Gaussian processes are already discussed in 1980. In this article, first, we derive the joint asymptotic distribution of the ZC estimator for ellipsoidal processes. Next, we show the variance of the ZC estimator does not attain the Cramer–Rao lower bound (CRLB). However, it is shown that the ZC estimator has robustness when the process is contaminated by an outlier. In contrast with this, we observe that the quasi‐maximum likelihood estimator (QMLE) attains the CRLB. However, we can see that QMLE is sensitive for the outlier.     

Estimation in nonstationary random coefficient autoregressive models

Abstract.  We investigate the estimation of parameters in the random coefficient autoregressive (RCA) model X _k  = ( φ  +  b _k ) X _{k −1} +  e _k , where ( φ ,  ω ²,  σ ²) is the parameter of the process,     ,     . We consider a nonstationary RCA process satisfying E  log | φ  +  b ₀| ≥ 0 and show that σ ² cannot be estimated by the quasi-maximum likelihood method. The asymptotic normality of the quasi-maximum likelihood estimator for ( φ ,  ω ²) is proven so that the unit root problem does not exist in the RCA model.