Publication: Parameter Estimation Error in Tests of Predictive Performance under Discrete Loss Functions
Loading...
Files
Official URL
Full text at PDC
Publication Date
2014-07
Advisors (or tutors)
Editors
Journal Title
Journal ISSN
Volume Title
Publisher
Citations
Exportar
Abstract
We analyze the effect of parameter estimation error on the size of unconditional population level tests of predictive ability when they are implemented under a class of loss functions we refer to as ‘discrete functions’. The analysis is restricted to linear models in stationary variables. We obtain analytical results for no nested models guaranteeing asymptotic irrelevance of parameter estimation error under a plausible predictive environment and three subsets of discrete loss functions that seem quite appropriate for many economic applications. For nested models, we provide some Monte Carlo evidence suggesting that the asymptotic distribution of the Diebold and Mariano (1995) test is relatively robust to parameter estimation error in many cases if it is implemented under discrete loss functions, unlike what happens under the squared forecast error or the absolute value error loss functions.
Description
UCM subjects
Unesco subjects
Keywords
Citation
Blaskowitz, O. and Herwartz, H. (2011). On Economic Evaluation of Directional Forecasts, International Journal of Forecasting, in press.
Clark, T. and McCracken, M.W. (2001). Tests of Equal Forecast Accuracy and Encom- passing for Nested Models, Journal of Econometrics 105, 85-110.
Clark, T. and McCracken, M.W. (2010). Testing for Unconditional Predictive Ability, Working Paper 2010-031 A, Federal Reserve Bank of St. Louis.
Clark, T. and West, K.D. (2007). Approximately Normal Tests for Equal Predictive Accuracy in Nested Models, Journal of Econometrics 138, 291-311.
Corradi, V., Swanson, N. and Olivetti, C. (2001). Predictive Ability with Cointegrated Variables, Journal of Econometrics 104, 315-358.
Diebold, F.X. and Mariano, R. (1995). Comparing Predictive Accuracy, Journal of Busi- ness and Economic Statistics, 13, 253-263.
Giacomini, R. and White, H. (2006). Tests of Conditional Predictive Ability, Economet- rica, 74, 1545-1578.
Granger, C.W.J. and Machina, M.J. (2006), Forecasting and Decision Theory, in Handbook of Economic Forecasting, Elliot G., Granger C.W.J., Timmermann A. (eds), North Holland.
Granger, C.W.J. and Pesaran, M.H. (2000). Economic and Statistical Measures of Fore- cast Accuracy, Journal of Forecasting, 19, 537-560.
McCracken, M.W. (2000). Robust Out of Sample Inference, Journal of Econometrics, 99, 195-223.
McCracken, M.W. (2004). Parameter Estimation and Tests of Equal Forecast Accuracy between nonnested Models, Jnternational Journal of Forecasting, 20, 503-514.
McCracken, M.W. (2007). Asymptotics for Out of Sample Tests of Granger Causality, Journal of Econometrics, 140, 717-752.
Pesaran, M.H. and Skouras, S. (2002). Decision-based Methods for Forecast Evaluation, in A companion to Economic Forecasting, Clements, M.P. and Hendry, D.F. (eds), Oxford, Blackwell Publishing.
Pesaran, M.H. and Timmermann, A. (2009). Testing Dependence among Serially Correlated Multi-category Variables", Journal of the American Statistical Association, 104 (485), 325-337.
Rossi, B. (2005). Testing Long-Horizon Predictive Ability with High Persistence, and the Meese-Rogo§ Puzzle, International Economic Review, 46, 61-92.
West, K.D. (1996). Asymptotic Inference about Predictive Ability, Econometrica, 64, 1067-1084.
West, K.D. (2006), Forecast Evaluation, in Handbook of Economic Forecasting, Elliot G., Granger C.W.J., Timmermann A. (eds), North Holland.