Tests of Conditional Predictive Ability

Raffaella Giacomini () and Halbert White

University of California at San Diego, Economics Working Paper Series from Department of Economics, UC San Diego

Abstract: We argue that the current framework for predictive ability testing (e.g., West, 1996) is not necessarily useful for real-time forecast selection, i.e., for assessing which of two competing forecasting methods will perform better in the future. We propose an alternative framework for out-of-sample comparison of predictive ability which delivers more practically relevant conclusions. Our approach is based on inference about conditional expectations of forecasts and forecast errors rather than the unconditional expectations that are the focus of the existing literature. We capture important determinants of forecast performance that are neglected in the existing literature by evaluating what we call the forecasting method (the model and the parameter estimation procedure), rather than just the forecasting model. Compared to previous approaches, our tests are valid under more general data assumptions (heterogeneity rather than stationarity) and estimation methods, and they can handle comparison of both nested and non-nested models, which is not currently possible. To illustrate the usefulness of the proposed tests, we compare the forecast performance of three leading parameter-reduction methods for macroeconomic forecasting using a large number of predictors: a sequential model selection approach, the "diffusion indexes" approach of Stock and Watson (2002), and the use of Bayesian shrinkage estimators.

Keywords: Forecast evaluation; asymptotic inference; parameter-reduction methods (search for similar items in EconPapers)
Date: 2003-06-01
References: Add references at CitEc
Citations: View citations in EconPapers (41)

Downloads: (external link)
https://www.escholarship.org/uc/item/5jk0j5jh.pdf;origin=repeccitec (application/pdf)

Related works:
Journal Article: Tests of Conditional Predictive Ability (2006)
Working Paper: Tests of conditional predictive ability (2003)
Working Paper: Tests of Conditional Predictive Ability (2003)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cdl:ucsdec:qt5jk0j5jh

Access Statistics for this paper

More papers in University of California at San Diego, Economics Working Paper Series from Department of Economics, UC San Diego Contact information at EDIRC.
Bibliographic data for series maintained by Lisa Schiff ().