IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/13902.html
   My bibliography  Save this paper

Expert opinion versus expertise in forecasting

Author

Listed:
  • Franses, Ph.H.B.F.
  • McAleer, M.J.
  • Legerstee, R.

Abstract

Expert opinion is an opinion given by an expert, and it can have significant value in forecasting key policy variables in economics and finance. Expert forecasts can either be expert opinions, or forecasts based on an econometric model. An expert forecast that is based on an econometric model is replicable, and can be defined as a replicable expert forecast (REF), whereas an expert opinion that is not based on an econometric model can be defined as a non-replicable expert forecast (Non-REF). Both replicable and non-replicable expert forecasts may be made available by an expert regarding a policy variable of interest. In this paper we develop a model to generate replicable expert forecasts, and compare REF with Non-REF. A method is presented to compare REF and Non-REF using efficient estimation methods, and a direct test of expertise on expert opinion is given. The latter serves the purpose of investigating whether expert adjustment improves the model-based forecasts. Illustrations for forecasting pharmaceutical SKUs, where the econometric model is of (variations of) the ARIMA type, show the relevance of the new methodology proposed in the paper. In particular, experts possess significant expertise, and expert forecasts are significant in explaining actual sales.

Suggested Citation

  • Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008. "Expert opinion versus expertise in forecasting," Econometric Institute Research Papers EI 2008-30, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    • Handle: RePEc:ems:eureir:13902
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/13902/EI%202008-30.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Franses, Ph.H.B.F. & Kranendonk, H.C. & Lanser, D., 2007. "On the optimality of expert-adjusted forecasts," Econometric Institute Research Papers EI 2007-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    2. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    3. Oxley, Les & McAleer, Michael, 1993. "Econometric Issues in Macroeconomic Models with Generated Regressors," Journal of Economic Surveys, Wiley Blackwell, vol. 7(1), pages 1-40.
    4. Bunn, Derek W. & Salo, Ahti A., 1996. "Adjustment of forecasts with model consistent expectations," International Journal of Forecasting, Elsevier, vol. 12(1), pages 163-170, March.
    5. Franses, Philip Hans, 2008. "Merging models and experts," International Journal of Forecasting, Elsevier, vol. 24(1), pages 31-33.
    6. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    7. repec:bla:ecorec:v:68:y:1992:i:200:p:65-72 is not listed on IDEAS
    8. McAleer, Michael, 1995. "The significance of testing empirical non-nested models," Journal of Econometrics, Elsevier, vol. 67(1), pages 149-171, May.
    9. Fiebig, Denzil G. & McAleer, Michael & Bartels, Robert, 1992. "Properties of ordinary least squares estimators in regression models with nonspherical disturbances," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 321-334.
    10. Pagan, Adrian, 1984. "Econometric Issues in the Analysis of Regressions with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 25(1), pages 221-247, February.
    11. Mcleer, M. & Mckenzie, C.R., 1989. "When Are Two Step Estimators Efficient?," Papers 179, Australian National University - Department of Economics.
    12. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    13. Goodwin, Paul, 2000. "Improving the voluntary integration of statistical forecasts and judgment," International Journal of Forecasting, Elsevier, vol. 16(1), pages 85-99.
    14. Suhejla Hoti & Michael McAleer & Daniel Slottje, 2006. "Intellectual Property Litigation Activity In The Usa," Journal of Economic Surveys, Wiley Blackwell, vol. 20(4), pages 715-729, September.
    15. Franses, Philip Hans & Legerstee, Rianne, 2009. "Properties of expert adjustments on model-based SKU-level forecasts," International Journal of Forecasting, Elsevier, vol. 25(1), pages 35-47.
    16. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chang, Chia-Lin & de Bruijn, Bert & Franses, Philip Hans & McAleer, Michael, 2013. "Analyzing fixed-event forecast revisions," International Journal of Forecasting, Elsevier, vol. 29(4), pages 622-627.
    2. Chia-Lin Chang & Michael Mcaleer, 2013. "What Do Experts Know About Forecasting Journal Quality? A Comparison With Isi Research Impact In Finance," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 1-30.
    3. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2013. "Are forecast updates progressive?," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 9-18.
    4. Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2010. "Evaluating Combined Non-Replicable Forecasts," KIER Working Papers 744, Kyoto University, Institute of Economic Research.
    5. Franses, Ph.H.B.F., 2009. "Forecasting Sales," Econometric Institute Research Papers EI 2009-29, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2010. "Evaluating Macroeconomic Forecast: A Review of Some Recent Developments," Econometric Institute Research Papers EI 2010-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Chang, C-L. & McAleer, M.J., 2012. "What do Experts Know About Ranking Journal Quality? A Comparison with ISI Research Impact in Finance," Econometric Institute Research Papers EI2012-01, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    8. Chang, Chia Lin & Franses, Philip Hans & Mcaleer, Michael, 2012. "Evaluating Individual and Mean Non-Replicable Forecasts," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(3), pages 22-43, September.
    9. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.
    10. Philip Hans Franses, 2011. "Averaging Model Forecasts and Expert Forecasts: Why Does It Work?," Interfaces, INFORMS, vol. 41(2), pages 177-181, April.
    11. Chang, C-L. & McAleer, M.J. & Franses, Ph.H.B.F., 2010. "Combining Non-Replicable Forecasts," Econometric Institute Research Papers EI 2010-44, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    12. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008. "Does the ROMC have expertise, and can it forecast?," Econometric Institute Research Papers EI 2008-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    13. Egor Griva & Irina Butorina & Anatoly Sidorov & Pavel Senchenko, 2022. "Analysis and Forecasting of Sales Funnels," Mathematics, MDPI, vol. 11(1), pages 1-22, December.
    14. Franses, Ph.H.B.F., 2010. "Decomposing bias in expert forecast," Econometric Institute Research Papers EI 2010-26, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    15. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    16. Franses, Philip Hans, 2013. "Improving judgmental adjustment of model-based forecasts," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 1-8.
    17. Chang, C-L. & Franses, Ph.H.B.F. & McAleer, M.J., 2009. "How Accurate are Government Forecast of Economic Fundamentals?," Econometric Institute Research Papers EI 2009-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    2. Chang, C-L. & Franses, Ph.H.B.F. & McAleer, M.J., 2009. "How Accurate are Government Forecast of Economic Fundamentals?," Econometric Institute Research Papers EI 2009-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    3. Chang, C-L. & McAleer, M.J. & Franses, Ph.H.B.F., 2010. "Combining Non-Replicable Forecasts," Econometric Institute Research Papers EI 2010-44, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    4. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2013. "Are forecast updates progressive?," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 9-18.
    5. Rianne Legerstee & Philip Hans Franses & Richard Paap, 2011. "Do Experts incorporate Statistical Model Forecasts and should they?," Tinbergen Institute Discussion Papers 11-141/4, Tinbergen Institute.
    6. Philip Hans Franses & Rianne Legerstee, 2010. "Do experts' adjustments on model-based SKU-level forecasts improve forecast quality?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 331-340.
    7. P H Franses & R Legerstee, 2011. "Experts' adjustment to model-based SKU-level forecasts: does the forecast horizon matter?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 537-543, March.
    8. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008. "Does the ROMC have expertise, and can it forecast?," Econometric Institute Research Papers EI 2008-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. Branston, Christopher B. & Groenewold, Nicolaas, 2004. "Investment and share prices: fundamental versus speculative components," The North American Journal of Economics and Finance, Elsevier, vol. 15(2), pages 199-226, August.
    10. Franses, Ph.H.B.F. & Legerstee, R., 2007. "What drives the relevance and quality of experts' adjustment to model-based forecasts?," Econometric Institute Research Papers EI 2007-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    11. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    12. Kearney, Colm, 2000. "The determination and international transmission of stock market volatility," Global Finance Journal, Elsevier, vol. 11(1-2), pages 31-52.
    13. Christian Pierdzioch & Jan-Christoph Rülke & Peter Tillmann, 2013. "Using forecasts to uncover the loss function of FOMC members," MAGKS Papers on Economics 201302, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    14. Hutson, Elaine & Kearney, Colm, 2001. "Volatility in stocks subject to takeover bids: Australian evidence using daily data," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 273-296, July.
    15. Bert de Bruijn & Philip Hans Franses, 2012. "Managing Sales Forecasters," Tinbergen Institute Discussion Papers 12-131/III, Tinbergen Institute.
    16. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    17. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    18. De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
    19. Rianne Legerstee & Philip Hans Franses, 2014. "Do Experts’ SKU Forecasts Improve after Feedback?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 69-79, January.
    20. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.

    More about this item

    Keywords

    direct test; efficient estimation; expert opinion; forecasts; generated regressors; non-replicable expert forecast; replicable expert;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:13902. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub The email address of this maintainer does not seem to be valid anymore. Please ask RePub to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/feeurnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.
    pFad - Phonifier reborn

    Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

    Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


    Alternative Proxies:

    Alternative Proxy

    pFad Proxy

    pFad v3 Proxy

    pFad v4 Proxy