IDEAS home Printed from https://ideas.repec.org/p/inn/wpaper/2017-23.html
   My bibliography  Save this paper

Estimation methods for non-homogeneous regression models: Minimum continuous ranked probability score vs. maximum likelihood

Author

Listed:
  • Manuel Gebetsberger
  • Jakob W. Messner
  • Georg J. Mayr
  • Achim Zeileis

Abstract

Non-homogeneous regression models are widely used to statistically post-process numerical ensemble weather prediction models. Such regression models are capable of forecasting full probability distributions and correct for ensemble errors in the mean and variance. To estimate the corresponding regression coefficients, minimization of the continuous ranked probability score (CRPS) has widely been used in meteorological post-processing studies and has often been found to yield more calibrated forecasts compared to maximum likelihood estimation. From a theoretical perspective, both estimators are consistent and should lead to similar results, provided the correct distribution assumption about empirical data. Differences between the estimated values indicate a wrong specification of the regression model. This study compares the two estimators for probabilistic temperature forecasting with non-homogeneous regression, where results show discrepancies for the classical Gaussian assumption. The heavy-tailed logistic and Student-t distributions can improve forecast performance in terms of sharpness and calibration, and lead to only minor differences between the estimators employed. Finally, a simulation study confirms the importance of appropriate distribution assumptions and shows that for a correctly specified model the maximum likelihood estimator is slightly more efficient than the CRPS estimator.

Suggested Citation

  • Manuel Gebetsberger & Jakob W. Messner & Georg J. Mayr & Achim Zeileis, 2017. "Estimation methods for non-homogeneous regression models: Minimum continuous ranked probability score vs. maximum likelihood," Working Papers 2017-23, Faculty of Economics and Statistics, Universität Innsbruck.
  • Handle: RePEc:inn:wpaper:2017-23
    as

    Download full text from publisher

    File URL: https://www2.uibk.ac.at/downloads/c4041030/wpaper/2017-23.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464.
    2. Thordis L. Thorarinsdottir & Tilmann Gneiting, 2010. "Probabilistic forecasts of wind speed: ensemble model output statistics by using heteroscedastic censored regression," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(2), pages 371-388, April.
    3. Reinhard Selten, 1998. "Axiomatic Characterization of the Quadratic Scoring Rule," Experimental Economics, Springer;Economic Science Association, vol. 1(1), pages 43-61, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tindara Addabbo & Anna Maccagnan & Carmen Llorca-Rodríguez & Rosa García-Fernández, 2010. "Income distribution and the effect of the financial crisis on the Italian and Spanish labour markets," Department of Economics 0639, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    2. Becchetti, Leonardo & Degli Antoni, Giacomo & Ottone, Stefania & Solferino, Nazaria, 2013. "Allocation criteria under task performance: The gendered preference for protection," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 45(C), pages 96-111.
    3. Walter Beckert, 2015. "Choice in the Presence of Experts," Birkbeck Working Papers in Economics and Finance 1503, Birkbeck, Department of Economics, Mathematics & Statistics.
    4. Ai, Chunrong & Chen, Xiaohong, 2007. "Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables," Journal of Econometrics, Elsevier, vol. 141(1), pages 5-43, November.
    5. Xiaohong Chen & Roger Koenker & Zhijie Xiao, 2009. "Copula-based nonlinear quantile autoregression," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 50-67, January.
    6. Magnus, Jan R., 2007. "The Asymptotic Variance Of The Pseudo Maximum Likelihood Estimator," Econometric Theory, Cambridge University Press, vol. 23(5), pages 1022-1032, October.
    7. Chor-Yiu Sin, 2014. "Qmle Of A Standard Exponential Acd Model: Asymptotic Distribution And Residual Correlation," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 9(02), pages 1-10.
    8. Benjamin Enke & Florian Zimmermann, 2019. "Correlation Neglect in Belief Formation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 313-332.
    9. Coenen, Gunter & Wieland, Volker, 2005. "A small estimated euro area model with rational expectations and nominal rigidities," European Economic Review, Elsevier, vol. 49(5), pages 1081-1104, July.
    10. Chen, Xiaohong & Liao, Zhipeng & Sun, Yixiao, 2014. "Sieve inference on possibly misspecified semi-nonparametric time series models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 639-658.
    11. David T. Frazier & Bonsoo Koo, 2020. "Indirect Inference for Locally Stationary Models," Monash Econometrics and Business Statistics Working Papers 30/20, Monash University, Department of Econometrics and Business Statistics.
    12. Arie Preminger & Uri Ben-zion & David Wettstein, 2007. "The extended switching regression model: allowing for multiple latent state variables," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(7), pages 457-473.
    13. Guido M. Kuersteiner & Ingmar R. Prucha, 2020. "Dynamic Spatial Panel Models: Networks, Common Shocks, and Sequential Exogeneity," Econometrica, Econometric Society, vol. 88(5), pages 2109-2146, September.
    14. Dimitriadis, Timo & Schnaitmann, Julie, 2021. "Forecast encompassing tests for the expected shortfall," International Journal of Forecasting, Elsevier, vol. 37(2), pages 604-621.
    15. Hommes, Cars & Zhu, Mei, 2014. "Behavioral learning equilibria," Journal of Economic Theory, Elsevier, vol. 150(C), pages 778-814.
    16. Takagi, Shingo, 1999. "Bias in maximum likelihood estimator of disequilibrium and sample selection model with error-ridden observations," Economics Letters, Elsevier, vol. 64(2), pages 161-165, August.
    17. Marco LiCalzi & Roland Mühlenbernd, 2022. "Feature-weighted categorized play across symmetric games," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 1052-1078, June.
    18. Hannes Böhm & Julia Schaumburg & Lena Tonzer, 2022. "Financial Linkages and Sectoral Business Cycle Synchronization: Evidence from Europe," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 70(4), pages 698-734, December.
    19. Agbeyegbe, Terence D., 2015. "An inverted U-shaped crude oil price return-implied volatility relationship," Review of Financial Economics, Elsevier, vol. 27(C), pages 28-45.
    20. Eric Hillebrand & Marcelo C. Medeiros, 2016. "Nonlinearity, Breaks, and Long-Range Dependence in Time-Series Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(1), pages 23-41, January.

    More about this item

    Keywords

    ensemble post-processing; maximum likelihood; CRPS minimization; probabilistic forecasting; distributional regression models;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C16 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Econometric and Statistical Methods; Specific Distributions
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inn:wpaper:2017-23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Janette Walde (email available below). General contact details of provider: https://edirc.repec.org/data/fuibkat.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.