IDEAS home Printed from https://ideas.repec.org/p/ucr/wpaper/202307.html
   My bibliography  Save this paper

Estimation and Testing of Forecast Rationality with Many Moments

Author

Listed:
  • Tae-Hwy Lee

    (Department of Economics, University of California Riverside)

  • Tao Wang

    (Department of Economics, University of Victoria, Canada)

Abstract

We in this paper utilize P-GMM (Cheng and Liao, 2015) moment selection procedure to select valid and relevant moments for estimating and testing forecast rationality under the flexible loss proposed by Elliott et al. (2005). We motivate the moment selection in a large dimensional setting, explain the fundamental mechanism of P-GMM moment selection procedure, and elucidate how to implement it in the context of forecast rationality by allowing the existence of potentially invalid moment conditions. A set of Monte Carlo simulations is conducted to examine the finite sample performance of P-GMM estimation in integrating the information available in instruments into both the estimation and testing, and a real data analysis using data from the Survey of Professional Forecasters issued by the Federal Reserve Bank of Philadelphia is presented to further illustrate the practical value of the suggested methodology. The results indicate that the P-GMM post-selection estimator of forecaster’s attitude is comparable to the oracle estimator by using the available information efficiently. The accompanying power of rationality and symmetry tests utilizing P-GMM estimation would be substantially increased through reducing the influence of uninformative instruments. When a forecast user estimates and tests for rationality of forecasts that have been produced by others such as Greenbook, P-GMM moment selection procedure can assist in achieving consistent and more efficient outcomes.

Suggested Citation

  • Tae-Hwy Lee & Tao Wang, 2023. "Estimation and Testing of Forecast Rationality with Many Moments," Working Papers 202307, University of California at Riverside, Department of Economics.
    • Handle: RePEc:ucr:wpaper:202307
    as

    Download full text from publisher

    File URL: https://economics.ucr.edu/repec/ucr/wpaper/202307.pdf
    File Function: First version, 2023
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    2. Ng Serena & Bai Jushan, 2009. "Selecting Instrumental Variables in a Data Rich Environment," Journal of Time Series Econometrics, De Gruyter, vol. 1(1), pages 1-34, April.
    3. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    4. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    5. Donald W. K. Andrews, 1999. "Consistent Moment Selection Procedures for Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 67(3), pages 543-564, May.
    6. Donald W. K. Andrews, 2002. "Higher-Order Improvements of a Computationally Attractive "k"-Step Bootstrap for Extremum Estimators," Econometrica, Econometric Society, vol. 70(1), pages 119-162, January.
    7. Liao, Zhipeng, 2013. "Adaptive Gmm Shrinkage Estimation With Consistent Moment Selection," Econometric Theory, Cambridge University Press, vol. 29(5), pages 857-904, October.
    8. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-836, July.
    9. Wang, Yiyao & Lee, Tae-Hwy, 2014. "Asymmetric loss in the Greenbook and the Survey of Professional Forecasters," International Journal of Forecasting, Elsevier, vol. 30(2), pages 235-245.
    10. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    11. Atsushi Inoue, 2006. "A bootstrap approach to moment selection," Econometrics Journal, Royal Economic Society, vol. 9(1), pages 48-75, March.
    12. Hong, Han & Preston, Bruce & Shum, Matthew, 2003. "Generalized Empirical Likelihood–Based Model Selection Criteria For Moment Condition Models," Econometric Theory, Cambridge University Press, vol. 19(6), pages 923-943, December.
    13. Mehmet Caner & Xu Han & Yoonseok Lee, 2018. "Adaptive Elastic Net GMM Estimation With Many Invalid Moment Conditions: Simultaneous Model and Moment Selection," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 24-46, January.
    14. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    15. Andrews, Donald W. K. & Lu, Biao, 2001. "Consistent model and moment selection procedures for GMM estimation with application to dynamic panel data models," Journal of Econometrics, Elsevier, vol. 101(1), pages 123-164, March.
    16. Hall, Alastair R. & Inoue, Atsushi & Jana, Kalidas & Shin, Changmock, 2007. "Information in generalized method of moments estimation and entropy-based moment selection," Journal of Econometrics, Elsevier, vol. 138(2), pages 488-512, June.
    17. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    18. Timmermann, Allan & Zhu, Yinchu, 2019. "Comparing Forecasting Performance with Panel Data," CEPR Discussion Papers 13746, C.E.P.R. Discussion Papers.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu Cheng & Zhipeng Liao, 2012. "Select the Valid and Relevant Moments: A One-Step Procedure for GMM with Many Moments," PIER Working Paper Archive 12-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    2. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    3. Byunghoon Kang, 2018. "Higher Order Approximation of IV Estimators with Invalid Instruments," Working Papers 257105320, Lancaster University Management School, Economics Department.
    4. Jinyuan Chang & Zhentao Shi & Jia Zhang, 2021. "Culling the herd of moments with penalized empirical likelihood," Papers 2108.03382, arXiv.org, revised May 2022.
    5. Prosper Donovon & Alastair R. Hall, 2015. "GMM and Indirect Inference: An appraisal of their connections and new results on their properties under second order identification," Economics Discussion Paper Series 1505, Economics, The University of Manchester.
    6. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
    7. Ruoyao Shi & Zhipeng Liao, 2018. "An Averaging GMM Estimator Robust to Misspecification," Working Papers 201803, University of California at Riverside, Department of Economics.
    8. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    9. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    10. Shi, Zhentao, 2016. "Econometric estimation with high-dimensional moment equalities," Journal of Econometrics, Elsevier, vol. 195(1), pages 104-119.
    11. DiTraglia, Francis J., 2016. "Using invalid instruments on purpose: Focused moment selection and averaging for GMM," Journal of Econometrics, Elsevier, vol. 195(2), pages 187-208.
    12. Tobias Rühl, 2015. "Taylor rules revisited: ECB and Bundesbank in comparison," Empirical Economics, Springer, vol. 48(3), pages 951-967, May.
    13. Prosper Dovonon & Firmin Doko Tchatoka & Michael Aguessy, 2019. "Relevant moment selection under mixed identification strength," School of Economics and Public Policy Working Papers 2019-04, University of Adelaide, School of Economics and Public Policy.
    14. Kim, Jae-Young, 2014. "An alternative quasi likelihood approach, Bayesian analysis and data-based inference for model specification," Journal of Econometrics, Elsevier, vol. 178(P1), pages 132-145.
    15. Tae-Hwy Lee & Yiyao Wang, 2019. "Evaluation of the Survey of Professional Forecasters in the Greenbook’s Loss Function," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 17(2), pages 345-360, June.
    16. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    17. Ivan Korolev, 2018. "LM-BIC Model Selection in Semiparametric Models," Papers 1811.10676, arXiv.org.
    18. Francis J. DiTraglia, 2011. "Using Invalid Instruments on Purpose: Focused Moment Selection and Averaging for GMM, Second Version," PIER Working Paper Archive 14-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 09 Dec 2014.
    19. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    20. Francis DiTraglia, 2011. "Using Invalid Instruments on Purpose: Focused Moment Selection and Averaging for GMM, Second Version," PIER Working Paper Archive 15-027, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 10 Aug 2015.
    21. Aman Ullah & Huansha Wang, 2013. "Parametric and Nonparametric Frequentist Model Selection and Model Averaging," Econometrics, MDPI, vol. 1(2), pages 1-23, September.

    More about this item

    Keywords

    Forecast rationality; Moment selection; P-GMM; Relevance; Validity.;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C36 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Instrumental Variables (IV) Estimation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucr:wpaper:202307. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelvin Mac (email available below). General contact details of provider: https://edirc.repec.org/data/deucrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.