IDEAS home Printed from https://ideas.repec.org/p/qed/wpaper/1391.html
   My bibliography  Save this paper

Model Selection In Factor-augmented Regressions With Estimated Factors

Author

Listed:
  • Antoine A. Djogbenou

    (Queen's University)

Abstract

This paper proposes two consistent in-sample model selection procedures for factor-augmented regressions in finite samples. We first demonstrate that the usual cross-validation is inconsistent, but that a generalization, leave-d-out cross-validation, selects the smallest basis for the space spanned by the true latent factors. The second proposed criterion is a generalization of the bootstrap approximation of the squared error of prediction from Shao (1996) to factor-augmented regressions. We show that these procedures are consistent model selection approaches. Simulation evidence documents improvements in the probability of selecting the smallest set of estimated factors than the usually available methods. An illustrative empirical application that analyzes the relationship between stock market excess returns and factors extracted from a large panel of U.S. macroeconomic and financial data is conducted. Our new procedures select factors that correlate heavily with interest rate spreads and with the Fama−French factors. These factors have in-sample predictive power for excess returns.

Suggested Citation

  • Antoine A. Djogbenou, 2017. "Model Selection In Factor-augmented Regressions With Estimated Factors," Working Paper 1391, Economics Department, Queen's University.
  • Handle: RePEc:qed:wpaper:1391
    as

    Download full text from publisher

    File URL: https://www.econ.queensu.ca/sites/econ.queensu.ca/files/wpaper/qed_wp_1391.pdf
    File Function: First version 2017
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    2. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    3. Bai, Jushan & Ng, Serena, 2013. "Principal components estimation and identification of static factors," Journal of Econometrics, Elsevier, vol. 176(1), pages 18-29.
    4. Gonçalves, Sílvia & Perron, Benoit, 2014. "Bootstrapping factor-augmented regression models," Journal of Econometrics, Elsevier, vol. 182(1), pages 156-173.
    5. Jack Fosten, 2017. "Model selection with estimated factors and idiosyncratic components," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(6), pages 1087-1106, September.
    6. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    7. repec:bla:jfinan:v:44:y:1989:i:3:p:719-29 is not listed on IDEAS
    8. Martin Lettau & Sydney Ludvigson, 2001. "Consumption, Aggregate Wealth, and Expected Stock Returns," Journal of Finance, American Finance Association, vol. 56(3), pages 815-849, June.
    9. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    10. Gonçalves, Sílvia & McCracken, Michael W. & Perron, Benoit, 2017. "Tests of equal accuracy for nested models with estimated factors," Journal of Econometrics, Elsevier, vol. 198(2), pages 231-252.
    11. Robert J. Shiller, 1989. "Comovements in Stock Prices and Comovements in Dividends," Journal of Finance, American Finance Association, vol. 44(3), pages 719-729, July.
    12. Jan J. J. Groen & George Kapetanios, 2009. "Model selection criteria for factor-augmented regressions," Staff Reports 363, Federal Reserve Bank of New York.
    13. Lettau, Martin & Ludvigson, Sydney C., 2005. "Expected returns and expected dividend growth," Journal of Financial Economics, Elsevier, vol. 76(3), pages 583-626, June.
    14. Campbell, John Y, 1991. "A Variance Decomposition for Stock Returns," Economic Journal, Royal Economic Society, vol. 101(405), pages 157-179, March.
    15. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    16. repec:bla:jfinan:v:44:y:1989:i:3:p:719-730 is not listed on IDEAS
    17. Ludvigson, Sydney C. & Ng, Serena, 2007. "The empirical risk-return relation: A factor analysis approach," Journal of Financial Economics, Elsevier, vol. 83(1), pages 171-222, January.
    18. Jushan Bai & Serena Ng, 2009. "Boosting diffusion indices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 607-629.
    19. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    20. Kleibergen, Frank & Zhan, Zhaoguo, 2015. "Unexplained factors and their effects on second pass R-squared’s," Journal of Econometrics, Elsevier, vol. 189(1), pages 101-116.
    21. Antoine Djogbenou & Silvia Gonçalves & Benoit Perron, 2015. "Bootstrap inference in regressions with estimated factors and serial correlation," CIRANO Working Papers 2015s-20, CIRANO.
    22. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    23. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    2. Jack Fosten, 2017. "Model selection with estimated factors and idiosyncratic components," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(6), pages 1087-1106, September.
    3. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    4. Tu, Yundong & Wang, Siwei, 2024. "Selection inconsistency for factor-augmented regressions," Economics Letters, Elsevier, vol. 241(C).
    5. Antoine A. Djogbenou, 2020. "Comovements in the real activity of developed and emerging economies: A test of global versus specific international factors," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(3), pages 344-370, April.
    6. Djogbenou, Antoine & Sufana, Razvan, 2024. "Tests for group-specific heterogeneity in high-dimensional factor models," Journal of Multivariate Analysis, Elsevier, vol. 199(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    2. Antoine A. Djogbenou, 2020. "Comovements in the real activity of developed and emerging economies: A test of global versus specific international factors," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(3), pages 344-370, April.
    3. Fan, Jianqing & Xue, Lingzhou & Yao, Jiawei, 2017. "Sufficient forecasting using factor models," Journal of Econometrics, Elsevier, vol. 201(2), pages 292-306.
    4. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 51(3), pages 695-746, August.
    5. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    6. Gonçalves, Sílvia & Perron, Benoit, 2020. "Bootstrapping factor models with cross sectional dependence," Journal of Econometrics, Elsevier, vol. 218(2), pages 476-495.
    7. Marine Carrasco & Barbara Rossi, 2016. "In-Sample Inference and Forecasting in Misspecified Factor Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 313-338, July.
    8. Sium Bodha Hannadige & Jiti Gao & Mervyn J. Silvapulle & Param Silvapulle, 2020. "Forecasting a Nonstationary Time Series with a Mixture of Stationary and Nonstationary Factors as Predictors," Monash Econometrics and Business Statistics Working Papers 19/20, Monash University, Department of Econometrics and Business Statistics.
    9. Masud Alam, 2024. "Output, employment, and price effects of U.S. narrative tax changes: a factor-augmented vector autoregression approach," Empirical Economics, Springer, vol. 67(4), pages 1421-1471, October.
    10. Jack Fosten, 2016. "Forecast evaluation with factor-augmented models," University of East Anglia School of Economics Working Paper Series 2016-05, School of Economics, University of East Anglia, Norwich, UK..
    11. Varlam Kutateladze, 2021. "The Kernel Trick for Nonlinear Factor Modeling," Papers 2103.01266, arXiv.org.
    12. repec:cte:wsrepe:23974 is not listed on IDEAS
    13. Fosten, Jack, 2019. "CO2 emissions and economic activity: A short-to-medium run perspective," Energy Economics, Elsevier, vol. 83(C), pages 415-429.
    14. Hande Karabiyik & Joakim Westerlund, 2021. "Forecasting using cross-section average–augmented time series regressions," The Econometrics Journal, Royal Economic Society, vol. 24(2), pages 315-333.
    15. Karen Miranda & Pilar Poncela & Esther Ruiz, 2022. "Dynamic factor models: Does the specification matter?," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 13(1), pages 397-428, May.
    16. Kutateladze, Varlam, 2022. "The kernel trick for nonlinear factor modeling," International Journal of Forecasting, Elsevier, vol. 38(1), pages 165-177.
    17. Massacci, Daniele, 2017. "Least squares estimation of large dimensional threshold factor models," Journal of Econometrics, Elsevier, vol. 197(1), pages 101-129.
    18. Fosten, Jack, 2017. "Confidence intervals in regressions with estimated factors and idiosyncratic components," Economics Letters, Elsevier, vol. 157(C), pages 71-74.
    19. Gonçalves, Sílvia & McCracken, Michael W. & Perron, Benoit, 2017. "Tests of equal accuracy for nested models with estimated factors," Journal of Econometrics, Elsevier, vol. 198(2), pages 231-252.
    20. Maio, Paulo & Philip, Dennis, 2015. "Macro variables and the components of stock returns," Journal of Empirical Finance, Elsevier, vol. 33(C), pages 287-308.
    21. Sium Bodha Hannadige & Jiti Gao & Mervyn J Silvapulle & Param Silvapulle, 2021. "Time Series Forecasting Using a Mixture of Stationary and Nonstationary Predictors," Monash Econometrics and Business Statistics Working Papers 6/21, Monash University, Department of Econometrics and Business Statistics.

    More about this item

    Keywords

    factor model; consistent model selection; cross-validation; bootstrap; excess returns; macroeconomic and financial factors;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1391. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Babcock (email available below). General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.