IDEAS home Printed from https://ideas.repec.org/a/eee/finlet/v58y2023ipas1544612323006645.html
   My bibliography  Save this article

Supervised kernel principal component analysis for forecasting

Author

Listed:
  • Fang, Puyi
  • Gao, Zhaoxing
  • Tsay, Ruey S.

Abstract

Principal component analysis (PCA) is a versatile tool for dimension reduction with many applications in finance, economics, and machine learning. This paper proposes a new approach to improving the forecasting ability of the Principal Components (PCs) of observed high-dimensional predictors in a factor-augmented forecasting framework. The approach is carried out in a three-step procedure, where we first perform a nonparametric kernel regression of the target variable on each predictor to obtain a new high-dimensional predictor vector formed by stacking all estimated kernel regression functions, we then extract PCs from these new predictors using PCA, and finally, we employ the extracted PCs as predictors to forecast the target variable. A real example on macroeconomic forecasting is analyzed and numerical results show that the proposed kernel PCA can outperform some commonly used forecasting approaches in out-of-sample prediction.

Suggested Citation

  • Fang, Puyi & Gao, Zhaoxing & Tsay, Ruey S., 2023. "Supervised kernel principal component analysis for forecasting," Finance Research Letters, Elsevier, vol. 58(PA).
  • Handle: RePEc:eee:finlet:v:58:y:2023:i:pa:s1544612323006645
    DOI: 10.1016/j.frl.2023.104292
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1544612323006645
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.frl.2023.104292?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guo, Yangli & He, Feng & Liang, Chao & Ma, Feng, 2022. "Oil price volatility predictability: New evidence from a scaled PCA approach," Energy Economics, Elsevier, vol. 105(C).
    2. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    3. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    4. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    5. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    6. Shu, Lei & Lu, Feiyang & Chen, Yu, 2023. "Robust forecasting with scaled independent component analysis," Finance Research Letters, Elsevier, vol. 51(C).
    7. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    8. Ludvigson, Sydney C. & Ng, Serena, 2007. "The empirical risk-return relation: A factor analysis approach," Journal of Financial Economics, Elsevier, vol. 83(1), pages 171-222, January.
    9. Dashan Huang & Fuwei Jiang & Kunpeng Li & Guoshi Tong & Guofu Zhou, 2022. "Scaled PCA: A New Approach to Dimension Reduction," Management Science, INFORMS, vol. 68(3), pages 1678-1695, March.
    10. Ma, Feng & Cao, Jiawei, 2023. "The Chinese equity premium predictability: Evidence from a long historical data," Finance Research Letters, Elsevier, vol. 53(C).
    11. Gao, Zhaoxing & Tsay, Ruey S., 2021. "Modeling high-dimensional unit-root time series," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1535-1555.
    12. Zhaoxing Gao & Ruey S. Tsay, 2022. "Modeling High-Dimensional Time Series: A Factor Model With Dynamically Dependent Factors and Diverging Eigenvalues," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(539), pages 1398-1414, September.
    13. Nikolay Gospodinov & Serena Ng, 2013. "Commodity Prices, Convenience Yields, and Inflation," The Review of Economics and Statistics, MIT Press, vol. 95(1), pages 206-219, March.
    14. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    2. Simon Freyaldenhoven, 2020. "Identification Through Sparsity in Factor Models," Working Papers 20-25, Federal Reserve Bank of Philadelphia.
    3. Miao, Ke & Phillips, Peter C.B. & Su, Liangjun, 2023. "High-dimensional VARs with common factors," Journal of Econometrics, Elsevier, vol. 233(1), pages 155-183.
    4. Jin, Sainan & Miao, Ke & Su, Liangjun, 2021. "On factor models with random missing: EM estimation, inference, and cross validation," Journal of Econometrics, Elsevier, vol. 222(1), pages 745-777.
    5. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    6. repec:dau:papers:123456789/11663 is not listed on IDEAS
    7. repec:ipg:wpaper:19 is not listed on IDEAS
    8. Yannick Le Pen & Benoît Sévi, 2013. "Futures Trading and the Excess Comovement of Commodity Prices," Working Papers halshs-00793724, HAL.
    9. repec:ipg:wpaper:2013-019 is not listed on IDEAS
    10. Dashan Huang & Fuwei Jiang & Kunpeng Li & Guoshi Tong & Guofu Zhou, 2022. "Scaled PCA: A New Approach to Dimension Reduction," Management Science, INFORMS, vol. 68(3), pages 1678-1695, March.
    11. Fan, Jianqing & Jiang, Bai & Sun, Qiang, 2022. "Bayesian factor-adjusted sparse regression," Journal of Econometrics, Elsevier, vol. 230(1), pages 3-19.
    12. Forni, Mario & Cavicchioli, Maddalena & Lippi, Marco & Zaffaroni, Paolo, 2016. "Eigenvalue Ratio Estimators for the Number of Common Factors," CEPR Discussion Papers 11440, C.E.P.R. Discussion Papers.
    13. Fan, Jianqing & Xue, Lingzhou & Yao, Jiawei, 2017. "Sufficient forecasting using factor models," Journal of Econometrics, Elsevier, vol. 201(2), pages 292-306.
    14. Perez, M. Fabricio & Shkilko, Andriy & Sokolov, Konstantin, 2015. "Factor models for binary financial data," Journal of Banking & Finance, Elsevier, vol. 61(S2), pages 177-188.
    15. Fosten, Jack, 2019. "CO2 emissions and economic activity: A short-to-medium run perspective," Energy Economics, Elsevier, vol. 83(C), pages 415-429.
    16. Jianqing Fan & Kunpeng Li & Yuan Liao, 2020. "Recent Developments on Factor Models and its Applications in Econometric Learning," Papers 2009.10103, arXiv.org.
    17. Martin Solberger & Erik Spånberg, 2020. "Estimating a Dynamic Factor Model in EViews Using the Kalman Filter and Smoother," Computational Economics, Springer;Society for Computational Economics, vol. 55(3), pages 875-900, March.
    18. Huang, Dashan & Jiang, Fuwei & Li, Kunpeng & Tong, Guoshi & Zhou, Guofu, 2023. "Are bond returns predictable with real-time macro data?," Journal of Econometrics, Elsevier, vol. 237(2).
    19. repec:dau:papers:123456789/11382 is not listed on IDEAS
    20. Alain-Philippe Fortin & Patrick Gagliardini & O. Scaillet, 2022. "Eigenvalue tests for the number of latent factors in short panels," Swiss Finance Institute Research Paper Series 22-81, Swiss Finance Institute.
    21. Jushan Bai & Serena Ng, 2020. "Simpler Proofs for Approximate Factor Models of Large Dimensions," Papers 2008.00254, arXiv.org.
    22. Xiong, Ruoxuan & Pelger, Markus, 2023. "Large dimensional latent factor modeling with missing observations and applications to causal inference," Journal of Econometrics, Elsevier, vol. 233(1), pages 271-301.
    23. Nii Ayi Armah & Norman Swanson, 2010. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 476-510.
    24. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finlet:v:58:y:2023:i:pa:s1544612323006645. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/frl .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.