IDEAS home Printed from https://ideas.repec.org/p/ucr/wpaper/202417.html
   My bibliography  Save this paper

Robust High-Dimensional Time-Varying Coefficient Estimation

Author

Listed:
  • Donggyu Kim

    (Department of Economics, University of California Riverside)

  • Minseok Shin

Abstract

In this paper, we develop a novel high-dimensional coefficient estimation procedure based on high-frequency data. Unlike usual high-dimensional regression procedure such as LASSO, we additionally handle the heavy-tailedness of high-frequency observations as well as time variations of coefficient processes. Specifically, we employ Huber loss and truncation scheme to handle heavy-tailed observations, while â„“1-regularization is adopted to overcome the curse of dimensionality. To account for the time-varying coefficient, we estimate local coefficients which are biased due to the â„“1-regularization. Thus, when estimating integrated coefficients, we propose a debiasing scheme to enjoy the law of large number property and employ a thresholding scheme to further accommodate the sparsity of the coefficients. We call this Robust thrEsholding Debiased LASSO (RED-LASSO) estimator. We show that the RED LASSO estimator can achieve a near-optimal convergence rate. In the empirical study, we apply the RED-LASSO procedure to the high-dimensional integrated coefficient estimation using high-frequency trading data.

Suggested Citation

  • Donggyu Kim & Minseok Shin, 2024. "Robust High-Dimensional Time-Varying Coefficient Estimation," Working Papers 202417, University of California at Riverside, Department of Economics.
  • Handle: RePEc:ucr:wpaper:202417
    as

    Download full text from publisher

    File URL: https://economics.ucr.edu/repec/ucr/wpaper/202417.pdf
    File Function: First version, 2024
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wayne E. Ferson & Campbell R. Harvey, 1999. "Conditioning Variables and the Cross Section of Stock Returns," Journal of Finance, American Finance Association, vol. 54(4), pages 1325-1360, August.
    2. John Y. Campbell & Jens Hilscher & Jan Szilagyi, 2008. "In Search of Distress Risk," Journal of Finance, American Finance Association, vol. 63(6), pages 2899-2939, December.
    3. Bali, Turan G. & Cakici, Nusret & Whitelaw, Robert F., 2011. "Maxing out: Stocks as lotteries and the cross-section of expected returns," Journal of Financial Economics, Elsevier, vol. 99(2), pages 427-446, February.
    4. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    5. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Ginger Wu, 2006. "Realized Beta: Persistence and Predictability," Advances in Econometrics, in: Econometric Analysis of Financial and Economic Time Series, pages 1-39, Emerald Group Publishing Limited.
    6. Per A. Mykland & Lan Zhang, 2009. "Inference for Continuous Semimartingales Observed at High Frequency," Econometrica, Econometric Society, vol. 77(5), pages 1403-1445, September.
    7. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    8. R. David Mclean & Jeffrey Pontiff, 2016. "Does Academic Research Destroy Stock Return Predictability?," Journal of Finance, American Finance Association, vol. 71(1), pages 5-32, February.
    9. John Lintner, 1965. "Security Prices, Risk, And Maximal Gains From Diversification," Journal of Finance, American Finance Association, vol. 20(4), pages 587-615, December.
    10. Engle, Robert F. & Gallo, Giampiero M., 2006. "A multiple indicators model for volatility using intra-daily data," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 3-27.
    11. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    12. Kewei Hou & Chen Xue & Lu Zhang, 2020. "Replicating Anomalies," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2019-2133.
    13. Shin, Minseok & Kim, Donggyu & Fan, Jianqing, 2023. "Adaptive robust large volatility matrix estimation based on high-frequency financial data," Journal of Econometrics, Elsevier, vol. 237(1).
    14. Aït-Sahalia, Yacine & Kalnina, Ilze & Xiu, Dacheng, 2020. "High-frequency factor models and regressions," Journal of Econometrics, Elsevier, vol. 216(1), pages 86-105.
    15. Clifford S. Asness & Tobias J. Moskowitz & Lasse Heje Pedersen, 2013. "Value and Momentum Everywhere," Journal of Finance, American Finance Association, vol. 68(3), pages 929-985, June.
    16. Song, Xinyu & Kim, Donggyu & Yuan, Huiling & Cui, Xiangyu & Lu, Zhiping & Zhou, Yong & Wang, Yazhen, 2021. "Volatility analysis with realized GARCH-Itô models," Journal of Econometrics, Elsevier, vol. 222(1), pages 393-410.
    17. Jianqing Fan & Donggyu Kim, 2018. "Robust High-Dimensional Volatility Matrix Estimation for High-Frequency Factor Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1268-1283, July.
    18. Yacine Aït-Sahalia & Dacheng Xiu, 2019. "Principal Component Analysis of High-Frequency Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 287-303, January.
    19. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    20. Neil Shephard & Kevin Sheppard, 2010. "Realising the future: forecasting with high-frequency-based volatility (HEAVY) models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 197-231.
    21. Ole E. Barndorff-Nielsen & Neil Shephard, 2004. "Econometric Analysis of Realized Covariation: High Frequency Based Covariance, Regression, and Correlation in Financial Economics," Econometrica, Econometric Society, vol. 72(3), pages 885-925, May.
    22. Li, Jia & Todorov, Viktor & Tauchen, George, 2017. "Adaptive estimation of continuous-time regression models using high-frequency data," Journal of Econometrics, Elsevier, vol. 200(1), pages 36-47.
    23. John H. Cochrane, 2011. "Presidential Address: Discount Rates," Journal of Finance, American Finance Association, vol. 66(4), pages 1047-1108, August.
    24. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    25. Mao, Guangyu & Zhang, Zhengjun, 2018. "Stochastic tail index model for high frequency financial data with Bayesian analysis," Journal of Econometrics, Elsevier, vol. 205(2), pages 470-487.
    26. Kim, Donggyu & Wang, Yazhen, 2016. "Unified discrete-time and continuous-time models and statistical inferences for merged low-frequency and high-frequency financial data," Journal of Econometrics, Elsevier, vol. 194(2), pages 220-230.
    27. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    28. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    29. Peter Reinhard Hansen & Zhuo Huang & Howard Howan Shek, 2012. "Realized GARCH: a joint model for returns and realized measures of volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 877-906, September.
    30. Qiang Sun & Wen-Xin Zhou & Jianqing Fan, 2020. "Adaptive Huber Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 254-265, January.
    31. Kim, Donggyu & Fan, Jianqing, 2019. "Factor GARCH-Itô models for high-frequency data with application to large volatility matrix prediction," Journal of Econometrics, Elsevier, vol. 208(2), pages 395-417.
    32. Cai, Tony & Liu, Weidong & Luo, Xi, 2011. "A Constrained â„“1 Minimization Approach to Sparse Precision Matrix Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 594-607.
    33. Cun-Hui Zhang & Stephanie S. Zhang, 2014. "Confidence intervals for low dimensional parameters in high dimensional linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 217-242, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Donggyu Kim & Minseok Shin, 2024. "Nonconvex High-Dimensional Time-Varying Coefficient Estimation for Noisy High-Frequency Observations with a Factor Structure," Working Papers 202418, University of California at Riverside, Department of Economics.
    2. Donggyu Kim, 2024. "High-Dimensional Time-Varying Coefficient Estimation," Working Papers 202416, University of California at Riverside, Department of Economics.
    3. Jianqing Fan & Donggyu Kim & Minseok Shin & Yazhen Wang, 2024. "Factor and Idiosyncratic VAR-Ito Volatility Models for Heavy-Tailed High-Frequency Financial Data," Working Papers 202415, University of California at Riverside, Department of Economics.
    4. Dohyun Chun & Donggyu Kim, 2022. "State Heterogeneity Analysis of Financial Volatility using high‐frequency Financial Data," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(1), pages 105-124, January.
    5. Shin, Minseok & Kim, Donggyu & Fan, Jianqing, 2023. "Adaptive robust large volatility matrix estimation based on high-frequency financial data," Journal of Econometrics, Elsevier, vol. 237(1).
    6. Jianqing Fan & Donggyu Kim & Minseok Shin, 2024. "Adaptive Robust Large Volatility Matrix Estimation Based on High-Frequency Financial Data," Working Papers 202419, University of California at Riverside, Department of Economics.
    7. Cakici, Nusret & Zaremba, Adam, 2022. "Salience theory and the cross-section of stock returns: International and further evidence," Journal of Financial Economics, Elsevier, vol. 146(2), pages 689-725.
    8. Adam Zaremba & Jacob Koby Shemer, 2018. "Price-Based Investment Strategies," Springer Books, Springer, number 978-3-319-91530-2, September.
    9. Vitor Azevedo & Christopher Hoegner, 2023. "Enhancing stock market anomalies with machine learning," Review of Quantitative Finance and Accounting, Springer, vol. 60(1), pages 195-230, January.
    10. Chiah, Mardy & Long, Huaigang & Zaremba, Adam & Umar, Zaghum, 2023. "Trade competitiveness and the aggregate returns in global stock markets," Journal of Economic Dynamics and Control, Elsevier, vol. 148(C).
    11. Kim, Donggyu & Song, Xinyu & Wang, Yazhen, 2022. "Unified discrete-time factor stochastic volatility and continuous-time Itô models for combining inference based on low-frequency and high-frequency," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    12. Gagliardini, Patrick & Ossola, Elisa & Scaillet, Olivier, 2019. "Estimation of large dimensional conditional factor models in finance," Working Papers unige:125031, University of Geneva, Geneva School of Economics and Management.
    13. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    14. Donggyu Kim & Minseok Shin & Yazhen Wang, 2023. "Overnight GARCH-Itô Volatility Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1215-1227, October.
    15. Söhnke M. Bartram & Harald Lohre & Peter F. Pope & Ananthalakshmi Ranganathan, 2021. "Navigating the factor zoo around the world: an institutional investor perspective," Journal of Business Economics, Springer, vol. 91(5), pages 655-703, July.
    16. Wolfgang Drobetz & Tizian Otto, 2021. "Empirical asset pricing via machine learning: evidence from the European stock market," Journal of Asset Management, Palgrave Macmillan, vol. 22(7), pages 507-538, December.
    17. Virk, Nader Shahzad & Butt, Hilal Anwar, 2022. "Asset pricing anomalies: Liquidity risk hedgers or liquidity risk spreaders?," International Review of Financial Analysis, Elsevier, vol. 81(C).
    18. Donggyu Kim, 2021. "Exponential GARCH-Ito Volatility Models," Papers 2111.04267, arXiv.org.
    19. Sun, Yucheng & Xu, Wen & Zhang, Chuanhai, 2023. "Identifying latent factors based on high-frequency data," Journal of Econometrics, Elsevier, vol. 233(1), pages 251-270.
    20. Assoe, Kodjovi & Attig, Najah & Sy, Oumar, 2024. "The battle of factors," Global Finance Journal, Elsevier, vol. 62(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucr:wpaper:202417. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelvin Mac (email available below). General contact details of provider: https://edirc.repec.org/data/deucrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.