IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1909.10035.html
   My bibliography  Save this paper

Using Machine Learning to Predict Realized Variance

Author

Listed:
  • Peter Carr
  • Liuren Wu
  • Zhibai Zhang

Abstract

In this paper we formulate a regression problem to predict realized volatility by using option price data and enhance VIX-styled volatility indices' predictability and liquidity. We test algorithms including regularized regression and machine learning methods such as Feedforward Neural Networks (FNN) on S&P 500 Index and its option data. By conducting a time series validation we find that both Ridge regression and FNN can improve volatility indexing with higher prediction performance and fewer options required. The best approach found is to predict the difference between the realized volatility and the VIX-styled index's prediction rather than to predict the realized volatility directly, representing a successful combination of human learning and machine learning. We also discuss suitability of different regression algorithms for volatility indexing and applications of our findings.

Suggested Citation

  • Peter Carr & Liuren Wu & Zhibai Zhang, 2019. "Using Machine Learning to Predict Realized Variance," Papers 1909.10035, arXiv.org.
    • Handle: RePEc:arx:papers:1909.10035
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1909.10035
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    2. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    3. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    4. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yue Zhuo & Takayuki Morimoto, 2024. "A Hybrid Model for Forecasting Realized Volatility Based on Heterogeneous Autoregressive Model and Support Vector Regression," Risks, MDPI, vol. 12(1), pages 1-16, January.
    2. Kim Christensen & Mathias Siggaard & Bezirgen Veliyev, 2023. "A Machine Learning Approach to Volatility Forecasting," Journal of Financial Econometrics, Oxford University Press, vol. 21(5), pages 1680-1727.
    3. Tehseen Mazhar & Rizwana Naz Asif & Muhammad Amir Malik & Muhammad Asgher Nadeem & Inayatul Haq & Muhammad Iqbal & Muhammad Kamran & Shahzad Ashraf, 2023. "Electric Vehicle Charging System in the Smart Grid Using Different Machine Learning Methods," Sustainability, MDPI, vol. 15(3), pages 1-26, February.
    4. Alexander Brunhuemer & Lukas Larcher & Philipp Seidl & Sascha Desmettre & Johannes Kofler & Gerhard Larcher, 2022. "Supervised machine learning classification for short straddles on the S&P500," Papers 2204.13587, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew J. Patton & Yasin Simsek, 2023. "Generalized Autoregressive Score Trees and Forests," Papers 2305.18991, arXiv.org.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Díaz, Juan D. & Hansen, Erwin & Cabrera, Gabriel, 2024. "Machine-learning stock market volatility: Predictability, drivers, and economic value," International Review of Financial Analysis, Elsevier, vol. 94(C).
    4. Chia-Lin Chang & Jukka Ilomäki & Hannu Laurila & Michael McAleer, 2018. "Long Run Returns Predictability and Volatility with Moving Averages," Risks, MDPI, vol. 6(4), pages 1-18, September.
    5. Denisa Banulescu-Radu & Christophe Hurlin & Bertrand Candelon & Sébastien Laurent, 2016. "Do We Need High Frequency Data to Forecast Variances?," Annals of Economics and Statistics, GENES, issue 123-124, pages 135-174.
    6. Jonathan J. Reeves & Xuan Xie, 2014. "Forecasting stock return volatility at the quarterly frequency: an evaluation of time series approaches," Applied Financial Economics, Taylor & Francis Journals, vol. 24(5), pages 347-356, March.
    7. Harry-Paul Vander Elst, 2015. "FloGARCH: Realizing Long Memory and Asymmetries in Returns Valitility," Working Papers ECARES ECARES 2015-12, ULB -- Universite Libre de Bruxelles.
    8. Zhu, Haibin & Bai, Lu & He, Lidan & Liu, Zhi, 2023. "Forecasting realized volatility with machine learning: Panel data perspective," Journal of Empirical Finance, Elsevier, vol. 73(C), pages 251-271.
    9. Catania, Leopoldo & Proietti, Tommaso, 2020. "Forecasting volatility with time-varying leverage and volatility of volatility effects," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1301-1317.
    10. Huiling Yuan & Guodong Li & Junhui Wang, 2022. "High-Frequency-Based Volatility Model with Network Structure," Papers 2204.12933, arXiv.org.
    11. Chia-Lin Chang & Michael Mcaleer, 2009. "Daily Tourist Arrivals, Exchange Rates and Voatility for Korea and Taiwan," Korean Economic Review, Korean Economic Association, vol. 25, pages 241-267.
    12. M. Eren Akbiyik & Mert Erkul & Killian Kaempf & Vaiva Vasiliauskaite & Nino Antulov-Fantulin, 2021. "Ask "Who", Not "What": Bitcoin Volatility Forecasting with Twitter Data," Papers 2110.14317, arXiv.org, revised Dec 2022.
    13. Papantonis, Ioannis & Rompolis, Leonidas & Tzavalis, Elias, 2023. "Improving variance forecasts: The role of Realized Variance features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1221-1237.
    14. Bernardi, Mauro & Costola, Michele, 2019. "High-dimensional sparse financial networks through a regularised regression model," SAFE Working Paper Series 244, Leibniz Institute for Financial Research SAFE.
    15. Do, Hung Xuan & Nepal, Rabindra & Jamasb, Tooraj, 2020. "Electricity market integration, decarbonisation and security of supply: Dynamic volatility connectedness in the Irish and Great Britain markets," Energy Economics, Elsevier, vol. 92(C).
    16. Ping-Hung Chou & Pei-Shan Wu & Teng-Tsai Tu, 2014. "The Impact of Trader Behavior on Options Price Volatility," Asian Economic and Financial Review, Asian Economic and Social Society, vol. 4(4), pages 503-516, April.
    17. Wang, Yuejing & Ye, Wuyi & Jiang, Ying & Liu, Xiaoquan, 2024. "Volatility prediction for the energy sector with economic determinants: Evidence from a hybrid model," International Review of Financial Analysis, Elsevier, vol. 92(C).
    18. Fei, Tianlun & Liu, Xiaoquan & Wen, Conghua, 2019. "Cross-sectional return dispersion and volatility prediction," Pacific-Basin Finance Journal, Elsevier, vol. 58(C).
    19. Dinghai Xu, 2021. "A study on volatility spurious almost integration effect: A threshold realized GARCH approach," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 4104-4126, July.
    20. Mihaela Craioveanu & Eric Hillebrand, 2012. "Level changes in volatility models," Annals of Finance, Springer, vol. 8(2), pages 277-308, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1909.10035. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.