IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2412.19372.html
   My bibliography  Save this paper

Minimal Batch Adaptive Learning Policy Engine for Real-Time Mid-Price Forecasting in High-Frequency Trading

Author

Listed:
  • Adamantios Ntakaris
  • Gbenga Ibikunle

Abstract

High-frequency trading (HFT) has transformed modern financial markets, making reliable short-term price forecasting models essential. In this study, we present a novel approach to mid-price forecasting using Level 1 limit order book (LOB) data from NASDAQ, focusing on 100 U.S. stocks from the S&P 500 index during the period from September to November 2022. Expanding on our previous work with Radial Basis Function Neural Networks (RBFNN), which leveraged automated feature importance techniques based on mean decrease impurity (MDI) and gradient descent (GD), we introduce the Adaptive Learning Policy Engine (ALPE) - a reinforcement learning (RL)-based agent designed for batch-free, immediate mid-price forecasting. ALPE incorporates adaptive epsilon decay to dynamically balance exploration and exploitation, outperforming a diverse range of highly effective machine learning (ML) and deep learning (DL) models in forecasting performance.

Suggested Citation

  • Adamantios Ntakaris & Gbenga Ibikunle, 2024. "Minimal Batch Adaptive Learning Policy Engine for Real-Time Mid-Price Forecasting in High-Frequency Trading," Papers 2412.19372, arXiv.org, revised Dec 2024.
    • Handle: RePEc:arx:papers:2412.19372
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2412.19372
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Justin A. Sirignano, 2019. "Deep learning for limit order books," Quantitative Finance, Taylor & Francis Journals, vol. 19(4), pages 549-570, April.
    2. Ymir Mäkinen & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2019. "Forecasting jump arrivals in stock prices: new attention-based network architecture using limit order book data," Quantitative Finance, Taylor & Francis Journals, vol. 19(12), pages 2033-2050, December.
    3. Philip, R., 2020. "Estimating permanent price impact via machine learning," Journal of Econometrics, Elsevier, vol. 215(2), pages 414-449.
    4. Yuanrong Wang & Yinsen Miao & Alexander CY Wong & Nikita P Granger & Christian Michler, 2023. "Domain-adapted Learning and Interpretability: DRL for Gas Trading," Papers 2301.08359, arXiv.org, revised Sep 2023.
    5. G. Ibikunle & B. Moews & D. Muravyev & K. Rzayev, 2024. "Can machine learning unlock new insights into high-frequency trading?," Papers 2405.08101, arXiv.org, revised Jan 2025.
    6. Huijian Dong & Xiaomin Guo & Han Reichgelt & Ruizhi Hu, 2020. "Predictive power of ARIMA models in forecasting equity returns: a sliding window method," Journal of Asset Management, Palgrave Macmillan, vol. 21(6), pages 549-566, October.
    7. Arifovic, Jasmina & He, Xue-zhong & Wei, Lijian, 2022. "Machine learning and speed in high-frequency trading," Journal of Economic Dynamics and Control, Elsevier, vol. 139(C).
    8. Zhuang, Dian & Gan, Vincent J.L. & Duygu Tekler, Zeynep & Chong, Adrian & Tian, Shuai & Shi, Xing, 2023. "Data-driven predictive control for smart HVAC system in IoT-integrated buildings with time-series forecasting and reinforcement learning," Applied Energy, Elsevier, vol. 338(C).
    9. Adamantios Ntakaris & Giorgio Mirone & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2019. "Feature Engineering for Mid-Price Prediction with Deep Learning," Papers 1904.05384, arXiv.org, revised Jun 2019.
    10. Etaf Alshawarbeh & Alanazi Talal Abdulrahman & Eslam Hussam, 2023. "Statistical Modeling of High Frequency Datasets Using the ARIMA-ANN Hybrid," Mathematics, MDPI, vol. 11(22), pages 1-17, November.
    11. He, Xue-Zhong & Lin, Shen, 2022. "Reinforcement Learning Equilibrium in Limit Order Markets," Journal of Economic Dynamics and Control, Elsevier, vol. 144(C).
    12. Yi Cao & Jia Zhai, 2022. "Estimating price impact via deep reinforcement learning," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 3954-3970, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adamantios Ntakaris & Moncef Gabbouj & Juho Kanniainen, 2023. "Optimum Output Long Short-Term Memory Cell for High-Frequency Trading Forecasting," Papers 2304.09840, arXiv.org, revised May 2023.
    2. Breckenfelder, Johannes, 2024. "Competition among high-frequency traders and market quality," Journal of Economic Dynamics and Control, Elsevier, vol. 166(C).
    3. Luca Grilli & Domenico Santoro, 2022. "Forecasting financial time series with Boltzmann entropy through neural networks," Computational Management Science, Springer, vol. 19(4), pages 665-681, October.
    4. Chaeshick Chung & Sukjin Park, 2021. "Deep Learning Market Microstructure: Dual-Stage Attention-Based Recurrent Neural Networks," Working Papers 2108, Nam Duck-Woo Economic Research Institute, Sogang University (Former Research Institute for Market Economy).
    5. Adamantios Ntakaris & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2020. "Mid-price prediction based on machine learning methods with technical and quantitative indicators," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-39, June.
    6. Erdinc Akyildirim & Oguzhan Cepni & Shaen Corbet & Gazi Salah Uddin, 2023. "Forecasting mid-price movement of Bitcoin futures using machine learning," Annals of Operations Research, Springer, vol. 330(1), pages 553-584, November.
    7. Martin Magris & Mostafa Shabani & Alexandros Iosifidis, 2022. "Bayesian Bilinear Neural Network for Predicting the Mid-price Dynamics in Limit-Order Book Markets," Papers 2203.03613, arXiv.org, revised Jan 2023.
    8. Carè, Rosella & Cumming, Douglas, 2024. "Technology and automation in financial trading: A bibliometric review," Research in International Business and Finance, Elsevier, vol. 71(C).
    9. Ao Kong & Hongliang Zhu & Robert Azencott, 2021. "Predicting intraday jumps in stock prices using liquidity measures and technical indicators," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 416-438, April.
    10. Petter N. Kolm & Jeremy Turiel & Nicholas Westray, 2023. "Deep order flow imbalance: Extracting alpha at multiple horizons from the limit order book," Mathematical Finance, Wiley Blackwell, vol. 33(4), pages 1044-1081, October.
    11. Ye, Wuyi & Yang, Jinting & Chen, Pengzhan, 2024. "Short-term stock price trend prediction with imaging high frequency limit order book data," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1189-1205.
    12. Jiwon Jung & Kiseop Lee, 2024. "Attention-Based Reading, Highlighting, and Forecasting of the Limit Order Book," Papers 2409.02277, arXiv.org, revised Nov 2024.
    13. Doan, Bao & Vo, Duc Hong, 2021. "Is there any information content of traded stocks in an emerging market? Evidence from Vietnam," International Economics, Elsevier, vol. 167(C), pages 78-87.
    14. Antonio Briola & Silvia Bartolucci & Tomaso Aste, 2024. "Deep Limit Order Book Forecasting," Papers 2403.09267, arXiv.org, revised Jun 2024.
    15. He, Xue-Zhong & Lin, Shen, 2022. "Reinforcement Learning Equilibrium in Limit Order Markets," Journal of Economic Dynamics and Control, Elsevier, vol. 144(C).
    16. Behzadi, Amirmohammad & Duwig, Christophe & Ploskic, Adnan & Holmberg, Sture & Sadrizadeh, Sasan, 2024. "Application to novel smart techniques for decarbonization of commercial building heating and cooling through optimal energy management," Applied Energy, Elsevier, vol. 376(PA).
    17. James Wallbridge, 2020. "Transformers for Limit Order Books," Papers 2003.00130, arXiv.org.
    18. Hong Guo & Jianwu Lin & Fanlin Huang, 2023. "Market Making with Deep Reinforcement Learning from Limit Order Books," Papers 2305.15821, arXiv.org.
    19. Xianfeng Jiao & Zizhong Li & Chang Xu & Yang Liu & Weiqing Liu & Jiang Bian, 2023. "Microstructure-Empowered Stock Factor Extraction and Utilization," Papers 2308.08135, arXiv.org.
    20. Buis, Boyd & Pieterse-Bloem, Mary & Verschoor, Willem F.C. & Zwinkels, Remco C.J., 2024. "Gamma positioning and market quality," Journal of Economic Dynamics and Control, Elsevier, vol. 164(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2412.19372. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.