IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2103.01670.html
   My bibliography  Save this paper

The LOB Recreation Model: Predicting the Limit Order Book from TAQ History Using an Ordinary Differential Equation Recurrent Neural Network

Author

Listed:
  • Zijian Shi
  • Yu Chen
  • John Cartlidge

Abstract

In an order-driven financial market, the price of a financial asset is discovered through the interaction of orders - requests to buy or sell at a particular price - that are posted to the public limit order book (LOB). Therefore, LOB data is extremely valuable for modelling market dynamics. However, LOB data is not freely accessible, which poses a challenge to market participants and researchers wishing to exploit this information. Fortunately, trades and quotes (TAQ) data - orders arriving at the top of the LOB, and trades executing in the market - are more readily available. In this paper, we present the LOB recreation model, a first attempt from a deep learning perspective to recreate the top five price levels of the LOB for small-tick stocks using only TAQ data. Volumes of orders sitting deep in the LOB are predicted by combining outputs from: (1) a history compiler that uses a Gated Recurrent Unit (GRU) module to selectively compile prediction relevant quote history; (2) a market events simulator, which uses an Ordinary Differential Equation Recurrent Neural Network (ODE-RNN) to simulate the accumulation of net order arrivals; and (3) a weighting scheme to adaptively combine the predictions generated by (1) and (2). By the paradigm of transfer learning, the source model trained on one stock can be fine-tuned to enable application to other financial assets of the same class with much lower demand on additional data. Comprehensive experiments conducted on two real world intraday LOB datasets demonstrate that the proposed model can efficiently recreate the LOB with high accuracy using only TAQ data as input.

Suggested Citation

  • Zijian Shi & Yu Chen & John Cartlidge, 2021. "The LOB Recreation Model: Predicting the Limit Order Book from TAQ History Using an Ordinary Differential Equation Recurrent Neural Network," Papers 2103.01670, arXiv.org.
    • Handle: RePEc:arx:papers:2103.01670
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2103.01670
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rama Cont & Sasha Stoikov & Rishi Talreja, 2010. "A Stochastic Model for Order Book Dynamics," Operations Research, INFORMS, vol. 58(3), pages 549-563, June.
    2. I. Muni Toke, 2015. "The order book as a queueing system: average depth and influence of the size of limit orders," Quantitative Finance, Taylor & Francis Journals, vol. 15(5), pages 795-808, May.
    3. Charles Cao & Oliver Hansch & Xiaoxin Wang, 2009. "The information content of an open limit‐order book," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 29(1), pages 16-41, January.
    4. Arthur, W.B. & Holland, J.H. & LeBaron, B. & Palmer, R. & Tayler, P., 1996. "Asset Pricing Under Endogenous Expectations in an Artificial Stock Market," Working papers 9625, Wisconsin Madison - Social Systems.
    5. Biais, Bruno & Hillion, Pierre & Spatt, Chester, 1995. "An Empirical Analysis of the Limit Order Book and the Order Flow in the Paris Bourse," Journal of Finance, American Finance Association, vol. 50(5), pages 1655-1689, December.
    6. Justin Sirignano & Rama Cont, 2019. "Universal features of price formation in financial markets: perspectives from deep learning," Quantitative Finance, Taylor & Francis Journals, vol. 19(9), pages 1449-1459, September.
    7. Ioane Muni Toke, 2015. "The order book as a queueing system: average depth and influence of the size of limit orders," Post-Print hal-01006410, HAL.
    8. W. Brian Arthur & Paul Tayler, "undated". "Asset Pricing Under Endogenous Expectations in an Artificial Stock Market," Computing in Economics and Finance 1997 57, Society for Computational Economics.
    9. Junyi Li & Xitong Wang & Yaoyang Lin & Arunesh Sinha & Micheal P. Wellman, 2020. "Generating Realistic Stock Market Order Streams," Papers 2006.04212, arXiv.org.
    10. Rama Cont & Adrien de Larrard, 2013. "Price Dynamics in a Markovian Limit Order Market," Post-Print hal-00552252, HAL.
    11. Adamantios Ntakaris & Martin Magris & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2018. "Benchmark dataset for mid‐price forecasting of limit order book data with machine learning methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(8), pages 852-866, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zijian Shi & John Cartlidge, 2021. "The Limit Order Book Recreation Model (LOBRM): An Extended Analysis," Papers 2107.00534, arXiv.org.
    2. Zacharia Issa & Blanka Horvath & Maud Lemercier & Cristopher Salvi, 2023. "Non-adversarial training of Neural SDEs with signature kernel scores," Papers 2305.16274, arXiv.org.
    3. Zijian Shi & John Cartlidge, 2023. "Neural Stochastic Agent-Based Limit Order Book Simulation: A Hybrid Methodology," Papers 2303.00080, arXiv.org.
    4. Xianfeng Jiao & Zizhong Li & Chang Xu & Yang Liu & Weiqing Liu & Jiang Bian, 2023. "Microstructure-Empowered Stock Factor Extraction and Utilization," Papers 2308.08135, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zijian Shi & John Cartlidge, 2021. "The Limit Order Book Recreation Model (LOBRM): An Extended Analysis," Papers 2107.00534, arXiv.org.
    2. M. Derksen & B. Kleijn & R. de Vilder, 2019. "Clearing price distributions in call auctions," Papers 1904.07583, arXiv.org, revised Nov 2019.
    3. Zijian Shi & John Cartlidge, 2024. "Neural stochastic agent‐based limit order book simulation with neural point process and diffusion probabilistic model," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 31(2), June.
    4. Frank Kelly & Elena Yudovina, 2018. "A Markov Model of a Limit Order Book: Thresholds, Recurrence, and Trading Strategies," Mathematics of Operations Research, INFORMS, vol. 43(1), pages 181-203, February.
    5. Clinet, Simon & Yoshida, Nakahiro, 2017. "Statistical inference for ergodic point processes and application to Limit Order Book," Stochastic Processes and their Applications, Elsevier, vol. 127(6), pages 1800-1839.
    6. Ioane Muni Toke, 2017. "Stationary Distribution Of The Volume At The Best Quote In A Poisson Order Book Model," Post-Print hal-01705085, HAL.
    7. Efstathios Panayi & Gareth W. Peters, 2015. "Stochastic simulation framework for the limit order book using liquidity-motivated agents," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 2(02), pages 1-52.
    8. Ioane Muni Toke, 2017. "Stationary Distribution Of The Volume At The Best Quote In A Poisson Order Book Model," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 20(06), pages 1-22, September.
    9. Efstathios Panayi & Gareth Peters, 2015. "Stochastic simulation framework for the Limit Order Book using liquidity motivated agents," Papers 1501.02447, arXiv.org, revised Jan 2015.
    10. Ulrich Horst & Michael Paulsen, 2017. "A Law of Large Numbers for Limit Order Books," Mathematics of Operations Research, INFORMS, vol. 42(4), pages 1280-1312, November.
    11. Hong Guo & Jianwu Lin & Fanlin Huang, 2023. "Market Making with Deep Reinforcement Learning from Limit Order Books," Papers 2305.15821, arXiv.org.
    12. Johannes Bleher & Michael Bleher & Thomas Dimpfl, 2020. "From orders to prices: A stochastic description of the limit order book to forecast intraday returns," Papers 2004.11953, arXiv.org, revised May 2021.
    13. Rene Carmona & Kevin Webster, 2013. "The Self-Financing Equation in High Frequency Markets," Papers 1312.2302, arXiv.org.
    14. Mohammad Zare & Omid Naghshineh Arjmand & Erfan Salavati & Adel Mohammadpour, 2021. "An Agent‐Based model for Limit Order Book: Estimation and simulation," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(1), pages 1112-1121, January.
    15. Kyungsub Lee & Byoung Ki Seo, 2021. "Analytic formula for option margin with liquidity costs under dynamic delta hedging," Papers 2103.15302, arXiv.org.
    16. Ulrich Horst & Michael Paulsen, 2015. "A law of large numbers for limit order books," Papers 1501.00843, arXiv.org.
    17. Mostafa Shabani & Martin Magris & George Tzagkarakis & Juho Kanniainen & Alexandros Iosifidis, 2022. "Predicting the State of Synchronization of Financial Time Series using Cross Recurrence Plots," Papers 2210.14605, arXiv.org, revised Nov 2022.
    18. Ben Hambly & Jasdeep Kalsi & James Newbury, 2018. "Limit order books, diffusion approximations and reflected SPDEs: from microscopic to macroscopic models," Papers 1808.07107, arXiv.org, revised Jun 2019.
    19. Christian Bayer & Ulrich Horst & Jinniao Qiu, 2014. "A Functional Limit Theorem for Limit Order Books with State Dependent Price Dynamics," Papers 1405.5230, arXiv.org, revised Aug 2016.
    20. Ioane Muni Toke, 2016. "Reconstruction of Order Flows using Aggregated Data," Post-Print hal-01705074, HAL.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2103.01670. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.