IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2003.00130.html
   My bibliography  Save this paper

Transformers for Limit Order Books

Author

Listed:
  • James Wallbridge

Abstract

We introduce a new deep learning architecture for predicting price movements from limit order books. This architecture uses a causal convolutional network for feature extraction in combination with masked self-attention to update features based on relevant contextual information. This architecture is shown to significantly outperform existing architectures such as those using convolutional networks (CNN) and Long-Short Term Memory (LSTM) establishing a new state-of-the-art benchmark for the FI-2010 dataset.

Suggested Citation

  • James Wallbridge, 2020. "Transformers for Limit Order Books," Papers 2003.00130, arXiv.org.
    • Handle: RePEc:arx:papers:2003.00130
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2003.00130
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Martin D. Gould & Mason A. Porter & Stacy Williams & Mark McDonald & Daniel J. Fenn & Sam D. Howison, 2010. "Limit Order Books," Papers 1012.0349, arXiv.org, revised Apr 2013.
    2. Avraam Tsantekidis & Nikolaos Passalis & Anastasios Tefas & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2018. "Using Deep Learning for price prediction by exploiting stationary limit order book features," Papers 1810.09965, arXiv.org.
    3. Ymir Mäkinen & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2019. "Forecasting jump arrivals in stock prices: new attention-based network architecture using limit order book data," Quantitative Finance, Taylor & Francis Journals, vol. 19(12), pages 2033-2050, December.
    4. Martin D. Gould & Mason A. Porter & Stacy Williams & Mark McDonald & Daniel J. Fenn & Sam D. Howison, 2013. "Limit order books," Quantitative Finance, Taylor & Francis Journals, vol. 13(11), pages 1709-1742, November.
    5. Wei Bao & Jun Yue & Yulei Rao, 2017. "A deep learning framework for financial time series using stacked autoencoders and long-short term memory," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-24, July.
    6. Adamantios Ntakaris & Martin Magris & Juho Kanniainen & Moncef Gabbouj & Alexandros Iosifidis, 2018. "Benchmark dataset for mid‐price forecasting of limit order book data with machine learning methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(8), pages 852-866, December.
    7. Fischer, Thomas & Krauss, Christopher, 2018. "Deep learning with long short-term memory networks for financial market predictions," European Journal of Operational Research, Elsevier, vol. 270(2), pages 654-669.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yufei Wu & Mahmoud Mahfouz & Daniele Magazzeni & Manuela Veloso, 2021. "Towards Robust Representation of Limit Orders Books for Deep Learning Models," Papers 2110.05479, arXiv.org, revised Dec 2022.
    2. Amit Milstein & Haoran Deng & Guy Revach & Hai Morgenstern & Nir Shlezinger, 2022. "Neural Augmented Kalman Filtering with Bollinger Bands for Pairs Trading," Papers 2210.15448, arXiv.org, revised Sep 2023.
    3. Matteo Prata & Giuseppe Masi & Leonardo Berti & Viviana Arrigoni & Andrea Coletta & Irene Cannistraci & Svitlana Vyetrenko & Paola Velardi & Novella Bartolini, 2023. "LOB-Based Deep Learning Models for Stock Price Trend Prediction: A Benchmark Study," Papers 2308.01915, arXiv.org, revised Sep 2023.
    4. Zihao Zhang & Bryan Lim & Stefan Zohren, 2021. "Deep Learning for Market by Order Data," Papers 2102.08811, arXiv.org, revised Jul 2021.
    5. Jonathan Sadighian, 2020. "Extending Deep Reinforcement Learning Frameworks in Cryptocurrency Market Making," Papers 2004.06985, arXiv.org.
    6. Zihao Zhang & Stefan Zohren, 2021. "Multi-Horizon Forecasting for Limit Order Books: Novel Deep Learning Approaches and Hardware Acceleration using Intelligent Processing Units," Papers 2105.10430, arXiv.org, revised Aug 2021.
    7. Yufei Wu & Mahmoud Mahfouz & Daniele Magazzeni & Manuela Veloso, 2021. "How Robust are Limit Order Book Representations under Data Perturbation?," Papers 2110.04752, arXiv.org.
    8. Ilia Zaznov & Julian Kunkel & Alfonso Dufour & Atta Badii, 2022. "Predicting Stock Price Changes Based on the Limit Order Book: A Survey," Mathematics, MDPI, vol. 10(8), pages 1-33, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zihao Zhang & Stefan Zohren & Stephen Roberts, 2018. "DeepLOB: Deep Convolutional Neural Networks for Limit Order Books," Papers 1808.03668, arXiv.org, revised Jan 2020.
    2. Schnaubelt, Matthias, 2022. "Deep reinforcement learning for the optimal placement of cryptocurrency limit orders," European Journal of Operational Research, Elsevier, vol. 296(3), pages 993-1006.
    3. Adamantios Ntakaris & Moncef Gabbouj & Juho Kanniainen, 2023. "Optimum Output Long Short-Term Memory Cell for High-Frequency Trading Forecasting," Papers 2304.09840, arXiv.org, revised May 2023.
    4. Zihao Zhang & Stefan Zohren, 2021. "Multi-Horizon Forecasting for Limit Order Books: Novel Deep Learning Approaches and Hardware Acceleration using Intelligent Processing Units," Papers 2105.10430, arXiv.org, revised Aug 2021.
    5. Peng Wu & Marcello Rambaldi & Jean-Franc{c}ois Muzy & Emmanuel Bacry, 2019. "Queue-reactive Hawkes models for the order flow," Papers 1901.08938, arXiv.org.
    6. Yamamoto, Ryuichi, 2019. "Dynamic Predictor Selection And Order Splitting In A Limit Order Market," Macroeconomic Dynamics, Cambridge University Press, vol. 23(5), pages 1757-1792, July.
    7. Ivan Jericevich & Patrick Chang & Tim Gebbie, 2021. "Simulation and estimation of a point-process market-model with a matching engine," Papers 2105.02211, arXiv.org, revised Aug 2021.
    8. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    9. Alberto Ciacci & Takumi Sueshige & Hideki Takayasu & Kim Christensen & Misako Takayasu, 2020. "The microscopic relationships between triangular arbitrage and cross-currency correlations in a simple agent based model of foreign exchange markets," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-19, June.
    10. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.
    11. Johannes Bleher & Michael Bleher & Thomas Dimpfl, 2020. "From orders to prices: A stochastic description of the limit order book to forecast intraday returns," Papers 2004.11953, arXiv.org, revised May 2021.
    12. Tucker Hybinette Balch & Mahmoud Mahfouz & Joshua Lockhart & Maria Hybinette & David Byrd, 2019. "How to Evaluate Trading Strategies: Single Agent Market Replay or Multiple Agent Interactive Simulation?," Papers 1906.12010, arXiv.org.
    13. Johannes C. Müller & Sebastian Pokutta & Alexander Martin & Susanne Pape & Andrea Peter & Thomas Winter, 2017. "Pricing and clearing combinatorial markets with singleton and swap orders," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 85(2), pages 155-177, April.
    14. Hai-Chuan Xu & Wei Chen & Xiong Xiong & Wei Zhang & Wei-Xing Zhou & H Eugene Stanley, 2016. "Limit-order book resiliency after effective market orders: Spread, depth and intensity," Papers 1602.00731, arXiv.org, revised Feb 2017.
    15. Ranjan R. Chakravarty & Sudhanshu Pani, 2021. "A Data Paradigm to Operationalise Expanded Filtration: Realized Volatilities and Kernels from Non-Synchronous NASDAQ Quotes and Trades," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(4), pages 617-652, December.
    16. Ningyuan Chen & Steven Kou & Chun Wang, 2018. "A Partitioning Algorithm for Markov Decision Processes with Applications to Market Microstructure," Management Science, INFORMS, vol. 64(2), pages 784-803, February.
    17. Qing-Qing Yang & Wai-Ki Ching & Jiawen Gu & Tak-Kuen Siu, 2020. "Trading strategy with stochastic volatility in a limit order book market," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(1), pages 277-301, June.
    18. Gu, Gao-Feng & Xiong, Xiong & Zhang, Yong-Jie & Chen, Wei & Zhang, Wei & Zhou, Wei-Xing, 2016. "Stylized facts of price gaps in limit order books," Chaos, Solitons & Fractals, Elsevier, vol. 88(C), pages 48-58.
    19. Xuefeng Gao & S. J. Deng, 2014. "Hydrodynamic limit of order book dynamics," Papers 1411.7502, arXiv.org, revised Feb 2016.
    20. Masashi Ieda, 2015. "A dynamic optimal execution strategy under stochastic price recovery," Papers 1502.04521, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2003.00130. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.