IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2307.01816.html
   My bibliography  Save this paper

Over-the-Counter Market Making via Reinforcement Learning

Author

Listed:
  • Zhou Fang
  • Haiqing Xu

Abstract

The over-the-counter (OTC) market is characterized by a unique feature that allows market makers to adjust bid-ask spreads based on order size. However, this flexibility introduces complexity, transforming the market-making problem into a high-dimensional stochastic control problem that presents significant challenges. To address this, this paper proposes an innovative solution utilizing reinforcement learning techniques to tackle the OTC market-making problem. By assuming a linear inverse relationship between market order arrival intensity and bid-ask spreads, we demonstrate the optimal policy for bid-ask spreads follows a Gaussian distribution. We apply two reinforcement learning algorithms to conduct a numerical analysis, revealing the resulting return distribution and bid-ask spreads under different time and inventory levels.

Suggested Citation

  • Zhou Fang & Haiqing Xu, 2023. "Over-the-Counter Market Making via Reinforcement Learning," Papers 2307.01816, arXiv.org.
    • Handle: RePEc:arx:papers:2307.01816
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2307.01816
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philippe Bergault & Olivier Guéant, 2021. "Size matters for OTC market makers: General results and dimensionality reduction techniques," Mathematical Finance, Wiley Blackwell, vol. 31(1), pages 279-322, January.
    2. repec:bla:jfinan:v:43:y:1988:i:3:p:617-37 is not listed on IDEAS
    3. Marco Avellaneda & Sasha Stoikov, 2008. "High-frequency trading in a limit order book," Quantitative Finance, Taylor & Francis Journals, vol. 8(3), pages 217-224.
    4. Alexander Barzykin & Philippe Bergault & Olivier Guéant, 2022. "Dealing with multi-currency inventory risk in FX cash markets," Working Papers hal-03857966, HAL.
    5. Grossman, S.J. & Miller, M.H., 1988. "Liquidity And Market Structure," Papers 88, Princeton, Department of Economics - Financial Research Center.
    6. Yanwei Jia & Xun Yu Zhou, 2021. "Policy Gradient and Actor-Critic Learning in Continuous Time and Space: Theory and Algorithms," Papers 2111.11232, arXiv.org, revised Jul 2022.
    7. Philippe Bergault & David Evangelista & Olivier Guéant & Douglas Vieira, 2021. "Closed-form Approximations in Multi-asset Market Making," Applied Mathematical Finance, Taylor & Francis Journals, vol. 28(2), pages 101-142, March.
    8. Ho, Thomas & Stoll, Hans R., 1981. "Optimal dealer pricing under transactions and return uncertainty," Journal of Financial Economics, Elsevier, vol. 9(1), pages 47-73, March.
    9. Yanwei Jia & Xun Yu Zhou, 2021. "Policy Evaluation and Temporal-Difference Learning in Continuous Time and Space: A Martingale Approach," Papers 2108.06655, arXiv.org, revised Feb 2022.
    10. Álvaro Cartea & Yixuan Wang, 2020. "Market Making With Alpha Signals," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 23(03), pages 1-26, May.
    11. Álvaro Cartea & Yixuan Wang, 2019. "Market making with minimum resting times," Quantitative Finance, Taylor & Francis Journals, vol. 19(6), pages 903-920, June.
    12. Jonathan Sadighian, 2020. "Extending Deep Reinforcement Learning Frameworks in Cryptocurrency Market Making," Papers 2004.06985, arXiv.org.
    13. Sumitra Ganesh & Nelson Vadori & Mengda Xu & Hua Zheng & Prashant Reddy & Manuela Veloso, 2019. "Reinforcement Learning for Market Making in a Multi-agent Dealer Market," Papers 1911.05892, arXiv.org.
    14. Philippe Bergault & David Evangelista & Olivier Guéant & Douglas Vieira, 2021. "Closed-form Approximations in Multi-asset Market Making," Post-Print hal-03885121, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou Fang & Haiqing Xu, 2023. "Market Making of Options via Reinforcement Learning," Papers 2307.01814, arXiv.org.
    2. Marcello Monga, 2024. "Automated Market Making and Decentralized Finance," Papers 2407.16885, arXiv.org.
    3. Philippe Bergault & Louis Bertucci & David Bouba & Olivier Gu'eant, 2022. "Automated Market Makers: Mean-Variance Analysis of LPs Payoffs and Design of Pricing Functions," Papers 2212.00336, arXiv.org, revised Nov 2023.
    4. Philippe Bergault & Louis Bertucci & David Bouba & Olivier Gu'eant & Julien Guilbert, 2024. "Price-Aware Automated Market Makers: Models Beyond Brownian Prices and Static Liquidity," Papers 2405.03496, arXiv.org, revised May 2024.
    5. Mathieu Rosenbaum & Jianfei Zhang, 2022. "Multi-asset market making under the quadratic rough Heston," Papers 2212.10164, arXiv.org.
    6. Bastien Baldacci & Philippe Bergault & Dylan Possamai, 2022. "A mean-field game of market-making against strategic traders," Papers 2203.13053, arXiv.org.
    7. Philippe Bergault & Olivier Gu'eant, 2023. "Liquidity Dynamics in RFQ Markets and Impact on Pricing," Papers 2309.04216, arXiv.org, revised Jun 2024.
    8. Robert Boyce & Martin Herdegen & Leandro S'anchez-Betancourt, 2024. "Market Making with Exogenous Competition," Papers 2407.17393, arXiv.org.
    9. Joseph Jerome & Leandro Sanchez-Betancourt & Rahul Savani & Martin Herdegen, 2022. "Model-based gym environments for limit order book trading," Papers 2209.07823, arXiv.org.
    10. Bruno Gašperov & Stjepan Begušić & Petra Posedel Šimović & Zvonko Kostanjčar, 2021. "Reinforcement Learning Approaches to Optimal Market Making," Mathematics, MDPI, vol. 9(21), pages 1-22, October.
    11. Alexander Barzykin & Philippe Bergault & Olivier Gu'eant, 2021. "Algorithmic market making in dealer markets with hedging and market impact," Papers 2106.06974, arXiv.org, revised Dec 2022.
    12. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    13. Philippe Bergault & Olivier Guéant, 2021. "Size matters for OTC market makers: General results and dimensionality reduction techniques," Mathematical Finance, Wiley Blackwell, vol. 31(1), pages 279-322, January.
    14. Philippe Bergault & David Evangelista & Olivier Gu'eant & Douglas Vieira, 2018. "Closed-form approximations in multi-asset market making," Papers 1810.04383, arXiv.org, revised Sep 2022.
    15. Bastien Baldacci & Joffrey Derchu & Iuliia Manziuk, 2020. "An approximate solution for options market-making in high dimension," Papers 2009.00907, arXiv.org.
    16. Alexander Barzykin & Philippe Bergault & Olivier Guéant, 2023. "Algorithmic market making in dealer markets with hedging and market impact," Mathematical Finance, Wiley Blackwell, vol. 33(1), pages 41-79, January.
    17. Olivier Guéant, 2016. "The Financial Mathematics of Market Liquidity: From Optimal Execution to Market Making," Post-Print hal-01393136, HAL.
    18. Olivier Guéant, 2022. "Computational methods for market making algorithms," Post-Print hal-04590381, HAL.
    19. Alexander Barzykin & Philippe Bergault & Olivier Gu'eant, 2021. "Market making by an FX dealer: tiers, pricing ladders and hedging rates for optimal risk control," Papers 2112.02269, arXiv.org, revised Jun 2023.
    20. Ali Raheman & Anton Kolonin & Alexey Glushchenko & Arseniy Fokin & Ikram Ansari, 2022. "Adaptive Multi-Strategy Market-Making Agent For Volatile Markets," Papers 2204.13265, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2307.01816. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.