IDEAS home Printed from https://ideas.repec.org/a/spr/fininn/v10y2024i1d10.1186_s40854-024-00660-0.html
   My bibliography  Save this article

Predictive crypto-asset automated market maker architecture for decentralized finance using deep reinforcement learning

Author

Listed:
  • Tristan Lim

    (Nanyang Polytechnic)

Abstract

This study proposes a quote-driven predictive automated market maker (AMM) platform with on-chain custody and settlement functions, alongside off-chain predictive reinforcement learning capabilities, to improve the liquidity provision of real-world AMMs. The proposed architecture augments Uniswap V3, a cryptocurrency AMM protocol, by using a novel market equilibrium pricing to reduce divergence and slippage losses. Furthermore, the proposed architecture involves a predictive AMM capability, for which a deep hybrid long short-term memory (LSTM) and Q-learning reinforcement learning framework is used. It seeks to improve market efficiency through obtaining more accurate forecasts of liquidity concentration ranges, where liquidity starts moving to expected concentration ranges prior to asset price movement; thus, liquidity utilization is improved. The augmented protocol framework is expected to have practical real-world implications through (1) reducing divergence loss for liquidity providers; (2) reducing slippage for crypto-asset traders; and (3) improving capital efficiency for liquidity provision for the AMM protocol. The proposed architecture is empirically benchmarked against the well-established Uniswap V3 AMM architecture. The preliminary findings indicate that the novel AMM framework offers enhanced capital efficiency, reduced divergence loss, and diminished slippage, which could potentially address several of the challenges inherent to AMMs.

Suggested Citation

  • Tristan Lim, 2024. "Predictive crypto-asset automated market maker architecture for decentralized finance using deep reinforcement learning," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-29, December.
    • Handle: RePEc:spr:fininn:v:10:y:2024:i:1:d:10.1186_s40854-024-00660-0
    DOI: 10.1186/s40854-024-00660-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1186/s40854-024-00660-0
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1186/s40854-024-00660-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abbas Haider & Hui Wang & Bryan Scotney & Glenn Hawe, 2022. "Predictive Market Making via Machine Learning," SN Operations Research Forum, Springer, vol. 3(1), pages 1-21, March.
    2. Vijay Mohan, 2022. "Automated market makers and decentralized exchanges: a DeFi primer," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-48, December.
    3. Mohsen Pourpouneh & Kurt Nielsen & Omri Ross, 2020. "Automated Market Makers," IFRO Working Paper 2020/08, University of Copenhagen, Department of Food and Resource Economics.
    4. Raphael Auer & Bernhard Haslhofer & Stefan Kitzler & Pietro Saggese & Friedhelm Victor, 2024. "The technology of decentralized finance (DeFi)," Digital Finance, Springer, vol. 6(1), pages 55-95, March.
    5. Jonathan Sadighian, 2019. "Deep Reinforcement Learning in Cryptocurrency Market Making," Papers 1911.08647, arXiv.org.
    6. Nicholas T. Chan and Christian Shelton, 2001. "An Adaptive Electronic Market-Maker," Computing in Economics and Finance 2001 146, Society for Computational Economics.
    7. Lioba Heimbach & Eric Schertenleib & Roger Wattenhofer, 2022. "Risks and Returns of Uniswap V3 Liquidity Providers," Papers 2205.08904, arXiv.org, revised Sep 2022.
    8. Bikramaditya Ghosh & Hayfa Kazouz & Zaghum Umar, 2023. "Do Automated Market Makers in DeFi Ecosystem Exhibit Time-Varying Connectedness during Stressed Events?," JRFM, MDPI, vol. 16(5), pages 1-12, April.
    9. Kraaijeveld, Olivier & De Smedt, Johannes, 2020. "The predictive power of public Twitter sentiment for forecasting cryptocurrency prices," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 65(C).
    10. Zexin Hu & Yiqi Zhao & Matloob Khushi, 2021. "A Survey of Forex and Stock Price Prediction Using Deep Learning," Papers 2103.09750, arXiv.org.
    11. Jonathan Sadighian, 2020. "Extending Deep Reinforcement Learning Frameworks in Cryptocurrency Market Making," Papers 2004.06985, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tristan Lim, 2022. "Predictive Crypto-Asset Automated Market Making Architecture for Decentralized Finance using Deep Reinforcement Learning," Papers 2211.01346, arXiv.org, revised Jan 2023.
    2. Bruno Gašperov & Stjepan Begušić & Petra Posedel Šimović & Zvonko Kostanjčar, 2021. "Reinforcement Learning Approaches to Optimal Market Making," Mathematics, MDPI, vol. 9(21), pages 1-22, October.
    3. Luca Lalor & Anatoliy Swishchuk, 2024. "Reinforcement Learning in Non-Markov Market-Making," Papers 2410.14504, arXiv.org, revised Nov 2024.
    4. Hong Guo & Jianwu Lin & Fanlin Huang, 2023. "Market Making with Deep Reinforcement Learning from Limit Order Books," Papers 2305.15821, arXiv.org.
    5. Adrian Millea, 2021. "Deep Reinforcement Learning for Trading—A Critical Survey," Data, MDPI, vol. 6(11), pages 1-25, November.
    6. Ali Raheman & Anton Kolonin & Alexey Glushchenko & Arseniy Fokin & Ikram Ansari, 2022. "Adaptive Multi-Strategy Market-Making Agent For Volatile Markets," Papers 2204.13265, arXiv.org.
    7. Joseph Jerome & Gregory Palmer & Rahul Savani, 2022. "Market Making with Scaled Beta Policies," Papers 2207.03352, arXiv.org, revised Sep 2022.
    8. Joseph Jerome & Leandro Sanchez-Betancourt & Rahul Savani & Martin Herdegen, 2022. "Model-based gym environments for limit order book trading," Papers 2209.07823, arXiv.org.
    9. Jiafa He & Cong Zheng & Can Yang, 2023. "Integrating Tick-level Data and Periodical Signal for High-frequency Market Making," Papers 2306.17179, arXiv.org.
    10. Hui Niu & Siyuan Li & Jiahao Zheng & Zhouchi Lin & Jian Li & Jian Guo & Bo An, 2023. "IMM: An Imitative Reinforcement Learning Approach with Predictive Representation Learning for Automatic Market Making," Papers 2308.08918, arXiv.org.
    11. Hongcheng Ding & Xuanze Zhao & Zixiao Jiang & Shamsul Nahar Abdullah & Deshinta Arrova Dewi, 2024. "EUR-USD Exchange Rate Forecasting Based on Information Fusion with Large Language Models and Deep Learning Methods," Papers 2408.13214, arXiv.org.
    12. Eduard Hartwich & Alexander Rieger & Johannes Sedlmeir & Dominik Jurek & Gilbert Fridgen, 2023. "Machine economies," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-13, December.
    13. Arman Abgaryan & Utkarsh Sharma, 2024. "IntraLayer: A Platform of Digital Finance Platforms," Papers 2412.07348, arXiv.org.
    14. Annetta Ho & Cosmin Cazan & Andrew Schrumm, 2024. "The Ecology of Automated Market Makers," Discussion Papers 2024-12, Bank of Canada.
    15. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    16. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.
    17. Fischer, Thomas G., 2018. "Reinforcement learning in financial markets - a survey," FAU Discussion Papers in Economics 12/2018, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    18. Man-Fai Leung & Lewis Chan & Wai-Chak Hung & Siu-Fung Tsoi & Chun-Hin Lam & Yiu-Hang Cheng, 2023. "An Intelligent System for Trading Signal of Cryptocurrency Based on Market Tweets Sentiments," FinTech, MDPI, vol. 2(1), pages 1-17, March.
    19. Erdong Chen & Mengzhong Ma & Zixin Nie, 2024. "Exploring the Impact: How Decentralized Exchange Designs Shape Traders' Behavior on Perpetual Future Contracts," Papers 2402.03953, arXiv.org, revised Apr 2024.
    20. Ravi Kashyap, 2024. "The Concentration Risk Indicator: Raising the Bar for Financial Stability and Portfolio Performance Measurement," Papers 2408.07271, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:fininn:v:10:y:2024:i:1:d:10.1186_s40854-024-00660-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.