IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2407.01577.html
   My bibliography  Save this paper

MOT: A Mixture of Actors Reinforcement Learning Method by Optimal Transport for Algorithmic Trading

Author

Listed:
  • Xi Cheng
  • Jinghao Zhang
  • Yunan Zeng
  • Wenfang Xue

Abstract

Algorithmic trading refers to executing buy and sell orders for specific assets based on automatically identified trading opportunities. Strategies based on reinforcement learning (RL) have demonstrated remarkable capabilities in addressing algorithmic trading problems. However, the trading patterns differ among market conditions due to shifted distribution data. Ignoring multiple patterns in the data will undermine the performance of RL. In this paper, we propose MOT,which designs multiple actors with disentangled representation learning to model the different patterns of the market. Furthermore, we incorporate the Optimal Transport (OT) algorithm to allocate samples to the appropriate actor by introducing a regularization loss term. Additionally, we propose Pretrain Module to facilitate imitation learning by aligning the outputs of actors with expert strategy and better balance the exploration and exploitation of RL. Experimental results on real futures market data demonstrate that MOT exhibits excellent profit capabilities while balancing risks. Ablation studies validate the effectiveness of the components of MOT.

Suggested Citation

  • Xi Cheng & Jinghao Zhang & Yunan Zeng & Wenfang Xue, 2024. "MOT: A Mixture of Actors Reinforcement Learning Method by Optimal Transport for Algorithmic Trading," Papers 2407.01577, arXiv.org.
  • Handle: RePEc:arx:papers:2407.01577
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2407.01577
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F & French, Kenneth R, 1996. "Multifactor Explanations of Asset Pricing Anomalies," Journal of Finance, American Finance Association, vol. 51(1), pages 55-84, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Harrison Hong & Terence Lim & Jeremy C. Stein, 2000. "Bad News Travels Slowly: Size, Analyst Coverage, and the Profitability of Momentum Strategies," Journal of Finance, American Finance Association, vol. 55(1), pages 265-295, February.
    2. Eun, Cheol & Lee, Kyuseok & Wei, Fengrong, 2023. "Dual role of the country factors in international asset pricing: The local factors and proxies for the global factors," International Review of Financial Analysis, Elsevier, vol. 89(C).
    3. Muhammad Kashif & Thomas Leirvik, 2022. "The MAX Effect in an Oil Exporting Country: The Case of Norway," JRFM, MDPI, vol. 15(4), pages 1-16, March.
    4. Pastor, Lubos & Stambaugh, Robert F., 2003. "Liquidity Risk and Expected Stock Returns," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 642-685, June.
    5. Abugri, Benjamin A. & Dutta, Sandip, 2014. "Are we overestimating REIT idiosyncratic risk? Analysis of pricing effects and persistence," International Review of Economics & Finance, Elsevier, vol. 29(C), pages 249-259.
    6. Philip A. Stork, 2011. "The intertemporal mechanics of European stock price momentum," Studies in Economics and Finance, Emerald Group Publishing Limited, vol. 28(3), pages 217-232, August.
    7. Robert P. Flood & Andrew K. Rose, 2005. "Financial Integration: A New Methodology And An Illustration," Journal of the European Economic Association, MIT Press, vol. 3(6), pages 1349-1359, December.
    8. Dimitrios D. Thomakos & Michail S. Koubouros, 2011. "The Role of Realised Volatility in the Athens Stock Exchange," Multinational Finance Journal, Multinational Finance Journal, vol. 15(1-2), pages 87-124, March - J.
    9. Tobias J. Moskowitz & Mark Grinblatt, 2002. "What Do We Really Know About the Cross-Sectional Relation Between Past and Expected Returns?," Yale School of Management Working Papers ysm259, Yale School of Management.
    10. Borovička, Jaroslav & Hansen, Lars Peter, 2014. "Examining macroeconomic models through the lens of asset pricing," Journal of Econometrics, Elsevier, vol. 183(1), pages 67-90.
    11. Alan Gregory & Julie Whittaker, 2013. "Exploring the Valuation of Corporate Social Responsibility—A Comparison of Research Methods," Journal of Business Ethics, Springer, vol. 116(1), pages 1-20, August.
    12. John H. Cochrane, 1999. "New facts in finance," Economic Perspectives, Federal Reserve Bank of Chicago, vol. 23(Q III), pages 36-58.
    13. Chongsoo An & John J. Cheh & Il-woon Kim, 2017. "Do Value Stocks Outperform Growth Stocks in the U.S. Stock Market?," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 7(2), pages 1-7.
    14. Gniadkowska-Szymańska Agata, 2017. "The impact of trading liquidity on the rate of return on emerging markets: the example of Poland and the Baltic countries," Financial Internet Quarterly (formerly e-Finanse), Sciendo, vol. 13(4), pages 136-148, December.
    15. Tim Brailsford & Clive Gaunt & Michael A O’Brien, 2012. "Size and book-to-market factors in Australia," Australian Journal of Management, Australian School of Business, vol. 37(2), pages 261-281, August.
    16. Javier Vidal-García & Marta Vidal & Sabri Boubaker & Riadh Manita, 2019. "Idiosyncratic risk and mutual fund performance," Annals of Operations Research, Springer, vol. 281(1), pages 349-372, October.
    17. Cakici, Nusret & Zaremba, Adam, 2022. "Salience theory and the cross-section of stock returns: International and further evidence," Journal of Financial Economics, Elsevier, vol. 146(2), pages 689-725.
    18. Hou, Yang & Meng, Jiayin, 2018. "The momentum effect in the Chinese market and its relationship with the simultaneous and the lagged investor sentiment," MPRA Paper 94838, University Library of Munich, Germany.
    19. Michael E. Drew & Jon D. Stanford, 2003. "Retail Superannuation Management in Australia: Risk, Cost and Alpha," School of Economics and Finance Discussion Papers and Working Papers Series 126, School of Economics and Finance, Queensland University of Technology.
    20. Souza, Thiago de Oliveira, 2020. "Dollar carry timing," Discussion Papers on Economics 10/2020, University of Southern Denmark, Department of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2407.01577. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.