IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2109.10429.html
   My bibliography  Save this paper

Exploring Coevolutionary Dynamics of Competitive Arms-Races Between Infinitely Diverse Heterogenous Adaptive Automated Trader-Agents

Author

Listed:
  • Nik Alexandrov
  • Dave Cliff
  • Charlie Figuero

Abstract

We report on a series of experiments in which we study the coevolutionary "arms-race" dynamics among groups of agents that engage in adaptive automated trading in an accurate model of contemporary financial markets. At any one time, every trader in the market is trying to make as much profit as possible given the current distribution of different other trading strategies that it finds itself pitched against in the market; but the distribution of trading strategies and their observable behaviors is constantly changing, and changes in any one trader are driven to some extent by the changes in all the others. Prior studies of coevolutionary dynamics in markets have concentrated on systems where traders can choose one of a small number of fixed pure strategies, and can change their choice occasionally, thereby giving a market with a discrete phase-space, made up of a finite set of possible system states. Here we present first results from two independent sets of experiments, where we use minimal-intelligence trading-agents but in which the space of possible strategies is continuous and hence infinite. Our work reveals that by taking only a small step in the direction of increased realism we move immediately into high-dimensional phase-spaces, which then present difficulties in visualising and understanding the coevolutionary dynamics unfolding within the system. We conclude that further research is required to establish better analytic tools for monitoring activity and progress in co-adapting markets. We have released relevant Python code as open-source on GitHub, to enable others to continue this work.

Suggested Citation

  • Nik Alexandrov & Dave Cliff & Charlie Figuero, 2021. "Exploring Coevolutionary Dynamics of Competitive Arms-Races Between Infinitely Diverse Heterogenous Adaptive Automated Trader-Agents," Papers 2109.10429, arXiv.org.
    • Handle: RePEc:arx:papers:2109.10429
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2109.10429
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dave Cliff, 2018. "BSE: A Minimal Simulation of a Limit-Order-Book Stock Exchange," Papers 1809.06027, arXiv.org.
    2. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    3. J. Doyne Farmer & Paolo Patelli & Ilija I. Zovko, 2003. "The Predictive Power of Zero Intelligence in Financial Markets," Papers cond-mat/0309233, arXiv.org, revised Feb 2004.
    4. Abergel,Frédéric & Anane,Marouane & Chakraborti,Anirban & Jedidi,Aymen & Muni Toke,Ioane, 2016. "Limit Order Books," Cambridge Books, Cambridge University Press, number 9781107163980, September.
    5. Frédéric Abergel & Anirban Chakraborti & Aymen Jedidi & Ioane Muni Toke & Marouane Anane, 2016. "Limit Order Books," Post-Print hal-02177394, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Svitlana Vyetrenko & David Byrd & Nick Petosa & Mahmoud Mahfouz & Danial Dervovic & Manuela Veloso & Tucker Hybinette Balch, 2019. "Get Real: Realism Metrics for Robust Limit Order Book Market Simulations," Papers 1912.04941, arXiv.org.
    2. Dave Cliff, 2021. "BBE: Simulating the Microstructural Dynamics of an In-Play Betting Exchange via Agent-Based Modelling," Papers 2105.08310, arXiv.org.
    3. Peng Wu & Marcello Rambaldi & Jean-Franc{c}ois Muzy & Emmanuel Bacry, 2019. "Queue-reactive Hawkes models for the order flow," Papers 1901.08938, arXiv.org.
    4. Thomas Spooner & Rahul Savani, 2020. "Robust Market Making via Adversarial Reinforcement Learning," Papers 2003.01820, arXiv.org, revised Jul 2020.
    5. Junyi Li & Xitong Wang & Yaoyang Lin & Arunesh Sinha & Micheal P. Wellman, 2020. "Generating Realistic Stock Market Order Streams," Papers 2006.04212, arXiv.org.
    6. Charles-Albert Lehalle & Eyal Neuman, 2019. "Incorporating signals into optimal trading," Finance and Stochastics, Springer, vol. 23(2), pages 275-311, April.
    7. Michael Karpe & Jin Fang & Zhongyao Ma & Chen Wang, 2020. "Multi-Agent Reinforcement Learning in a Realistic Limit Order Book Market Simulation," Papers 2006.05574, arXiv.org, revised Sep 2020.
    8. Yufei Wu & Mahmoud Mahfouz & Daniele Magazzeni & Manuela Veloso, 2021. "How Robust are Limit Order Book Representations under Data Perturbation?," Papers 2110.04752, arXiv.org.
    9. Xiaofei Lu & Frédéric Abergel, 2017. "Limit order book modelling with high dimensional Hawkes processes," Working Papers hal-01512430, HAL.
    10. Ioane Muni Toke, 2017. "Stationary Distribution Of The Volume At The Best Quote In A Poisson Order Book Model," Post-Print hal-01705085, HAL.
    11. Federico Gonzalez & Mark Schervish, 2017. "Instantaneous order impact and high-frequency strategy optimization in limit order books," Papers 1707.01167, arXiv.org, revised Oct 2017.
    12. Emmanouil Sfendourakis & Ioane Muni Toke, 2021. "LOB modeling using Hawkes processes with a state-dependent factor," Papers 2107.12872, arXiv.org, revised Dec 2021.
    13. Peng Wu & Marcello Rambaldi & Jean-François Muzy & Emmanuel Bacry, 2021. "Queue-reactive Hawkes models for the order flow," Working Papers hal-02409073, HAL.
    14. Xiaofei Lu & Fr'ed'eric Abergel, 2018. "Order-book modelling and market making strategies," Papers 1806.05101, arXiv.org.
    15. Masatoshi Goda, 2021. "Hawkes process and Edgeworth expansion with application to maximum likelihood estimator," Statistical Inference for Stochastic Processes, Springer, vol. 24(2), pages 277-325, July.
    16. Tommaso Mariotti & Fabrizio Lillo & Giacomo Toscano, 2022. "From Zero-Intelligence to Queue-Reactive: Limit Order Book modeling for high-frequency volatility estimation and optimal execution," Papers 2202.12137, arXiv.org, revised Sep 2022.
    17. Restocchi, Valerio & McGroarty, Frank & Gerding, Enrico, 2019. "Statistical properties of volume and calendar effects in prediction markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 1150-1160.
    18. Ioane Muni Toke & Nakahiro Yoshida, 2016. "Modelling intensities of order flows in a limit order book," Papers 1602.03944, arXiv.org.
    19. Thomas Spooner & John Fearnley & Rahul Savani & Andreas Koukorinis, 2018. "Market Making via Reinforcement Learning," Papers 1804.04216, arXiv.org.
    20. Xiaofei Lu & Frédéric Abergel, 2018. "High dimensional Hawkes processes for limit order books Modelling, empirical analysis and numerical calibration," Post-Print hal-01686122, HAL.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2109.10429. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.