IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2311.05743.html
   My bibliography  Save this paper

Advancing Algorithmic Trading: A Multi-Technique Enhancement of Deep Q-Network Models

Author

Listed:
  • Gang Hu

Abstract

This study enhances a Deep Q-Network (DQN) trading model by incorporating advanced techniques like Prioritized Experience Replay, Regularized Q-Learning, Noisy Networks, Dueling, and Double DQN. Extensive tests on assets like BTC/USD and AAPL demonstrate superior performance compared to the original model, with marked increases in returns and Sharpe Ratio, indicating improved risk-adjusted rewards. Notably, convolutional neural network (CNN) architectures, both 1D and 2D, significantly boost returns, suggesting their effectiveness in market trend analysis. Across instruments, these enhancements have yielded stable and high gains, eclipsing the baseline and highlighting the potential of CNNs in trading systems. The study suggests that applying sophisticated deep learning within reinforcement learning can greatly enhance automated trading, urging further exploration into advanced methods for broader financial applicability. The findings advocate for the continued evolution of AI in finance.

Suggested Citation

  • Gang Hu, 2023. "Advancing Algorithmic Trading: A Multi-Technique Enhancement of Deep Q-Network Models," Papers 2311.05743, arXiv.org.
    • Handle: RePEc:arx:papers:2311.05743
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2311.05743
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mehran Taghian & Ahmad Asadi & Reza Safabakhsh, 2021. "A Reinforcement Learning Based Encoder-Decoder Framework for Learning Stock Trading Rules," Papers 2101.03867, arXiv.org.
    2. Allen, Franklin & Karjalainen, Risto, 1999. "Using genetic algorithms to find technical trading rules," Journal of Financial Economics, Elsevier, vol. 51(2), pages 245-271, February.
    3. Chien Yi Huang, 2018. "Financial Trading as a Game: A Deep Reinforcement Learning Approach," Papers 1807.02787, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andriosopoulos, Kostas & Nomikos, Nikos, 2014. "Performance replication of the Spot Energy Index with optimal equity portfolio selection: Evidence from the UK, US and Brazilian markets," European Journal of Operational Research, Elsevier, vol. 234(2), pages 571-582.
    2. Chia-Lin Chang & Jukka Ilomäki & Hannu Laurila & Michael McAleer, 2018. "Long Run Returns Predictability and Volatility with Moving Averages," Risks, MDPI, vol. 6(4), pages 1-18, September.
    3. Pereira, Robert, 1999. "Forecasting Ability But No Profitability: An Empirical Evaluation of Genetic Algorithm-optimised Technical Trading Rules," MPRA Paper 9055, University Library of Munich, Germany.
    4. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    5. Trifan, Emanuela, 2004. "Entscheidungsregeln und ihr Einfluss auf den Aktienkurs," Darmstadt Discussion Papers in Economics 131, Darmstadt University of Technology, Department of Law and Economics.
    6. Frensi Zejnullahu & Maurice Moser & Joerg Osterrieder, 2022. "Applications of Reinforcement Learning in Finance -- Trading with a Double Deep Q-Network," Papers 2206.14267, arXiv.org.
    7. Meredith Beechey & David Gruen & James Vickery, 2000. "The Efficient Market Hypothesis: A Survey," RBA Research Discussion Papers rdp2000-01, Reserve Bank of Australia.
    8. Chiarella, Carl & Ladley, Daniel, 2016. "Chasing trends at the micro-level: The effect of technical trading on order book dynamics," Journal of Banking & Finance, Elsevier, vol. 72(S), pages 119-131.
    9. Sid Ghoshal & Stephen J. Roberts, 2018. "Thresholded ConvNet Ensembles: Neural Networks for Technical Forecasting," Papers 1807.03192, arXiv.org, revised Jul 2018.
    10. Jie Fang & Jianwu Lin & Shutao Xia & Yong Jiang & Zhikang Xia & Xiang Liu, 2020. "Neural Network-based Automatic Factor Construction," Papers 2008.06225, arXiv.org, revised Oct 2020.
    11. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    12. Ioana-Andreea Boboc & Mihai-Cristian Dinică, 2013. "An Algorithm for Testing the Efficient Market Hypothesis," PLOS ONE, Public Library of Science, vol. 8(10), pages 1-11, October.
    13. Adam Karp & Gary Van Vuuren, 2019. "Investment Implications Of The Fractal Market Hypothesis," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 14(01), pages 1-27, March.
    14. Maxime Charlebois & Stephen Sapp, 2007. "Temporal Patterns in Foreign Exchange Returns and Options," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(2-3), pages 443-470, March.
    15. Psaradellis, Ioannis & Laws, Jason & Pantelous, Athanasios A. & Sermpinis, Georgios, 2023. "Technical analysis, spread trading, and data snooping control," International Journal of Forecasting, Elsevier, vol. 39(1), pages 178-191.
    16. Andrew W. Lo & Harry Mamaysky & Jiang Wang, 2000. "Foundations of Technical Analysis: Computational Algorithms, Statistical Inference, and Empirical Implementation," Journal of Finance, American Finance Association, vol. 55(4), pages 1705-1765, August.
    17. Lijun Wang & Haizhong An & Xiaohua Xia & Xiaojia Liu & Xiaoqi Sun & Xuan Huang, 2014. "Generating Moving Average Trading Rules on the Oil Futures Market with Genetic Algorithms," Mathematical Problems in Engineering, Hindawi, vol. 2014, pages 1-10, May.
    18. Auer, Benjamin R., 2016. "On the performance of simple trading rules derived from the fractal dynamics of gold and silver price fluctuations," Finance Research Letters, Elsevier, vol. 16(C), pages 255-267.
    19. Pernagallo, Giuseppe & Torrisi, Benedetto, 2020. "Blindfolded monkeys or financial analysts: Who is worth your money? New evidence on informational inefficiencies in the U.S. stock market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 539(C).
    20. Dan Anghel, 2013. "How Reliable is the Moving Average Crossover Rule for an Investor on the Romanian Stock Market?," The Review of Finance and Banking, Academia de Studii Economice din Bucuresti, Romania / Facultatea de Finante, Asigurari, Banci si Burse de Valori / Catedra de Finante, vol. 5(2), pages 089-115, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2311.05743. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.