IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2111.15354.html
   My bibliography  Save this paper

An Improved Reinforcement Learning Model Based on Sentiment Analysis

Author

Listed:
  • Yizhuo Li
  • Peng Zhou
  • Fangyi Li
  • Xiao Yang

Abstract

With the development of artificial intelligence technology, quantitative trading systems represented by reinforcement learning have emerged in the stock trading market. The authors combined the deep Q network in reinforcement learning with the sentiment quantitative indicator ARBR to build a high-frequency stock trading model for the share market. To improve the performance of the model, the PCA algorithm is used to reduce the dimensionality feature vector while incorporating the influence of market sentiment on the long-short power into the spatial state of the trading model and uses the LSTM layer to replace the fully connected layer to solve the traditional DQN model due to limited empirical data storage. Through the use of cumulative income, Sharpe ratio to evaluate the performance of the model and the use of double moving averages and other strategies for comparison. The results show that the improved model proposed by authors is far superior to the comparison model in terms of income, achieving a maximum annualized rate of return of 54.5%, which is proven to be able to increase reinforcement learning performance significantly in stock trading.

Suggested Citation

  • Yizhuo Li & Peng Zhou & Fangyi Li & Xiao Yang, 2021. "An Improved Reinforcement Learning Model Based on Sentiment Analysis," Papers 2111.15354, arXiv.org.
    • Handle: RePEc:arx:papers:2111.15354
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2111.15354
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    2. Xiao-Yang Liu & Zhuoran Xiong & Shan Zhong & Hongyang Yang & Anwar Walid, 2018. "Practical Deep Reinforcement Learning Approach for Stock Trading," Papers 1811.07522, arXiv.org, revised Jul 2022.
    3. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Karol Chojnacki & Robert Ślepaczuk, 2023. "This study compares well-known tools of technical analysis (Moving Average Crossover MAC) with Machine Learning based strategies (LSTM and XGBoost) and Ensembled Machine Learning Strategies (LSTM ense," Working Papers 2023-15, Faculty of Economic Sciences, University of Warsaw.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gianna Figà-Talamanca & Marco Patacca, 2024. "An explorative analysis of sentiment impact on S&P 500 components returns, volatility and downside risk," Annals of Operations Research, Springer, vol. 342(3), pages 2095-2117, November.
    2. Yong Ma & Lu Yan & Dongtao Pan, 2024. "The power of news data in forecasting tail risk: evidence from China," Empirical Economics, Springer, vol. 67(6), pages 2607-2642, December.
    3. Demiralay, Sercan & Ulusoy, Veysel, 2014. "Value-at-risk Predictions of Precious Metals with Long Memory Volatility Models," MPRA Paper 53229, University Library of Munich, Germany.
    4. Müller, Karsten, 2020. "German forecasters' narratives: How informative are German business cycle forecast reports?," Working Papers 23, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    5. Goedde-Menke, Michael & Langer, Thomas & Pfingsten, Andreas, 2014. "Impact of the financial crisis on bank run risk – Danger of the days after," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 522-533.
    6. David E. Allen & Michael McAleer & Abhay K. Singh, 2019. "Daily market news sentiment and stock prices," Applied Economics, Taylor & Francis Journals, vol. 51(30), pages 3212-3235, June.
    7. Takahashi, Makoto & Watanabe, Toshiaki & Omori, Yasuhiro, 2016. "Volatility and quantile forecasts by realized stochastic volatility models with generalized hyperbolic distribution," International Journal of Forecasting, Elsevier, vol. 32(2), pages 437-457.
    8. Yan Luo & Linying Zhou, 2020. "Textual tone in corporate financial disclosures: a survey of the literature," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 17(2), pages 101-110, September.
    9. Juan Carlos Escanciano & Zaichao Du, 2015. "Backtesting Expected Shortfall: Accounting for Tail Risk," CAEPR Working Papers 2015-001, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    10. Berens, Tobias & Weiß, Gregor N.F. & Wied, Dominik, 2015. "Testing for structural breaks in correlations: Does it improve Value-at-Risk forecasting?," Journal of Empirical Finance, Elsevier, vol. 32(C), pages 135-152.
    11. Chen, Cathy W.S. & Gerlach, Richard & Hwang, Bruce B.K. & McAleer, Michael, 2012. "Forecasting Value-at-Risk using nonlinear regression quantiles and the intra-day range," International Journal of Forecasting, Elsevier, vol. 28(3), pages 557-574.
    12. Jiao Ji & Oleksandr Talavera & Shuxing Yin, 2018. "The Hidden Information Content: Evidence from the Tone of Independent Director Reports," Working Papers 2018-28, Swansea University, School of Management.
    13. Jorge E. Galán & María Rodríguez Moreno, 2020. "At-risk measures and financial stability," Financial Stability Review, Banco de España, issue Autumn.
    14. Rostagno, Luciano Martin, 2005. "Empirical tests of parametric and non-parametric Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) measures for the Brazilian stock market index," ISU General Staff Papers 2005010108000021878, Iowa State University, Department of Economics.
    15. Saswat Patra & Malay Bhattacharyya, 2020. "How Risky Are the Options? A Comparison with the Underlying Stock Using MaxVaR as a Risk Measure," Risks, MDPI, vol. 8(3), pages 1-17, July.
    16. M. Hashem Pesaran & Paolo Zaffaroni, 2004. "Model Averaging and Value-at-Risk Based Evaluation of Large Multi Asset Volatility Models for Risk Management," CESifo Working Paper Series 1358, CESifo.
    17. Lixiang Wang & Wendi Hou & Yupei Liu, 2023. "How do co‐shareholding networks affect negative media coverage? Evidence from China," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 4221-4249, December.
    18. Kamaladdin Fataliyev & Aneesh Chivukula & Mukesh Prasad & Wei Liu, 2021. "Stock Market Analysis with Text Data: A Review," Papers 2106.12985, arXiv.org, revised Jul 2021.
    19. Bennani, Hamza, 2018. "Media coverage and ECB policy-making: Evidence from an augmented Taylor rule," Journal of Macroeconomics, Elsevier, vol. 57(C), pages 26-38.
    20. Christopher N. Avery & Judith A. Chevalier & Richard J. Zeckhauser, 2016. "The "CAPS" Prediction System and Stock Market Returns," Review of Finance, European Finance Association, vol. 20(4), pages 1363-1381.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2111.15354. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.