IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2309.00136.html
   My bibliography  Save this paper

Predicting Financial Market Trends using Time Series Analysis and Natural Language Processing

Author

Listed:
  • Ali Asgarov

Abstract

Forecasting financial market trends through time series analysis and natural language processing poses a complex and demanding undertaking, owing to the numerous variables that can influence stock prices. These variables encompass a spectrum of economic and political occurrences, as well as prevailing public attitudes. Recent research has indicated that the expression of public sentiments on social media platforms such as Twitter may have a noteworthy impact on the determination of stock prices. The objective of this study was to assess the viability of Twitter sentiments as a tool for predicting stock prices of major corporations such as Tesla, Apple. Our study has revealed a robust association between the emotions conveyed in tweets and fluctuations in stock prices. Our findings indicate that positivity, negativity, and subjectivity are the primary determinants of fluctuations in stock prices. The data was analyzed utilizing the Long-Short Term Memory neural network (LSTM) model, which is currently recognized as the leading methodology for predicting stock prices by incorporating Twitter sentiments and historical stock prices data. The models utilized in our study demonstrated a high degree of reliability and yielded precise outcomes for the designated corporations. In summary, this research emphasizes the significance of incorporating public opinions into the prediction of stock prices. The application of Time Series Analysis and Natural Language Processing methodologies can yield significant scientific findings regarding financial market patterns, thereby facilitating informed decision-making among investors. The results of our study indicate that the utilization of Twitter sentiments can serve as a potent instrument for forecasting stock prices, and ought to be factored in when formulating investment strategies.

Suggested Citation

  • Ali Asgarov, 2023. "Predicting Financial Market Trends using Time Series Analysis and Natural Language Processing," Papers 2309.00136, arXiv.org.
    • Handle: RePEc:arx:papers:2309.00136
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2309.00136
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Huina Mao & Scott Counts & Johan Bollen, 2011. "Predicting Financial Markets: Comparing Survey, News, Twitter and Search Engine Data," Papers 1112.1051, arXiv.org.
    2. Costola, Michele & Hinz, Oliver & Nofer, Michael & Pelizzon, Loriana, 2023. "Machine learning sentiment analysis, COVID-19 news and stock market reactions," Research in International Business and Finance, Elsevier, vol. 64(C).
    3. Xingyu Zhou & Zhisong Pan & Guyu Hu & Siqi Tang & Cheng Zhao, 2018. "Stock Market Prediction on High-Frequency Data Using Generative Adversarial Nets," Mathematical Problems in Engineering, Hindawi, vol. 2018, pages 1-11, April.
    4. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bianconi, Marcelo & Hua, Xiaxin & Tan, Chih Ming, 2015. "Determinants of systemic risk and information dissemination," International Review of Economics & Finance, Elsevier, vol. 38(C), pages 352-368.
    2. Gabriele Ranco & Darko Aleksovski & Guido Caldarelli & Miha Grčar & Igor Mozetič, 2015. "The Effects of Twitter Sentiment on Stock Price Returns," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-21, September.
    3. Ahelegbey, Daniel Felix & Cerchiello, Paola & Scaramozzino, Roberta, 2022. "Network based evidence of the financial impact of Covid-19 pandemic," International Review of Financial Analysis, Elsevier, vol. 81(C).
    4. Eric. W. K. See-To & Yang Yang, 2017. "Market sentiment dispersion and its effects on stock return and volatility," Electronic Markets, Springer;IIM University of St. Gallen, vol. 27(3), pages 283-296, August.
    5. Sushant Chari & Purva Hegde Desai & Nilesh Borde & Babu George, 2023. "Aggregate News Sentiment and Stock Market Returns in India," JRFM, MDPI, vol. 16(8), pages 1-18, August.
    6. Gabriele Ranco & Ilaria Bordino & Giacomo Bormetti & Guido Caldarelli & Fabrizio Lillo & Michele Treccani, 2014. "Coupling news sentiment with web browsing data improves prediction of intra-day price dynamics," Papers 1412.3948, arXiv.org, revised Dec 2015.
    7. Al-Nasseri, Alya & Menla Ali, Faek, 2018. "What does investors' online divergence of opinion tell us about stock returns and trading volume?," Journal of Business Research, Elsevier, vol. 86(C), pages 166-178.
    8. Jaroslav Bukovina, 2015. "Sentiment of a society and large-cap stock liquidity," MENDELU Working Papers in Business and Economics 2015-56, Mendel University in Brno, Faculty of Business and Economics.
    9. Felix Ming Fai Wong & Zhenming Liu & Mung Chiang, 2014. "Stock Market Prediction from WSJ: Text Mining via Sparse Matrix Factorization," Papers 1406.7330, arXiv.org.
    10. Zhang, Xiaotao & Li, Guoran & Li, Yishuo & Zou, Gaofeng & Wu, Ji George, 2023. "Which is more important in stock market forecasting: Attention or sentiment?," International Review of Financial Analysis, Elsevier, vol. 89(C).
    11. Abdollahi, Hooman & Fjesme, Sturla L. & Sirnes, Espen, 2024. "Measuring market volatility connectedness to media sentiment," The North American Journal of Economics and Finance, Elsevier, vol. 71(C).
    12. Yousra Trichilli & Mouna Abdelhédi & Mouna Boujelbène Abbes, 2020. "The thermal optimal path model: Does Google search queries help to predict dynamic relationship between investor’s sentiment and indexes returns?," Journal of Asset Management, Palgrave Macmillan, vol. 21(3), pages 261-279, May.
    13. Lyócsa, Štefan & Halousková, Martina & Haugom, Erik, 2023. "The US banking crisis in 2023: Intraday attention and price variation of banks at risk," Finance Research Letters, Elsevier, vol. 57(C).
    14. Tushar Rao & Saket Srivastava, 2012. "Modeling Movements in Oil, Gold, Forex and Market Indices using Search Volume Index and Twitter Sentiments," Papers 1212.1037, arXiv.org.
    15. Wasim ul Rehman & Omur Saltik & Faryal Jalil & Suleyman Degirmen, 2024. "Viral decisions: unmasking the impact of COVID-19 info and behavioral quirks on investment choices," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-20, December.
    16. Justina Deveikyte & Helyette Geman & Carlo Piccari & Alessandro Provetti, 2020. "A Sentiment Analysis Approach to the Prediction of Market Volatility," Papers 2012.05906, arXiv.org.
    17. Arezoo Hatefi Ghahfarrokhi & Mehrnoush Shamsfard, 2019. "Tehran Stock Exchange Prediction Using Sentiment Analysis of Online Textual Opinions," Papers 1909.03792, arXiv.org, revised Sep 2019.
    18. Shen, Shulin & Xia, Le & Shuai, Yulin & Gao, Da, 2022. "Measuring news media sentiment using big data for Chinese stock markets," Pacific-Basin Finance Journal, Elsevier, vol. 74(C).
    19. Andrew Todd & James Bowden & Yashar Moshfeghi, 2024. "Text‐based sentiment analysis in finance: Synthesising the existing literature and exploring future directions," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 31(1), March.
    20. Jung, Sang Hoon & Jeong, Yong Jin, 2021. "Examining stock markets and societal mood using Internet memes," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2309.00136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.