IDEAS home Printed from https://ideas.repec.org/a/spr/fininn/v7y2021i1d10.1186_s40854-021-00269-7.html
   My bibliography  Save this article

DAViS: a unified solution for data collection, analyzation, and visualization in real-time stock market prediction

Author

Listed:
  • Suppawong Tuarob

    (Mahidol University)

  • Poom Wettayakorn

    (Mahidol University)

  • Ponpat Phetchai

    (Mahidol University)

  • Siripong Traivijitkhun

    (Mahidol University)

  • Sunghoon Lim

    (Ulsan National Institute of Science and Technology
    Ulsan National Institute of Science and Technology)

  • Thanapon Noraset

    (Mahidol University)

  • Tipajin Thaipisutikul

    (Mahidol University)

Abstract

The explosion of online information with the recent advent of digital technology in information processing, information storing, information sharing, natural language processing, and text mining techniques has enabled stock investors to uncover market movement and volatility from heterogeneous content. For example, a typical stock market investor reads the news, explores market sentiment, and analyzes technical details in order to make a sound decision prior to purchasing or selling a particular company’s stock. However, capturing a dynamic stock market trend is challenging owing to high fluctuation and the non-stationary nature of the stock market. Although existing studies have attempted to enhance stock prediction, few have provided a complete decision-support system for investors to retrieve real-time data from multiple sources and extract insightful information for sound decision-making. To address the above challenge, we propose a unified solution for data collection, analysis, and visualization in real-time stock market prediction to retrieve and process relevant financial data from news articles, social media, and company technical information. We aim to provide not only useful information for stock investors but also meaningful visualization that enables investors to effectively interpret storyline events affecting stock prices. Specifically, we utilize an ensemble stacking of diversified machine-learning-based estimators and innovative contextual feature engineering to predict the next day’s stock prices. Experiment results show that our proposed stock forecasting method outperforms a traditional baseline with an average mean absolute percentage error of 0.93. Our findings confirm that leveraging an ensemble scheme of machine learning methods with contextual information improves stock prediction performance. Finally, our study could be further extended to a wide variety of innovative financial applications that seek to incorporate external insight from contextual information such as large-scale online news articles and social media data.

Suggested Citation

  • Suppawong Tuarob & Poom Wettayakorn & Ponpat Phetchai & Siripong Traivijitkhun & Sunghoon Lim & Thanapon Noraset & Tipajin Thaipisutikul, 2021. "DAViS: a unified solution for data collection, analyzation, and visualization in real-time stock market prediction," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-32, December.
  • Handle: RePEc:spr:fininn:v:7:y:2021:i:1:d:10.1186_s40854-021-00269-7
    DOI: 10.1186/s40854-021-00269-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1186/s40854-021-00269-7
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1186/s40854-021-00269-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Huina Mao & Scott Counts & Johan Bollen, 2011. "Predicting Financial Markets: Comparing Survey, News, Twitter and Search Engine Data," Papers 1112.1051, arXiv.org.
    2. Dharmaraja Selvamuthu & Vineet Kumar & Abhishek Mishra, 2019. "Indian stock market prediction using artificial neural networks on tick data," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 5(1), pages 1-12, December.
    3. R. Gopinathan & S. Raja Sethu Durai, 2019. "Stock market and macroeconomic variables: new evidence from India," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 5(1), pages 1-17, December.
    4. Daning Hu & Gerhard Schwabe & Xiao Li, 2015. "Systemic risk management and investment analysis with financial network analytics: research opportunities and challenges," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 1(1), pages 1-9, December.
    5. Rajagopal, 2015. "Market Trend Analysis," Palgrave Macmillan Books, in: The Butterfly Effect in Competitive Markets, chapter 4, pages 95-118, Palgrave Macmillan.
    6. Wenbo Wu & Jiaqi Chen & Liang Xu & Qingyun He & Michael L. Tindall, 2019. "A statistical learning approach for stock selection in the Chinese stock market," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 5(1), pages 1-18, December.
    7. Catalin Stoean & Wiesław Paja & Ruxandra Stoean & Adrian Sandita, 2019. "Deep architectures for long-term stock price prediction with a heuristic-based strategy for trading simulations," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-19, October.
    8. Wen, Fenghua & Xu, Longhao & Ouyang, Guangda & Kou, Gang, 2019. "Retail investor attention and stock price crash risk: Evidence from China," International Review of Financial Analysis, Elsevier, vol. 65(C).
    9. Gang Kou & Özlem Olgu Akdeniz & Hasan Dinçer & Serhat Yüksel, 2021. "Fintech investments in European banks: a hybrid IT2 fuzzy multidimensional decision-making approach," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-28, December.
    10. Bomfim, Antulio N., 2003. "Pre-announcement effects, news effects, and volatility: Monetary policy and the stock market," Journal of Banking & Finance, Elsevier, vol. 27(1), pages 133-151, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Suppawong Tuarob & Thanapon Noraset & Tanisa Tawichsri, 2022. "Using Large-Scale Social Media Data for Population-Level Mental Health Monitoring and Public Sentiment Assessment: A Case Study of Thailand," PIER Discussion Papers 169, Puey Ungphakorn Institute for Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. François-Éric Racicot & Raymond Théoret, 2022. "Tracking market and non-traditional sources of risks in procyclical and countercyclical hedge fund strategies under extreme scenarios: a nonlinear VAR approach," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-56, December.
    2. Narasingha Das & Partha Gangopadhyay, 2023. "Did weekly economic index and volatility index impact US food sales during the first year of the pandemic?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-23, December.
    3. Xie, Wen-Jie & Li, Mu-Yao & Zhou, Wei-Xing, 2021. "Learning representation of stock traders and immediate price impacts," Emerging Markets Review, Elsevier, vol. 48(C).
    4. Deniz Can Yıldırım & Ismail Hakkı Toroslu & Ugo Fiore, 2021. "Forecasting directional movement of Forex data using LSTM with technical and macroeconomic indicators," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-36, December.
    5. Dawood Ashraf & Mohsin Khawaja & M. Ishaq Bhatti, 2022. "Raising capital amid economic policy uncertainty: an empirical investigation," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-32, December.
    6. Emre Cevik & Buket Kirci Altinkeski & Emrah Ismail Cevik & Sel Dibooglu, 2022. "Investor sentiments and stock markets during the COVID-19 pandemic," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-34, December.
    7. Seema Wati Narayan & Mobeen Ur Rehman & Yi-Shuai Ren & Chaoqun Ma, 2023. "Is a correlation-based investment strategy beneficial for long-term international portfolio investors?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-26, December.
    8. Geng, Yuedan & Ye, Qiang & Jin, Yu & Shi, Wen, 2022. "Crowd wisdom and internet searches: What happens when investors search for stocks?," International Review of Financial Analysis, Elsevier, vol. 82(C).
    9. Ladislav Kristoufek, 2022. "On the role of stablecoins in cryptoasset pricing dynamics," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-26, December.
    10. Jyh-Bang Jou & Charlene Tan Lee, 2023. "Design of the contingent royalty rate as related to the type of investment," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-25, December.
    11. Walid Mensi & Debasish Maitra & Refk Selmi & Xuan Vinh Vo, 2023. "Extreme dependencies and spillovers between gold and stock markets: evidence from MENA countries," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-27, December.
    12. Rangan Gupta & Christian Pierdzioch, 2023. "Do U.S. economic conditions at the state level predict the realized volatility of oil-price returns? A quantile machine-learning approach," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-22, December.
    13. Tai-Liang Chen & Ching-Hsue Cheng & Jing-Wei Liu, 2019. "A Causal Time-Series Model Based on Multilayer Perceptron Regression for Forecasting Taiwan Stock Index," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(06), pages 1967-1987, November.
    14. Alessio Brini & Jimmie Lenz, 2024. "A Comparison of Cryptocurrency Volatility-benchmarking New and Mature Asset Classes," Papers 2404.04962, arXiv.org.
    15. Aaryan Gupta & Vinya Dengre & Hamza Abubakar Kheruwala & Manan Shah, 2020. "Comprehensive review of text-mining applications in finance," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 6(1), pages 1-25, December.
    16. Roman Mestre, 2021. "A wavelet approach of investing behaviors and their effects on risk exposures," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-37, December.
    17. Keming Li, 2021. "The effect of option trading," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-32, December.
    18. Shankhajyoti De & Arabin Kumar Dey & Deepak Kumar Gouda, 2022. "Construction of Confidence Interval for a Univariate Stock Price Signal Predicted Through Long Short Term Memory Network," Annals of Data Science, Springer, vol. 9(2), pages 271-284, April.
    19. Maryam Abid & Danish Ahmed Siddique, 2020. "Impact of Financial Market Uncertainty on Market Returns: A Global Analysis," Business and Economic Research, Macrothink Institute, vol. 10(3), pages 216-244, September.
    20. Jubinski, Daniel & Tomljanovich, Marc, 2013. "Do FOMC minutes matter to markets? An intraday analysis of FOMC minutes releases on individual equity volatility and returns," Review of Financial Economics, Elsevier, vol. 22(3), pages 86-97.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:fininn:v:7:y:2021:i:1:d:10.1186_s40854-021-00269-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.