IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v38y2022i2p648-661.html
   My bibliography  Save this article

Dynamic logistic regression and variable selection: Forecasting and contextualizing civil unrest

Author

Listed:
  • Bakerman, Jordan
  • Pazdernik, Karl
  • Korkmaz, Gizem
  • Wilson, Alyson G.

Abstract

Civil unrest can range from peaceful protest to violent furor, and researchers are working to monitor, forecast, and assess such events to allocate resources better. Twitter has become a real-time data source for forecasting civil unrest because millions of people use the platform as a social outlet. Daily word counts are used as model features, and predictive terms contextualize the reasons for the protest. To forecast civil unrest and infer the reasons for the protest, we consider the problem of Bayesian variable selection for the dynamic logistic regression model and propose using penalized credible regions to select parameters of the updated state vector. This method avoids the need for shrinkage priors, is scalable to high-dimensional dynamic data, and allows the importance of variables to vary in time as new information becomes available. A substantial improvement in both precision and F1-score using this approach is demonstrated through simulation. Finally, we apply the proposed model fitting and variable selection methodology to the problem of forecasting civil unrest in Latin America. Our dynamic logistic regression approach shows improved accuracy compared to the static approach currently used in event prediction and feature selection.

Suggested Citation

  • Bakerman, Jordan & Pazdernik, Karl & Korkmaz, Gizem & Wilson, Alyson G., 2022. "Dynamic logistic regression and variable selection: Forecasting and contextualizing civil unrest," International Journal of Forecasting, Elsevier, vol. 38(2), pages 648-661.
  • Handle: RePEc:eee:intfor:v:38:y:2022:i:2:p:648-661
    DOI: 10.1016/j.ijforecast.2021.07.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016920702100114X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2021.07.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, August.
    2. Nima Nonejad, 2021. "An Overview Of Dynamic Model Averaging Techniques In Time‐Series Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 566-614, April.
    3. Risse, Marian & Ohl, Ludwig, 2017. "Using dynamic model averaging in state space representation with dynamic Occam’s window and applications to the stock and gold market," Journal of Empirical Finance, Elsevier, vol. 44(C), pages 158-176.
    4. Onorante, Luca & Raftery, Adrian E., 2016. "Dynamic model averaging in large model spaces using dynamic Occam׳s window," European Economic Review, Elsevier, vol. 81(C), pages 2-14.
    5. Nicholas G. Polson & James G. Scott & Jesse Windle, 2013. "Bayesian Inference for Logistic Models Using Pólya--Gamma Latent Variables," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1339-1349, December.
    6. Jouchi Nakajima & Mike West, 2013. "Bayesian Analysis of Latent Threshold Dynamic Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 151-164, April.
    7. Singh, Akshit & Shukla, Nagesh & Mishra, Nishikant, 2018. "Social media data analytics to improve supply chain management in food industries," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 114(C), pages 398-415.
    8. Howard D. Bondell & Brian J. Reich, 2012. "Consistent High-Dimensional Bayesian Variable Selection via Penalized Credible Regions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(500), pages 1610-1624, December.
    9. Kalli, Maria & Griffin, Jim E., 2014. "Time-varying sparsity in dynamic regression models," Journal of Econometrics, Elsevier, vol. 178(2), pages 779-793.
    10. Park, Trevor & Casella, George, 2008. "The Bayesian Lasso," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 681-686, June.
    11. Tyler H. McCormick & Adrian E. Raftery & David Madigan & Randall S. Burd, 2012. "Dynamic Logistic Regression and Dynamic Model Averaging for Binary Classification," Biometrics, The International Biometric Society, vol. 68(1), pages 23-30, March.
    12. Ole E. Barndorff‐Nielsen & Neil Shephard, 2001. "Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 167-241.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Short, Martin B. & Mohler, George O., 2023. "A fully Bayesian tracking algorithm for mitigating disparate prediction misclassification," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1238-1252.
    2. Liu, Ling & Wang, Jujie & Li, Jianping & Wei, Lu, 2023. "An online transfer learning model for wind turbine power prediction based on spatial feature construction and system-wide update," Applied Energy, Elsevier, vol. 340(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    2. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    3. Niko Hauzenberger, 2020. "Flexible Mixture Priors for Large Time-varying Parameter Models," Papers 2006.10088, arXiv.org, revised Nov 2020.
    4. Joshua C. C. Chan, 2018. "Specification tests for time-varying parameter models with stochastic volatility," Econometric Reviews, Taylor & Francis Journals, vol. 37(8), pages 807-823, September.
    5. Gary Koop & Dimitris Korobilis, 2023. "Bayesian Dynamic Variable Selection In High Dimensions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 1047-1074, August.
    6. Eraslan, Sercan & Schröder, Maximilian, 2019. "Nowcasting GDP with a large factor model space," Discussion Papers 41/2019, Deutsche Bundesbank.
    7. Korobilis, Dimitris & Koop, Gary, 2018. "Variational Bayes inference in high-dimensional time-varying parameter models," Essex Finance Centre Working Papers 22665, University of Essex, Essex Business School.
    8. Dufays, Arnaud & Rombouts, Jeroen V.K., 2020. "Relevant parameter changes in structural break models," Journal of Econometrics, Elsevier, vol. 217(1), pages 46-78.
    9. Felix Abramovich & Vadim Grinshtein, 2013. "Estimation of a sparse group of sparse vectors," Biometrika, Biometrika Trust, vol. 100(2), pages 355-370.
    10. Risse, Marian, 2019. "Combining wavelet decomposition with machine learning to forecast gold returns," International Journal of Forecasting, Elsevier, vol. 35(2), pages 601-615.
    11. Nima Nonejad, 2021. "An Overview Of Dynamic Model Averaging Techniques In Time‐Series Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 566-614, April.
    12. Bitto, Angela & Frühwirth-Schnatter, Sylvia, 2019. "Achieving shrinkage in a time-varying parameter model framework," Journal of Econometrics, Elsevier, vol. 210(1), pages 75-97.
    13. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.
    14. Florian Huber & Gary Koop & Michael Pfarrhofer, 2020. "Bayesian Inference in High-Dimensional Time-varying Parameter Models using Integrated Rotated Gaussian Approximations," Papers 2002.10274, arXiv.org.
    15. Nonejad, Nima, 2021. "Predicting the return on the spot price of crude oil out-of-sample by conditioning on news-based uncertainty measures: Some new empirical results," Energy Economics, Elsevier, vol. 104(C).
    16. Krzysztof Drachal, 2018. "Some Novel Bayesian Model Combination Schemes: An Application to Commodities Prices," Sustainability, MDPI, vol. 10(8), pages 1-27, August.
    17. Prüser, Jan, 2017. "Forecasting US inflation using Markov dimension switching," Ruhr Economic Papers 710, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    18. Catania, Leopoldo & Grassi, Stefano & Ravazzolo, Francesco, 2019. "Forecasting cryptocurrencies under model and parameter instability," International Journal of Forecasting, Elsevier, vol. 35(2), pages 485-501.
    19. Dimitris Korobilis, 2021. "High-Dimensional Macroeconomic Forecasting Using Message Passing Algorithms," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 493-504, March.
    20. Korobilis, Dimitris, 2015. "Quantile forecasts of inflation under model uncertainty," MPRA Paper 64341, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:38:y:2022:i:2:p:648-661. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.