IDEAS home Printed from https://ideas.repec.org/a/tpr/restat/v99y2017i5p749-755.html
   My bibliography  Save this article

Box Office Buzz: Does Social Media Data Steal the Show from Model Uncertainty When Forecasting for Hollywood?

Author

Listed:
  • Steven Lehrer

    (Queen’s University, NYU Shanghai, and NBER)

  • Tian Xie

    (Wang Yanan Institute for Studies in Economics, Department of Finance, MOE Key Lab of Econometrics, and Fujian Key Lab of Statistical Sciences, Xiamen University)

Abstract

Business decision makers are increasingly using predictive social media analytic tools in forecasting exercises but ignoring potential model uncertainty. Using data on the universe of Twitter messages, we calculate the sentiment regarding each film to understand whether these opinions affect box office opening and DVD retail sales. Our results contrasting eleven different econometric strategies including penalization methods indicate that accounting for model uncertainty can lead to large gains in forecast accuracy. While penalization methods do not outperform model averaging on forecast accuracy, evidence indicates they perform equivalently at the variable selection stage. Finally, incorporating social media data greatly improves forecast accuracy.

Suggested Citation

  • Steven Lehrer & Tian Xie, 2017. "Box Office Buzz: Does Social Media Data Steal the Show from Model Uncertainty When Forecasting for Hollywood?," The Review of Economics and Statistics, MIT Press, vol. 99(5), pages 749-755, December.
    • Handle: RePEc:tpr:restat:v:99:y:2017:i:5:p:749-755
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/REST_a_00671
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Xie, Tian, 2015. "Prediction model averaging estimator," Economics Letters, Elsevier, vol. 131(C), pages 5-8.
    2. David F. Hendry & Bent Nielsen, 2007. "Preface to Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    3. Enrico Moretti, 2011. "Social Learning and Peer Effects in Consumption: Evidence from Movie Sales," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(1), pages 356-393.
    4. David F. Hendry & Bent Nielsen, 2007. "The Bernoulli model, from Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    5. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    6. Wan, Alan T.K. & Zhang, Xinyu & Zou, Guohua, 2010. "Least squares model averaging by Mallows criterion," Journal of Econometrics, Elsevier, vol. 156(2), pages 277-283, June.
    7. Julia Campos & David F. Hendry & Hans‐Martin Krolzig, 2003. "Consistent Model Selection by an Automatic Gets Approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 803-819, December.
    8. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    9. Amemiya, Takeshi, 1980. "Selection of Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 21(2), pages 331-354, June.
    10. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    11. Pradeep K. Chintagunta & Shyam Gopinath & Sriram Venkataraman, 2010. "The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets," Marketing Science, INFORMS, vol. 29(5), pages 944-957, 09-10.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carstensen, Kai & Bachmann, Rüdiger & Schneider, Martin & Lautenbacher, Stefan, 2018. "Uncertainty is Change," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181572, Verein für Socialpolitik / German Economic Association.
    2. Steven F. Lehrer & Tian Xie, 2022. "The Bigger Picture: Combining Econometrics with Analytics Improves Forecasts of Movie Success," Management Science, INFORMS, vol. 68(1), pages 189-210, January.
    3. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    4. Steven Lehrer & Tian Xie & Tao Zeng, 2021. "Does High-Frequency Social Media Data Improve Forecasts of Low-Frequency Consumer Confidence Measures? [Regression Models with Mixed Sampling Frequencies]," Journal of Financial Econometrics, Oxford University Press, vol. 19(5), pages 910-933.
    5. Hui Xiao & Yiguo Sun, 2019. "On Tuning Parameter Selection in Model Selection and Model Averaging: A Monte Carlo Study," JRFM, MDPI, vol. 12(3), pages 1-16, June.
    6. Zhao, Shangwei & Xie, Tian & Ai, Xin & Yang, Guangren & Zhang, Xinyu, 2023. "Correcting sample selection bias with model averaging for consumer demand forecasting," Economic Modelling, Elsevier, vol. 123(C).
    7. Jordi McKenzie, 2023. "The economics of movies (revisited): A survey of recent literature," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 480-525, April.
    8. Qiu, Yue & Wang, Zongrun & Xie, Tian & Zhang, Xinyu, 2021. "Forecasting Bitcoin realized volatility by exploiting measurement error under model uncertainty," Journal of Empirical Finance, Elsevier, vol. 62(C), pages 179-201.
    9. Qiu, Yue & Zheng, Yuchen, 2023. "Improving box office projections through sentiment analysis: Insights from regularization-based forecast combinations," Economic Modelling, Elsevier, vol. 125(C).
    10. Jianchun Fang & Wanshan Wu & Zhou Lu & Eunho Cho, 2019. "Using Baidu Index To Nowcast Mobile Phone Sales In China," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 64(01), pages 83-96, March.
    11. Gabriel Okasa & Kenneth A. Younge, 2022. "Sample Fit Reliability," Papers 2209.06631, arXiv.org.
    12. Lehrer, Steven & Xie, Tian & Zhang, Xinyu, 2021. "Social media sentiment, model uncertainty, and volatility forecasting," Economic Modelling, Elsevier, vol. 102(C).
    13. Zhentao Shi & Liangjun Su & Tian Xie, 2020. "L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis," Papers 2010.09477, arXiv.org, revised Aug 2022.
    14. Xie, Tian, 2017. "Heteroscedasticity-robust model screening: A useful toolkit for model averaging in big data analytics," Economics Letters, Elsevier, vol. 151(C), pages 119-122.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven F. Lehrer & Tian Xie, 2022. "The Bigger Picture: Combining Econometrics with Analytics Improves Forecasts of Movie Success," Management Science, INFORMS, vol. 68(1), pages 189-210, January.
    2. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    3. Wenchao Xu & Xinyu Zhang, 2024. "On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included," Papers 2411.09258, arXiv.org.
    4. Zhao, Shangwei & Zhang, Xinyu & Gao, Yichen, 2016. "Model averaging with averaging covariance matrix," Economics Letters, Elsevier, vol. 145(C), pages 214-217.
    5. Xie, Tian, 2017. "Heteroscedasticity-robust model screening: A useful toolkit for model averaging in big data analytics," Economics Letters, Elsevier, vol. 151(C), pages 119-122.
    6. Tian Xie, 2019. "Forecast Bitcoin Volatility with Least Squares Model Averaging," Econometrics, MDPI, vol. 7(3), pages 1-20, September.
    7. Zhao, Shangwei & Xie, Tian & Ai, Xin & Yang, Guangren & Zhang, Xinyu, 2023. "Correcting sample selection bias with model averaging for consumer demand forecasting," Economic Modelling, Elsevier, vol. 123(C).
    8. Xie, Tian, 2015. "Prediction model averaging estimator," Economics Letters, Elsevier, vol. 131(C), pages 5-8.
    9. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    10. Qingfeng Liu & Andrey L. Vasnev, 2019. "A Combination Method for Averaging OLS and GLS Estimators," Econometrics, MDPI, vol. 7(3), pages 1-12, September.
    11. Hongwei Zhang & Qiang He & Ben Jacobsen & Fuwei Jiang, 2020. "Forecasting stock returns with model uncertainty and parameter instability," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 629-644, August.
    12. Alena Skolkova, 2023. "Model Averaging with Ridge Regularization," CERGE-EI Working Papers wp758, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    13. Wan, Alan T.K. & Zhang, Xinyu & Wang, Shouyang, 2014. "Frequentist model averaging for multinomial and ordered logit models," International Journal of Forecasting, Elsevier, vol. 30(1), pages 118-128.
    14. Yin-Wong Cheung & Wenhao Wang, 2020. "A Jackknife Model Averaging Analysis of RMB Misalignment Estimates," Journal of International Commerce, Economics and Policy (JICEP), World Scientific Publishing Co. Pte. Ltd., vol. 11(02), pages 1-45, June.
    15. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    16. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    17. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    18. Lastauskas, Povilas & Stakėnas, Julius, 2024. "Labor market policies in high- and low-interest rate environments: Evidence from the euro area," Economic Modelling, Elsevier, vol. 141(C).
    19. Shou-Yung Yin & Chu-An Liu & Chang-Ching Lin, 2021. "Focused Information Criterion and Model Averaging for Large Panels With a Multifactor Error Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 54-68, January.
    20. Wei, Yuting & Wang, Qihua, 2021. "Cross-validation-based model averaging in linear models with response missing at random," Statistics & Probability Letters, Elsevier, vol. 171(C).

    More about this item

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • M21 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Economics - - - Business Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:99:y:2017:i:5:p:749-755. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: The MIT Press (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.