IDEAS home Printed from https://ideas.repec.org/a/eee/ecmode/v139y2024ics0264999324001743.html
   My bibliography  Save this article

Noisy signals: Does rating volatility depend on the length of the consumption span?

Author

Listed:
  • Boto-García, David
  • Leoni, Veronica

Abstract

This study investigates the informational content of online reviews. Unlike other studies that have explored the drivers of average rating scores, we examine the factors explaining the variance in individual ratings for the same goods. In particular, we focus on how the length of stay at a hotel, as a measure of consumption span, influences the variance of rating scores. We conduct an empirical analysis using approximately 522,000 individual hotel reviews on Booking.com from five major European cities. Results indicate that the volatility of individual ratings decreases with stay duration, implying that online ratings from short-stayers (short consumption episodes) are noisy signals of the underlying hotel quality. We also present preliminary evidence that greater volatility negatively correlates with perceived usefulness by subsequent consumers. Our findings offer relevant insights for platform design operators about the drivers of rating volatility and how it affects social learning.

Suggested Citation

  • Boto-García, David & Leoni, Veronica, 2024. "Noisy signals: Does rating volatility depend on the length of the consumption span?," Economic Modelling, Elsevier, vol. 139(C).
  • Handle: RePEc:eee:ecmode:v:139:y:2024:i:c:s0264999324001743
    DOI: 10.1016/j.econmod.2024.106817
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0264999324001743
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econmod.2024.106817?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Susan Athey & Michael Luca, 2019. "Economists (and Economics) in Tech Companies," Journal of Economic Perspectives, American Economic Association, vol. 33(1), pages 209-230, Winter.
    2. Daniel Kahneman & Peter P. Wakker & Rakesh Sarin, 1997. "Back to Bentham? Explorations of Experienced Utility," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 375-406.
    3. Chunhua Wu & Hai Che & Tat Y. Chan & Xianghua Lu, 2015. "The Economic Value of Online Reviews," Marketing Science, INFORMS, vol. 34(5), pages 739-754, September.
    4. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    5. Marcello M. Mariani & Michela Matarazzo, 2021. "Does cultural distance affect online review ratings? Measuring international customers’ satisfaction with services leveraging digital platforms and big data," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 25(4), pages 1057-1078, December.
    6. Mira Frick & Ryota Iijima & Yuhta Ishii, 2020. "Misinterpreting Others and the Fragility of Social Learning," Econometrica, Econometric Society, vol. 88(6), pages 2281-2328, November.
    7. Arabmazar, Abbas & Schmidt, Peter, 1982. "An Investigation of the Robustness of the Tobit Estimator to Non-Normality," Econometrica, Econometric Society, vol. 50(4), pages 1055-1063, July.
    8. Hoffmann, Janina A. & Hosch, Ann-Katrin, 2023. "Predicting serial position effects and judgment errors in retrospective evaluations from memory recall," Journal of Economic Psychology, Elsevier, vol. 96(C).
    9. Bart de Langhe & Philip M. Fernbach & Donald R. Lichtenstein, 2016. "Navigating by the Stars: Investigating the Actual and Perceived Validity of Online User Ratings," Journal of Consumer Research, Oxford University Press, vol. 42(6), pages 817-833.
    10. Limin Fang, 2022. "The Effects of Online Review Platforms on Restaurant Revenue, Consumer Learning, and Welfare," Management Science, INFORMS, vol. 68(11), pages 8116-8143, November.
    11. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    12. Wang, Guocheng & Wang, Yanyi, 2018. "Herding, social network and volatility," Economic Modelling, Elsevier, vol. 68(C), pages 74-81.
    13. Eric Bettinger & Torbjørn Haegeland & Mari Rege, 2014. "Home with Mom: The Effects of Stay-at-Home Parents on Children's Long-Run Educational Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 32(3), pages 443-467.
    14. Oswald, Andrew J. & Powdthavee, Nattavudh, 2008. "Does happiness adapt? A longitudinal study of disability with implications for economists and judges," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1061-1077, June.
    15. Xu, Xun, 2020. "Examining an asymmetric effect between online customer reviews emphasis and overall satisfaction determinants," Journal of Business Research, Elsevier, vol. 106(C), pages 196-210.
    16. Liu, Zhiwei & Park, Sangwon, 2015. "What makes a useful online review? Implication for travel product websites," Tourism Management, Elsevier, vol. 47(C), pages 140-151.
    17. Marco Magnani, 2020. "The Economic And Behavioral Consequences Of Online User Reviews," Journal of Economic Surveys, Wiley Blackwell, vol. 34(2), pages 263-292, April.
    18. William Greene, 2004. "The behaviour of the maximum likelihood estimator of limited dependent variable models in the presence of fixed effects," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 98-119, June.
    19. Anderson, Lisa R & Holt, Charles A, 1997. "Information Cascades in the Laboratory," American Economic Review, American Economic Association, vol. 87(5), pages 847-862, December.
    20. Nelson, Phillip, 1970. "Information and Consumer Behavior," Journal of Political Economy, University of Chicago Press, vol. 78(2), pages 311-329, March-Apr.
    21. Arabmazar, Abbas & Schmidt, Peter, 1981. "Further evidence on the robustness of the Tobit estimator to heteroskedasticity," Journal of Econometrics, Elsevier, vol. 17(2), pages 253-258, November.
    22. Guizzardi, Andrea & Mariani, Marcello M. & Stacchini, Annalisa, 2022. "A temporal construal theory explanation of the price-quality relationship in online dynamic pricing," Journal of Business Research, Elsevier, vol. 146(C), pages 32-44.
    23. Balsa, Ana I. & Giuliano, Laura M. & French, Michael T., 2011. "The effects of alcohol use on academic achievement in high school," Economics of Education Review, Elsevier, vol. 30(1), pages 1-15, February.
    24. West, Patricia M & Broniarczyk, Susan M, 1998. "Integrating Multiple Opinions: The Role of Aspiration Level on Consumer Response to Critic Consensus," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(1), pages 38-51, June.
    25. Abhijit V. Banerjee, 1992. "A Simple Model of Herd Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 797-817.
    26. Harvey, A C, 1976. "Estimating Regression Models with Multiplicative Heteroscedasticity," Econometrica, Econometric Society, vol. 44(3), pages 461-465, May.
    27. Yi Zhao & Sha Yang & Vishal Narayan & Ying Zhao, 2013. "Modeling Consumer Learning from Online Product Reviews," Marketing Science, INFORMS, vol. 32(1), pages 153-169, May.
    28. Lightle, John P., 2016. "A rational choice model of the biased recall of information," Economic Modelling, Elsevier, vol. 53(C), pages 487-493.
    29. Leif Brandes & Yaniv Dover, 2022. "Offline Context Affects Online Reviews: The Effect of Post-Consumption Weather [Mobile Ad Effectiveness: Hyper-Contextual Targeting with Crowdedness]," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 49(4), pages 595-615.
    30. Yu, Zhuangxiong & Cheng, Jiajia & Mukhopadhaya, Pundarik & Dong, Jiemiao, 2023. "Do information spillovers across products aggravate product market monopoly? An examination with Chinese data," Economic Modelling, Elsevier, vol. 125(C).
    31. Davide Proserpio & Georgios Zervas, 2017. "Online Reputation Management: Estimating the Impact of Management Responses on Consumer Reviews," Marketing Science, INFORMS, vol. 36(5), pages 645-665, September.
    32. Sigelman, Lee & Zeng, Langche, 1999. "Analyzing Censored and Sample-Selected Data with Tobit and Heckit Models," Political Analysis, Cambridge University Press, vol. 8(2), pages 167-182, December.
    33. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    34. Hongbin Cai & Yuyu Chen & Hanming Fang, 2009. "Observational Learning: Evidence from a Randomized Natural Field Experiment," American Economic Review, American Economic Association, vol. 99(3), pages 864-882, June.
    35. Greene, William H, 1981. "On the Asymptotic Bias of the Ordinary Least Squares Estimator of the Tobit Model," Econometrica, Econometric Society, vol. 49(2), pages 505-513, March.
    36. Georgios Zervas & Davide Proserpio & John W. Byers, 2021. "A first look at online reputation on Airbnb, where every stay is above average," Marketing Letters, Springer, vol. 32(1), pages 1-16, March.
    37. H. Leibenstein, 1950. "Bandwagon, Snob, and Veblen Effects in the Theory of Consumers' Demand," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 64(2), pages 183-207.
    38. Chen, Pu & Chen, Yijuan & Hu, Xiangting & Li, Sanxi, 2015. "Can online markets attract high-quality products?," Economic Modelling, Elsevier, vol. 51(C), pages 65-71.
    39. Steffen Zimmermann & Philipp Herrmann & Dennis Kundisch & Barrie R. Nault, 2018. "Decomposing the Variance of Consumer Ratings and the Impact on Price and Demand," Information Systems Research, INFORMS, vol. 29(4), pages 984-1002, December.
    40. Daniel Kahneman & Richard H. Thaler, 2006. "Anomalies: Utility Maximization and Experienced Utility," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 221-234, Winter.
    41. Matthew Rabin & Joel L. Schrag, 1999. "First Impressions Matter: A Model of Confirmatory Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 37-82.
    42. Veronica Leoni & Anna Moretti, 2024. "Customer satisfaction during COVID-19 phases: the case of the Venetian hospitality system," Current Issues in Tourism, Taylor & Francis Journals, vol. 27(3), pages 396-412, February.
    43. Szroeter, Jerzy, 1978. "A Class of Parametric Tests for Heteroscedasticity in Linear Econometric Models X1-ab," Econometrica, Econometric Society, vol. 46(6), pages 1311-1327, November.
    44. Sendhil Mullainathan, 2002. "A Memory-Based Model of Bounded Rationality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 735-774.
    45. Luis Rayo & Gary S. Becker, 2007. "Evolutionary Efficiency and Happiness," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 302-337.
    46. Daron Acemoglu & Ali Makhdoumi & Azarakhsh Malekian & Asuman Ozdaglar, 2022. "Learning From Reviews: The Selection Effect and the Speed of Learning," Econometrica, Econometric Society, vol. 90(6), pages 2857-2899, November.
    47. Youngsoo Kim & Ramayya Krishnan, 2015. "On Product-Level Uncertainty and Online Purchase Behavior: An Empirical Analysis," Management Science, INFORMS, vol. 61(10), pages 2449-2467, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Boto-Garc a & Veronica Leoni, 2023. "Noisy signals: do ratings volatility depend on the length of the consumption span?," Working Papers wp1183, Dipartimento Scienze Economiche, Universita' di Bologna.
    2. Figini, Paolo & Leoni, Veronica & Vici, Laura, 2024. "And suddenly, the rain! When surprises shape experienced utility," Journal of Economic Behavior & Organization, Elsevier, vol. 224(C), pages 771-784.
    3. Arslan Aziz & Hui Li & Rahul Telang, 2023. "The Consequences of Rating Inflation on Platforms: Evidence from a Quasi-Experiment," Information Systems Research, INFORMS, vol. 34(2), pages 590-608, June.
    4. Sungsik Park & Woochoel Shin & Jinhong Xie, 2021. "The Fateful First Consumer Review," Marketing Science, INFORMS, vol. 40(3), pages 481-507, May.
    5. Guo, Qiaozhen & Chen, Ying-Ju & Huang, Wei, 2022. "Dynamic pricing of new experience products with dual-channel social learning and online review manipulations," Omega, Elsevier, vol. 109(C).
    6. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    7. Jason Greenberg & Daniel B. Sands & Gino Cattani & Joseph Porac, 2024. "Rating systems and increased heterogeneity in firm performance: Evidence from the New York City Restaurant Industry, 1994–2013," Strategic Management Journal, Wiley Blackwell, vol. 45(1), pages 36-65, January.
    8. S. Cicognani & P. Figini & M. Magnani, 2016. "Social Influence Bias in Online Ratings: A Field Experiment," Working Papers wp1060, Dipartimento Scienze Economiche, Universita' di Bologna.
    9. Jacobsen, Grant D., 2015. "Consumers, experts, and online product evaluations: Evidence from the brewing industry," Journal of Public Economics, Elsevier, vol. 126(C), pages 114-123.
    10. Anna K. Edenbrandt & Christian Gamborg & Bo Jellesmark Thorsen, 2020. "Observational learning in food choices: The effect of product familiarity and closeness of peers," Agribusiness, John Wiley & Sons, Ltd., vol. 36(3), pages 482-498, June.
    11. Carlson, Keith & Kopalle, Praveen K. & Riddell, Allen & Rockmore, Daniel & Vana, Prasad, 2023. "Complementing human effort in online reviews: A deep learning approach to automatic content generation and review synthesis," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 54-74.
    12. Bruno Frey & Alois Stutzer, 2014. "Economic Consequences of Mispredicting Utility," Journal of Happiness Studies, Springer, vol. 15(4), pages 937-956, August.
    13. Xitong Li, 2018. "Impact of Average Rating on Social Media Endorsement: The Moderating Role of Rating Dispersion and Discount Threshold," Information Systems Research, INFORMS, vol. 29(3), pages 739-754, September.
    14. Yang, Wenjuan & Zhang, Jiantong & Yan, Hong, 2022. "Promotions of online reviews from a channel perspective," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 161(C).
    15. Weijia (Daisy) Dai & Ginger Jin & Jungmin Lee & Michael Luca, 2018. "Aggregation of consumer ratings: an application to Yelp.com," Quantitative Marketing and Economics (QME), Springer, vol. 16(3), pages 289-339, September.
    16. Kim, Jong Min & Lee, Eunkyung & Mariani, Marcello M., 2021. "The influence of launching mobile channels on online customer reviews," Journal of Business Research, Elsevier, vol. 137(C), pages 366-378.
    17. Foster, Joshua, 2022. "How rating mechanisms shape user search, quality inference and engagement in online platforms: Experimental evidence," Journal of Business Research, Elsevier, vol. 142(C), pages 791-807.
    18. Brett Hollenbeck & Sridhar Moorthy & Davide Proserpio, 2019. "Advertising Strategy in the Presence of Reviews: An Empirical Analysis," Marketing Science, INFORMS, vol. 38(5), pages 793-811, September.
    19. Liting Li & Haichao Zheng & Dongyu Chen & Bin Zhu, 2024. "Whose reviews are most valuable for predicting the default risk of peer-to-peer lending platforms? Evidence from China," Electronic Commerce Research, Springer, vol. 24(3), pages 1619-1658, September.
    20. Chong (Alex) Wang & Xiaoquan (Michael) Zhang & Il-Horn Hann, 2018. "Socially Nudged: A Quasi-Experimental Study of Friends’ Social Influence in Online Product Ratings," Information Systems Research, INFORMS, vol. 29(3), pages 641-655, September.

    More about this item

    Keywords

    Online reviews; Ratings' variance; Length of stay; Quality uncertainty; Heteroskedasticity; Booking.com; Social learning;
    All these keywords.

    JEL classification:

    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • L15 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Information and Product Quality
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • L83 - Industrial Organization - - Industry Studies: Services - - - Sports; Gambling; Restaurants; Recreation; Tourism

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecmode:v:139:y:2024:i:c:s0264999324001743. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/30411 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.