IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v13y2021i23p13340-d693314.html
   My bibliography  Save this article

The Contribution of Online Reviews for Quality Evaluation of Cultural Tourism Offers: The Experience of Italian Museums

Author

Listed:
  • Deborah Agostino

    (Economics and Industrial Engineering, Department of Management, Politecnico di Milano, Via Lambruschini 4/b, 20156 Milano, Italy)

  • Marco Brambilla

    (Data Science Lab, Informazione e Bioingegneria, Dipartimento di Elettronica, Politecnico di Milano, Via Ponzio 34/5, 20133 Milano, Italy)

  • Silvio Pavanetto

    (Informazione e Bioingegneria, Dipartimento di Elettronica, Politecnico di Milano, Via Ponzio 34/5, 20133 Milano, Italy)

  • Paola Riva

    (Economics and Industrial Engineering, Department of Management, Politecnico di Milano, Via Lambruschini 4/b, 20156 Milano, Italy)

Abstract

In the cultural tourism field, there has been an increasing interest in adopting data-driven approaches that are aimed at measuring the service quality dimensions through online reviews. To date, studies measuring quality dimensions in cultural tourism settings through content analysis of online user-generated reviews are mainly based on manual approaches. When the content analysis is automated, these studies do not compare different analytical approaches. Our paper enters this field by comparing two different automated content analysis approaches to evaluate which of the two is more adequate for assessing the quality dimensions through user-generated reviews in an empirical setting of 100 Italian museums. Specifically, we compare a ‘top-down’ content analysis approach that is based on a supervised classification built on policy makers’ guidelines and a ‘bottom-up’ approach that is based on an unsupervised topic model of the online words of reviewers. The resulting museum quality dimensions are compared, showing that the ‘bottom-up’ approach reveals additional quality dimensions compared with those obtained through the ‘top-down’ approach. The misalignment of the results of the ‘top-down’ and ‘bottom-up’ approaches to quality evaluation for museums enhances the critical discussion on the contribution that data analytics can offer to support decision making in cultural tourism.

Suggested Citation

  • Deborah Agostino & Marco Brambilla & Silvio Pavanetto & Paola Riva, 2021. "The Contribution of Online Reviews for Quality Evaluation of Cultural Tourism Offers: The Experience of Italian Museums," Sustainability, MDPI, vol. 13(23), pages 1-20, December.
    • Handle: RePEc:gam:jsusta:v:13:y:2021:i:23:p:13340-:d:693314
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/13/23/13340/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/13/23/13340/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guo, Yue & Barnes, Stuart J. & Jia, Qiong, 2017. "Mining meaning from online ratings and reviews: Tourist satisfaction analysis using latent dirichlet allocation," Tourism Management, Elsevier, vol. 59(C), pages 467-483.
    2. Nuno Antonio & Marisol B. Correia & Filipa Perdigão Ribeiro, 2020. "Exploring User-Generated Content for Improving Destination Knowledge: The Case of Two World Heritage Cities," Sustainability, MDPI, vol. 12(22), pages 1-19, November.
    3. Guizzardi, Andrea & Mazzocchi, Mario, 2010. "Tourism demand for Italy and the business cycle," Tourism Management, Elsevier, vol. 31(3), pages 367-377.
    4. Jun Shao & Qinlin Ying & Shujin Shu & Alastair M. Morrison & Elizabeth Booth, 2019. "Museum Tourism 2.0: Experiences and Satisfaction with Shopping at the National Gallery in London," Sustainability, MDPI, vol. 11(24), pages 1-16, December.
    5. Sheng, Chieh-Wen & Chen, Ming-Chia, 2012. "A study of experience expectations of museum visitors," Tourism Management, Elsevier, vol. 33(1), pages 53-60.
    6. Liu, Yong & Teichert, Thorsten & Rossi, Matti & Li, Hongxiu & Hu, Feng, 2017. "Big data for big insights: Investigating language-specific drivers of hotel satisfaction with 412,784 user-generated reviews," Tourism Management, Elsevier, vol. 59(C), pages 554-563.
    7. Dimache, Alexandru & Wondirad, Amare & Agyeiwaah, Elizabeth, 2017. "One museum, two stories: Place identity at the Hong Kong Museum of History," Tourism Management, Elsevier, vol. 63(C), pages 287-301.
    8. Torre, Andrew & Scarborough, Helen, 2017. "Reconsidering the estimation of the economic impact of cultural tourism," Tourism Management, Elsevier, vol. 59(C), pages 621-629.
    9. Zhenshan Xu & Hong Zhang & Chunhui Zhang & Man Xu & Nan Dong, 2019. "Exploring the Role of Emotion in the Relationship between Museum Image and Tourists’ Behavioral Intention: The Case of Three Museums in Xi’an," Sustainability, MDPI, vol. 11(3), pages 1-20, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andreea Marin-Pantelescu & Laurențiu Tăchiciu & Ionica Oncioiu & Mihaela Ștefan-Hint, 2022. "Erasmus Students’ Experiences as Cultural Visitors: Lessons in Destination Management," Sustainability, MDPI, vol. 14(5), pages 1-26, February.
    2. Vincenzo Varriale & Antonello Cammarano & Francesca Michelino & Mauro Caputo, 2023. "Industry 5.0 and Triple Bottom Line Approach in Supply Chain Management: The State-of-the-Art," Sustainability, MDPI, vol. 15(7), pages 1-30, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sunyoung Hlee & Hanna Lee & Chulmo Koo, 2018. "Hospitality and Tourism Online Review Research: A Systematic Analysis and Heuristic-Systematic Model," Sustainability, MDPI, vol. 10(4), pages 1-27, April.
    2. Ahani, Ali & Nilashi, Mehrbakhsh & Yadegaridehkordi, Elaheh & Sanzogni, Louis & Tarik, A. Rashid & Knox, Kathy & Samad, Sarminah & Ibrahim, Othman, 2019. "Revealing customers’ satisfaction and preferences through online review analysis: The case of Canary Islands hotels," Journal of Retailing and Consumer Services, Elsevier, vol. 51(C), pages 331-343.
    3. Ziye Shang & Jian Ming Luo, 2022. "Topic Modeling for Hiking Trail Online Reviews: Analysis of the Mutianyu Great Wall," Sustainability, MDPI, vol. 14(6), pages 1-16, March.
    4. Mehrbakhsh Nilashi & Abbas Mardani & Huchang Liao & Hossein Ahmadi & Azizah Abdul Manaf & Wafa Almukadi, 2019. "A Hybrid Method with TOPSIS and Machine Learning Techniques for Sustainable Development of Green Hotels Considering Online Reviews," Sustainability, MDPI, vol. 11(21), pages 1-21, October.
    5. Zajadacz Alina & Minkwitz Aleksandra, 2020. "Using Social Media Data to Plan for Tourism," Quaestiones Geographicae, Sciendo, vol. 39(3), pages 125-138, September.
    6. Clérito Kaveski Peres & Edson Pacheco Paladini, 2022. "Quality Attributes of Hotel Services in Brazil and the Impacts of COVID-19 on Users’ Perception," Sustainability, MDPI, vol. 14(6), pages 1-15, March.
    7. Jun Shao & Qinlin Ying & Shujin Shu & Alastair M. Morrison & Elizabeth Booth, 2019. "Museum Tourism 2.0: Experiences and Satisfaction with Shopping at the National Gallery in London," Sustainability, MDPI, vol. 11(24), pages 1-16, December.
    8. Nguyen The Hien & Yen-Lun Su & Raksmey Sann & Le Thi Phuong Thanh, 2022. "Analysis of Online Customer Complaint Behavior in Vietnam’s Hotel Industry," Sustainability, MDPI, vol. 14(7), pages 1-15, March.
    9. Raksmey Sann & Pei-Chun Lai & Hui-Chen Chang, 2020. "Does Culture of Origin Have an Impact on Online Complaining Behaviors? The Perceptions of Asians and Non-Asians," Sustainability, MDPI, vol. 12(5), pages 1-37, February.
    10. Wang, Binni & Wang, Pong & Tu, Yiliu, 2021. "Customer satisfaction service match and service quality-based blockchain cloud manufacturing," International Journal of Production Economics, Elsevier, vol. 240(C).
    11. Yucheng Zhang & Zhiling Wang & Lin Xiao & Lijun Wang & Pei Huang, 2023. "Discovering the evolution of online reviews: A bibliometric review," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-22, December.
    12. Juan Carlos Martín & Veronika Rudchenko & María-Victoria Sánchez-Rebull, 2020. "The Role of Nationality and Hotel Class on Guests’ Satisfaction. A Fuzzy-TOPSIS Approach Applied in Saint Petersburg," Administrative Sciences, MDPI, vol. 10(3), pages 1-24, September.
    13. M. Narciso, 2022. "The Unreliability of Online Review Mechanisms," Journal of Consumer Policy, Springer, vol. 45(3), pages 349-368, September.
    14. Yağmur, Yenal & Aksu, Akın, 2022. "Investigation of destination image mediating effect on tourists’ risk assessment, behavioural intentions and satisfaction," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 8(1), pages 27-37.
    15. Ian Sutherland & Youngseok Sim & Seul Ki Lee & Jaemun Byun & Kiattipoom Kiatkawsin, 2020. "Topic Modeling of Online Accommodation Reviews via Latent Dirichlet Allocation," Sustainability, MDPI, vol. 12(5), pages 1-15, February.
    16. Jiacong Wu & Yu Wang & Ru Zhang & Jing Cai, 2018. "An Approach to Discovering Product/Service Improvement Priorities: Using Dynamic Importance-Performance Analysis," Sustainability, MDPI, vol. 10(10), pages 1-26, October.
    17. Zuo, Wenming & Bai, Weijing & Zhu, Wenfeng & He, Xinming & Qiu, Xinxin, 2022. "Changes in service quality of sharing accommodation: Evidence from airbnb," Technology in Society, Elsevier, vol. 71(C).
    18. Tahereh Dehdarirad & Kalle Karlsson, 2021. "News media attention in Climate Action: latent topics and open access," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8109-8128, September.
    19. Shuyue Huang & Lena Jingen Liang & Hwansuk Chris Choi, 2022. "How We Failed in Context: A Text-Mining Approach to Understanding Hotel Service Failures," Sustainability, MDPI, vol. 14(5), pages 1-18, February.
    20. An-Jin Shie & You-Yu Dai & Ming-Xing Shen & Li Tian & Ming Yang & Wen-Wei Luo & Yenchun Jim Wu & Zhao-Hui Su, 2022. "Diamond Model of Green Commitment and Low-Carbon Travel Motivation, Constraint, and Intention," IJERPH, MDPI, vol. 19(14), pages 1-21, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:13:y:2021:i:23:p:13340-:d:693314. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.