IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v11y2019i8p2306-d223592.html
   My bibliography  Save this article

Using Decision Tree to Predict Response Rates of Consumer Satisfaction, Attitude, and Loyalty Surveys

Author

Listed:
  • Jian Han

    (Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China)

  • Miaodan Fang

    (Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China)

  • Shenglu Ye

    (Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China)

  • Chuansheng Chen

    (Department of Psychological Science, University of California, Irvine, CA 92697, USA)

  • Qun Wan

    (Zhejiang Big Data Exchange Center, Jiaxing 314501, China)

  • Xiuying Qian

    (Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou 310028, China)

Abstract

Response rate has long been a major concern in survey research commonly used in many fields such as marketing, psychology, sociology, and public policy. Based on 244 published survey studies on consumer satisfaction, loyalty, and trust, this study aimed to identify factors that were predictors of response rates. Results showed that response rates were associated with the mode of data collection (face-to-face > mail/telephone > online), type of survey sponsors (government agencies > universities/research institutions > commercial entities), confidentiality (confidential > non-confidential), direct invitation (yes > no), and cultural orientation (individualism > collectivism). A decision tree regression analysis (using classification and regression Tree (C&RT) algorithm on 80% of the studies as the training set and 20% as the test set) revealed that a model with all above-mentioned factors attained a linear correlation coefficient (0.578) between the predicted values and actual values, which was higher than the corresponding coefficient of the traditional linear regression model (0.423). A decision tree analysis (using C5.0 algorithm on 80% of the studies as the training set and 20% as the test set) revealed that a model with all above-mentioned factors attained an overall accuracy of 78.26% in predicting whether a survey had a high (>50%) or low (<50%) response rate. Direct invitation was the most important factor in all three models and had a consistent trend in predicting response rate.

Suggested Citation

  • Jian Han & Miaodan Fang & Shenglu Ye & Chuansheng Chen & Qun Wan & Xiuying Qian, 2019. "Using Decision Tree to Predict Response Rates of Consumer Satisfaction, Attitude, and Loyalty Surveys," Sustainability, MDPI, vol. 11(8), pages 1-13, April.
    • Handle: RePEc:gam:jsusta:v:11:y:2019:i:8:p:2306-:d:223592
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/11/8/2306/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/11/8/2306/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brüggen, Elisabeth & Dholakia, Utpal M., 2010. "Determinants of Participation and Response Effort in Web Panel Surveys," Journal of Interactive Marketing, Elsevier, vol. 24(3), pages 239-250.
    2. Doreen Zillmann & Andreas Schmitz & Jan Skopek & Hans-Peter Blossfeld, 2014. "Survey topic and unit nonresponse," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(4), pages 2069-2088, July.
    3. Joop Hox & Edith Leeuw, 1994. "A comparison of nonresponse in mail, telephone, and face-to-face surveys," Quality & Quantity: International Journal of Methodology, Springer, vol. 28(4), pages 329-344, November.
    4. Elisabeth Deutskens & Ko de Ruyter & Martin Wetzels & Paul Oosterveld, 2004. "Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study," Marketing Letters, Springer, vol. 15(1), pages 21-36, February.
    5. Jennifer Dykema & John Stevenson & Lisa Klein & Yujin Kim & Brendan Day, "undated". "Effects of E-Mailed Versus Mailed Invitations and Incentives on Response Rates, Data Quality, and Costs in a Web Survey of University Faculty," Mathematica Policy Research Reports d3e2eb6640e040ee943fd8b80, Mathematica Policy Research.
    6. Sauermann, Henry & Roach, Michael, 2013. "Increasing web survey response rates in innovation research: An experimental study of static and dynamic contact design features," Research Policy, Elsevier, vol. 42(1), pages 273-286.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hugo Horta & Shihui Feng & João M. Santos, 2022. "Homophily in higher education research: a perspective based on co-authorships," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 523-543, January.
    2. Gibson Kimutai & Alexander Ngenzi & Rutabayiro Ngoga Said & Ambrose Kiprop & Anna Förster, 2020. "An Optimum Tea Fermentation Detection Model Based on Deep Convolutional Neural Networks," Data, MDPI, vol. 5(2), pages 1-26, April.
    3. Pu Song & Xiangwei Liu & Xuan Cai & Mengmeng Zhong & Qingqing Wang & Xiangmei Zhu, 2024. "Predictive analysis of college students’ academic procrastination behavior based on a decision tree model," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    4. Qiaoling Wang & Ziyu Kou & Xiaodan Sun & Shanshan Wang & Xianjuan Wang & Hui Jing & Peiying Lin, 2022. "Predictive Analysis of the Pro-Environmental Behaviour of College Students Using a Decision-Tree Model," IJERPH, MDPI, vol. 19(15), pages 1-14, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rolf Becker, 2023. "Short- and long-term effects of reminders on panellists’ survey participation in a probability-based panel study with a sequential mixed-mode design," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(5), pages 4095-4119, October.
    2. Alice Barth & Andreas Schmitz, 2018. "Response quality and ideological dispositions: an integrative approach using geometric and classifying techniques," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(1), pages 175-194, January.
    3. Takumi Kato & Taro Miura, 2021. "The impact of questionnaire length on the accuracy rate of online surveys," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(2), pages 83-98, June.
    4. Wießner, Frank, 1998. "Das Überbrückungsgeld als Instrument der Arbeitsmarktpolitik : eine Zwischenbilanz (Bridging allowance as an instrument of labour market policy : a provisional appraisal)," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 31(1), pages 123-142.
    5. Wießner, Frank, 2003. "Nonresponse bei Verbleibsuntersuchungen : Korrekturverfahren zu Antwortausfällen am Beispiel ehemals arbeitsloser Existenzgründer, die mit dem Überbrückungsgeld (§ 57 SGB III) gefördert wurden (Non-re," Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 36(1), pages 77-96.
    6. Srinivasan, V. Seenu & Netzer, Oded, 2007. "Adaptive Self-Explication of Multi-attribute Preferences," Research Papers 1979, Stanford University, Graduate School of Business.
    7. Tatsushi Fukaya & Masayuki Suzuki & Ikumi Ozawa & Takumi Nakagoshi, 2022. "An Examination of Related Factors of Mathematical Pedagogical Content Knowledge in Elementary School Teachers: Focusing on Conceptions of Teaching and Learning and Test Utilization Strategy," SAGE Open, , vol. 12(4), pages 21582440221, October.
    8. Henk Van Goor & Sonja Rispens, 2004. "A Middle Class Image of Society," Quality & Quantity: International Journal of Methodology, Springer, vol. 38(1), pages 35-49, February.
    9. Christoph Markmann & Alexander Spickermann & Heiko A. von der Gracht & Alexander Brem, 2021. "Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    10. Laura Abrardi & Elena Grinza & Alessandro Manello & Flavio Porta, 2024. "Work from home arrangements and organizational performance in Italian SMEs: evidence from the COVID-19 pandemic," Empirical Economics, Springer, vol. 67(6), pages 2821-2863, December.
    11. Lusk, Jayson L., 2012. "The political ideology of food," Food Policy, Elsevier, vol. 37(5), pages 530-542.
    12. Vahid Sobhani & Mohammadjavad Rostamizadeh & Seyed Morteza Hosseini & Seyed Ebrahim Hashemi & Ignacio Refoyo Román & Daniel Mon-López, 2022. "Anthropometric, Physiological, and Psychological Variables That Determine the Elite Pistol Performance of Women," IJERPH, MDPI, vol. 19(3), pages 1-10, January.
    13. Giulia Mascarello & Anna Pinto & Stefania Crovato & Barbara Tiozzo Pezzoli & Marco Pietropaoli & Michela Bertola & Franco Mutinelli & Giovanni Formato, 2024. "Consumers’ Perceptions and Behaviors Regarding Honey Purchases and Expectations on Traceability and Sustainability in Italy," Sustainability, MDPI, vol. 16(20), pages 1-17, October.
    14. Barbara Ryan & Rachel King, 2020. "How ready is ready? Measuring physical preparedness for severe storms," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 104(1), pages 171-199, October.
    15. Yang Liu & Jan Hannig & Abhishek Pal Majumder, 2019. "Second-Order Probability Matching Priors for the Person Parameter in Unidimensional IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 701-718, September.
    16. Elisabeth Deutskens & Ad Jong & Ko Ruyter & Martin Wetzels, 2006. "Comparing the generalizability of online and mail surveys in cross-national service quality research," Marketing Letters, Springer, vol. 17(2), pages 119-136, April.
    17. Mackeben, Jan, 2020. "Mode Effects in the Fourth Wave of the Linked Personnel Panel (LPP) Employee Survey," FDZ Methodenreport 202005_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    18. Janose Osedeme & Robert Barron & Christian Salmon & Joseph Ekong, 2024. "An Electric Vehicle Adoption Model for Nigeria—A Fuzzy MCDA Policy Analysis Tool with Implications for Developing Nations," Sustainability, MDPI, vol. 16(16), pages 1-19, August.
    19. Giancarlo Condello & Laura Capranica & Mojca Doupona & Kinga Varga & Verena Burk, 2019. "Dual-career through the elite university student-athletes’ lenses: The international FISU-EAS survey," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-18, October.
    20. Amy Phillips & Ahmed Z. Khan & Frank Canters, 2021. "Use-Related and Socio-Demographic Variations in Urban Green Space Preferences," Sustainability, MDPI, vol. 13(6), pages 1-22, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:11:y:2019:i:8:p:2306-:d:223592. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.