IDEAS home Printed from https://ideas.repec.org/a/pal/jmarka/v11y2023i4d10.1057_s41270-023-00249-z.html
   My bibliography  Save this article

Using quality control checks to overcome pitfalls in the collection of primary data via online platforms

Author

Listed:
  • Sam Fullerton

    (The North-West University (RSA) and Eastern Michigan University)

  • Tammy McCullough

    (Eastern Michigan University)

Abstract

A sample of 1452 adult respondents in the United States was drawn using a highly respected commercial Internet-based service provider. The 85-question survey addressed issues related to anti-consumption behavior among consumers. The instrument incorporated four quality control checks designed to identify inattentive respondents and cleanse the resultant data set. These quality control (QC) checks were a uniform identifier (where one specific response should result), an instructional manipulation check. A common knowledge question, and a time check. A total of 514 (35.4%) respondents failed at least one of the four QC checks with nine respondents failing all four. Comparisons of inattentive respondents to those who passed all four QC checks consistently identified statistically significant differences on each of the metrics used to determine the potential impact of inattentive respondents. These results indicate that inattentiveness does not produce “random noise” as some authors have stated; rather the inattentive respondents “create both random and systematic measurement error which impacts estimates of the reliability and validity” of the metrics used to assess various consumer phenomena. The results of this study are important, not only in projects designed to help marketers, but also for research in other fields where accuracy is of paramount importance.

Suggested Citation

  • Sam Fullerton & Tammy McCullough, 2023. "Using quality control checks to overcome pitfalls in the collection of primary data via online platforms," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 602-612, December.
    • Handle: RePEc:pal:jmarka:v:11:y:2023:i:4:d:10.1057_s41270-023-00249-z
    DOI: 10.1057/s41270-023-00249-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41270-023-00249-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1057/s41270-023-00249-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Armstrong, J. Scott & Overton, Terry S., 1977. "Estimating Nonresponse Bias in Mail Surveys," MPRA Paper 81694, University Library of Munich, Germany.
    2. Elisabeth Deutskens & Ad Jong & Ko Ruyter & Martin Wetzels, 2006. "Comparing the generalizability of online and mail surveys in cross-national service quality research," Marketing Letters, Springer, vol. 17(2), pages 119-136, April.
    3. Leonard J. Paas & Meike Morren, 2018. "PLease do not answer if you are reading this: respondent attention in online panels," Marketing Letters, Springer, vol. 29(1), pages 13-21, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen-Kuei Wu & Shu-Chin Huang & Hsiao-Chung Wu & Maw-Liann Shyu, 2021. "The Effects of the Social Influence Approach on Swift Guanxi, Trust and Repurchase Intention When Considering Buyer Dependence," Sustainability, MDPI, vol. 13(14), pages 1-14, July.
    2. Tomar, Sweta & Kent Baker, H. & Kumar, Satish & Hoffmann, Arvid O.I., 2021. "Psychological determinants of retirement financial planning behavior," Journal of Business Research, Elsevier, vol. 133(C), pages 432-449.
    3. S. Arunachalam & Sridhar N. Ramaswami & Pol Herrmann & Doug Walker, 2018. "Innovation pathway to profitability: the role of entrepreneurial orientation and marketing capabilities," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 744-766, July.
    4. Yoon, Junghyun & Lee, Hee Yong & Dinwoodie, John, 2015. "Competitiveness of container terminal operating companies in South Korea and the industry–university–government network," Transportation Research Part A: Policy and Practice, Elsevier, vol. 80(C), pages 1-14.
    5. Sousa, Carlos M.P. & Bradley, Frank, 2008. "Antecedents of international pricing adaptation and export performance," Journal of World Business, Elsevier, vol. 43(3), pages 307-320, July.
    6. Son K. Lam & Thomas E. DeCarlo & Ashish Sharma, 2019. "Salesperson ambidexterity in customer engagement: do customer base characteristics matter?," Journal of the Academy of Marketing Science, Springer, vol. 47(4), pages 659-680, July.
    7. Danilo Soares‐Silva & Gustavo Hermínio Salati Marcondes de Moraes & Alexandre Cappellozza & Cristiano Morini, 2020. "Explaining library user loyalty through perceived service quality: What is wrong?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(8), pages 954-967, August.
    8. Van Wijk, Raymond & Nadolska, Anna, 2020. "Making more of alliance portfolios: The role of alliance portfolio coordination," European Management Journal, Elsevier, vol. 38(3), pages 388-399.
    9. Jarle Aarstad & Olav Andreas Kvitastein & Stig-Erik Jakobsen, 2019. "What Drives Enterprise Product Innovation? Assessing How Regional, National, And International Inter-Firm Collaboration Complement Or Substitute For R&D Investments," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 23(05), pages 1-25, June.
    10. Jonathan H. Reed, 2022. "Operational and strategic change during temporary turbulence: evidence from the COVID-19 pandemic," Operations Management Research, Springer, vol. 15(1), pages 589-608, June.
    11. Tarifa Fernández, Jorge & de Burgos Jiménez, Jerónimo & Céspedes Lorente, José Joaquín, 2018. "Absorptive capacity as a confounder of the process of supply chain integration," MPRA Paper 120125, University Library of Munich, Germany, revised 2018.
    12. Dirk Boehe & Luciano Barin Cruz, 2010. "Corporate Social Responsibility, Product Differentiation Strategy and Export Performance," Journal of Business Ethics, Springer, vol. 91(2), pages 325-346, February.
    13. Aziz Barhmi & Omar Hajaji, 2023. "Multidisciplinary Approach to Supply Chain Resilience: Conceptualization and Scale Development," Central European Business Review, Prague University of Economics and Business, vol. 2023(5), pages 43-69.
    14. Franck Brulhart & Sandrine Gherra & Bertrand V. Quelin, 2019. "Do Stakeholder Orientation and Environmental Proactivity Impact Firm Profitability?," Journal of Business Ethics, Springer, vol. 158(1), pages 25-46, August.
    15. Chin-Shan Lu & Kuo-Chung Shang & Chi-Chang Lin, 2016. "Examining sustainability performance at ports: port managers’ perspectives on developing sustainable supply chains," Maritime Policy & Management, Taylor & Francis Journals, vol. 43(8), pages 909-927, November.
    16. Liang Xiao & Linyong Luo & Tongping Ke, 2024. "The influence of eWOM information structures on consumers’ purchase intentions," Electronic Commerce Research, Springer, vol. 24(3), pages 1713-1735, September.
    17. Van Gils, Anita & Huybrechts, Jolien & Minola, Tommaso & Cassia, Lucio, 2019. "Unraveling the impact of family antecedents on family firm image: A serial multiple-mediation model," Journal of Family Business Strategy, Elsevier, vol. 10(1), pages 17-27.
    18. Tu Thanh Hoai & Nguyen Phong Nguyen, 2022. "Internal Control Systems and Performance of Emerging Market Firms: The Moderating Roles of Leadership Consistency and Quality," SAGE Open, , vol. 12(3), pages 21582440221, September.
    19. Baier-Fuentes, Hugo & Andrade-Valbuena, Nelson A. & Huertas Gonzalez-Serrano, Maria & Gaviria-Marin, Magaly, 2023. "Bricolage as an effective tool for the survival of owner-managed SMEs during crises," Journal of Business Research, Elsevier, vol. 157(C).
    20. Mei, Maggie Qiuzhu & Wang, Le & Yan, Jie, 2023. "Maintaining product quality consistency when offshoring to emerging markets: The role of subsidiary control," Journal of International Management, Elsevier, vol. 29(1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jmarka:v:11:y:2023:i:4:d:10.1057_s41270-023-00249-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.