IDEAS home Printed from https://ideas.repec.org/a/spr/joamsc/v49y2021i2d10.1007_s11747-020-00766-8.html
   My bibliography  Save this article

The biasing effect of common method variance: some clarifications

Author

Listed:
  • Hans Baumgartner

    (Pennsylvania State University)

  • Bert Weijters

    (Ghent University)

  • Rik Pieters

    (Tilburg University)

Abstract

There are enduring misconceptions in the marketing and management literature about the potential biasing effects of Common Method Variance (CMV). One belief is that the biasing effect of CMV is of greater theoretical than practical importance; another belief is that if CMV is a potential problem, it can be easily identified with the Harman one-factor test. In this article, we show that both beliefs are ill founded and need correction. To demonstrate our key points with greater generality, we use analytical derivations rather than empirical simulations. First, we examine the effects of CMV on correlations between observed variables as a function of measure unreliability and the sign and size of the “true” trait correlation. We demonstrate that, for negative trait correlations, CMV leads to a substantial upward bias in observed correlations (i.e., observed correlations are less negative than the trait correlation), and under certain conditions observed correlations may even have the wrong sign (assuming that the method loadings are both positive or both negative). We also show that, for positive trait correlations, the downward bias due to measurement unreliability does not always mitigate the upward bias due to CMV (again assuming that the method loadings are either both positive or both negative). Importantly, our results indicate that the inflationary effect of CMV is larger at lower levels of (positive) trait correlations, whereas the deflationary effect of unreliability is larger at higher levels of trait correlations. Second, we demonstrate analytically the serious deficiencies of the popular Harman one-factor test for detecting common method variance and strongly recommend against its use in future research.

Suggested Citation

  • Hans Baumgartner & Bert Weijters & Rik Pieters, 2021. "The biasing effect of common method variance: some clarifications," Journal of the Academy of Marketing Science, Springer, vol. 49(2), pages 221-235, March.
  • Handle: RePEc:spr:joamsc:v:49:y:2021:i:2:d:10.1007_s11747-020-00766-8
    DOI: 10.1007/s11747-020-00766-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11747-020-00766-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11747-020-00766-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Williams, Larry J. & Brown, Barbara K., 1994. "Method Variance in Organizational Behavior and Human Resources Research: Effects on Correlations, Path Coefficients, and Hypothesis Testing," Organizational Behavior and Human Decision Processes, Elsevier, vol. 57(2), pages 185-209, February.
    2. Weijters, Bert & Cabooter, Elke & Schillewaert, Niels, 2010. "The effect of rating scale format on response styles: The number of response categories and response category labels," International Journal of Research in Marketing, Elsevier, vol. 27(3), pages 236-247.
    3. Aaron Cohen & Sari Ehrlich, 2019. "Exchange variables, organizational culture and their relationship with constructive deviance," Management Research Review, Emerald Group Publishing Limited, vol. 42(12), pages 1423-1446, July.
    4. MacKenzie, Scott B. & Podsakoff, Philip M., 2012. "Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies," Journal of Retailing, Elsevier, vol. 88(4), pages 542-555.
    5. Weijters, Bert & Geuens, Maggie & Schillewaert, Niels, 2009. "The proximity effect: The role of inter-item distance on reverse-item bias," International Journal of Research in Marketing, Elsevier, vol. 26(1), pages 2-12.
    6. Baumgartner, Hans & Weijters, Bert, 2019. "Measurement in Marketing," Foundations and Trends(R) in Marketing, now publishers, vol. 12(4), pages 278–400-2, December.
    7. John Hulland & Hans Baumgartner & Keith Marion Smith, 2018. "Marketing survey research best practices: evidence and recommendations from a review of JAMS articles," Journal of the Academy of Marketing Science, Springer, vol. 46(1), pages 92-108, January.
    8. Fuller, Christie M. & Simmering, Marcia J. & Atinc, Guclu & Atinc, Yasemin & Babin, Barry J., 2016. "Common methods variance detection in business research," Journal of Business Research, Elsevier, vol. 69(8), pages 3192-3198.
    9. Fabian Bill & Sven Feurer & Martin Klarmann, 2020. "Salesperson social media use in business-to-business relationships: An empirical test of an integrative framework linking antecedents and consequences," Journal of the Academy of Marketing Science, Springer, vol. 48(4), pages 734-752, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bartschat, Maria & Cziehso, Gerrit & Hennig-Thurau, Thorsten, 2022. "Searching for word of mouth in the digital age: Determinants of consumers’ uses of face-to-face information, internet opinion sites, and social media," Journal of Business Research, Elsevier, vol. 141(C), pages 393-409.
    2. Dash, Ganesh & Sharma, Kiran & Yadav, Neha, 2023. "The diffusion of mobile payments: Profiling the adopters and non-adopters, Roger's way," Journal of Retailing and Consumer Services, Elsevier, vol. 71(C).
    3. Yan-Fang Zhou & Atsushi Nanakida, 2023. "Job satisfaction and self-efficacy of in-service early childhood teachers in the post-COVID-19 pandemic era," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-13, December.
    4. Mohsin Raza & Rimsha Khalid & Larisa Ivascu & Jati Kasuma, 2023. "Education Beats at the Heart of the Sustainability in Thailand: The Role of Institutional Awareness, Image, Experience, and Student Volunteer Behavior," Sustainability, MDPI, vol. 15(2), pages 1-16, January.
    5. Sarah Desiree Schaefer & Peggy Cunningham & Sandra Diehl & Ralf Terlutter, 2024. "Employees' positive perceptions of corporate social responsibility create beneficial outcomes for firms and their employees: Organizational pride as a mediator," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(3), pages 2574-2587, May.
    6. Muhammad Zaheer Asghar & Javed Iqbal & Pirita Seitamaa-Hakkarainen & Elena Barbera & Fatih Mutlu Ozbilen & Yasira Waqar, 2023. "Symmetrical and Asymmetrical Modeling: Applying Vitae Researchers’ Development Framework through the Lens of Web 2.0 Technologies for Vocational-Health Education Researchers," Sustainability, MDPI, vol. 15(9), pages 1-19, May.
    7. Alamoudi, Hawazen & Shaikh, Aijaz A. & Alharthi, Majed & Dash, Ganesh, 2023. "With great power comes great responsibilities – Examining platform-based mechanisms and institutional trust in rideshare services," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    8. Dash, Ganesh & Alharthi, Majed & Albarrak, Mansour & Aggarwal, Shalini, 2024. "Saudi millennials’ panic buying behavior during pandemic and post-pandemic: Role of social media addiction and religious values and commitment," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    9. Ya Wen & Fei Liu & Liman Pang & Huaruo Chen, 2022. "Proactive Personality and Career Adaptability of Chinese Female Pre-Service Teachers in Primary Schools: The Role of Calling," Sustainability, MDPI, vol. 14(7), pages 1-17, April.
    10. Gilal, Faheem Gul & Gilal, Naeem Gul & Shahid, Shadma & Gilal, Rukhsana Gul & Shah, Syed Mir Muhammad, 2022. "The role of product design in shaping masstige brand passion: A masstige theory perspective," Journal of Business Research, Elsevier, vol. 152(C), pages 487-504.
    11. Eiko Matsuda & Mariko Kikutani, 2022. "The Interactive Influence of Life Stressor and Sleep Disturbance on Depression: A Cross-Sectional Examination on Chinese and Japanese University Students," SAGE Open, , vol. 12(1), pages 21582440221, March.
    12. Zohra Ghali-Zinoubi, 2023. "Online Retailers’ Perceived Ethics and Consumer Repetitive Purchases Under the Moderating Role of Reputation: A Commitment-Trust Theory Perspective," SAGE Open, , vol. 13(4), pages 21582440231, November.
    13. Daryanto, Ahmad & Lukas, Bryan A., 2022. "Controlling for spurious moderation in marketing: A review of statistical techniques," Journal of Business Research, Elsevier, vol. 144(C), pages 180-192.
    14. Leigh McAlister & Frank Germann & Natalie Chisam & Pete Hayes & Adriana Lynch & Bill Stewart, 2023. "A taxonomy of marketing organizations," Journal of the Academy of Marketing Science, Springer, vol. 51(3), pages 617-635, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dubey, Vivek K. & Matthes, Joseph M. & Saini, Amit, 2023. "Impact of socioeconomic values collaboration on performance in franchising," Journal of Business Research, Elsevier, vol. 162(C).
    2. Ryan Mullins & Raj Agnihotri, 2022. "Digital selling: organizational and managerial influences for frontline readiness and effectiveness," Journal of the Academy of Marketing Science, Springer, vol. 50(4), pages 800-821, July.
    3. Talwar, Shalini & Kaur, Puneet & Escobar, Octavio & Lan, Sai, 2022. "Virtual reality tourism to satisfy wanderlust without wandering: An unconventional innovation to promote sustainability," Journal of Business Research, Elsevier, vol. 152(C), pages 128-143.
    4. Lussier, Bruno & Philp, Matthew & Hartmann, Nathaniel N. & Wieland, Heiko, 2021. "Social anxiety and salesperson performance: The roles of mindful acceptance and perceived sales manager support," Journal of Business Research, Elsevier, vol. 124(C), pages 112-125.
    5. Cheah, Jun-Hwa & Lim, Xin-Jean & Ting, Hiram & Liu, Yide & Quach, Sara, 2022. "Are privacy concerns still relevant? Revisiting consumer behaviour in omnichannel retailing," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    6. Castaldo, Sandro & Ciacci, Andrea & Penco, Lara & Profumo, Giorgia, 2024. "Which trust layer better counterbalances the risk impact on travel intentions in a crisis scenario?," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    7. Surajit Bag & Muhammad Sabbir Rahman & Susmi Routray & Santosh Kumar Shrivastav & Soni Agrawal, 2024. "Exploring the potential of blockchain‐enabled smart contracts for achieving net‐zero emissions: An empirical study," Business Strategy and the Environment, Wiley Blackwell, vol. 33(5), pages 3965-3985, July.
    8. Lim, Xin-Jean & Cheah, Jun-Hwa & Ngo, Liem Viet & Chan, Kara & Ting, Hiram, 2023. "How do crazy rich Asians perceive sustainable luxury? Investigating the determinants of consumers’ willingness to pay a premium price," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    9. Adilson Carlos Yoshikuni & Rajeev Dwivedi & Ronaldo Gomes Dultra-de-Lima & Claudio Parisi & José Carlos Tiomatsu Oyadomari, 2023. "Role of Emerging Technologies in Accounting Information Systems for Achieving Strategic Flexibility through Decision-Making Performance: An Exploratory Study Based on North American and South American," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 24(2), pages 199-218, June.
    10. Kakkar, Shiva & Vohra, Neharika, 2021. "Self-Regulatory Effects of Performance Management System Consistency on Employee Engagement: A Moderated Mediation Model," American Business Review, Pompea College of Business, University of New Haven, vol. 24(1), pages 225-248, May.
    11. Kalra, Ashish & Briggs, Elten & Schrock, Wyatt, 2023. "Exploring the synergistic role of ethical leadership and sales control systems on salesperson social media use and sales performance," Journal of Business Research, Elsevier, vol. 154(C).
    12. Peter J Jordan & Ashlea C Troth, 2020. "Common method bias in applied settings: The dilemma of researching in organizations," Australian Journal of Management, Australian School of Business, vol. 45(1), pages 3-14, February.
    13. Dash, Ganesh & Alharthi, Majed & Albarrak, Mansour & Aggarwal, Shalini, 2024. "Saudi millennials’ panic buying behavior during pandemic and post-pandemic: Role of social media addiction and religious values and commitment," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    14. Howard, Matt C. & Henderson, Jennifer, 2023. "A review of exploratory factor analysis in tourism and hospitality research: Identifying current practices and avenues for improvement," Journal of Business Research, Elsevier, vol. 154(C).
    15. Eslami, Hadi & Kacker, Manish & Hibbard, Jonathan D., 2020. "Antecedents of locus of causality attributions for destructive acts in distribution channels," Journal of Business Research, Elsevier, vol. 107(C), pages 302-314.
    16. Augusto, Mário & Godinho, Pedro & Torres, Pedro, 2019. "Building customers’ resilience to negative information in the airline industry," Journal of Retailing and Consumer Services, Elsevier, vol. 50(C), pages 235-248.
    17. Sarah Desiree Schaefer & Peggy Cunningham & Sandra Diehl & Ralf Terlutter, 2024. "Employees' positive perceptions of corporate social responsibility create beneficial outcomes for firms and their employees: Organizational pride as a mediator," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(3), pages 2574-2587, May.
    18. Sakib, Md Nazmus & Hasan, Fuad & Al-Emran, Md & Felix, Reto, 2023. "A cross-cultural analysis of ridesharing intentions and compliance with COVID-19 health guidelines: The roles of social trust, fear of COVID-19, and trust-in-God," Journal of Retailing and Consumer Services, Elsevier, vol. 71(C).
    19. Steven Day & Janet Godsell & Donato Masi & Wanrong Zhang, 2020. "Predicting consumer adoption of branded subscription services: A prospect theory perspective," Business Strategy and the Environment, Wiley Blackwell, vol. 29(3), pages 1310-1330, March.
    20. Marie Louise Radanielina Hita & Yany Grégoire & Bruno Lussier & Simon Boissonneault & Christian Vandenberghe & Sylvain Sénécal, 2023. "An extended health belief model for COVID-19: understanding the media-based processes leading to social distancing and panic buying," Journal of the Academy of Marketing Science, Springer, vol. 51(1), pages 132-152, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joamsc:v:49:y:2021:i:2:d:10.1007_s11747-020-00766-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.