IDEAS home Printed from https://ideas.repec.org/a/spr/joamsc/v44y2016i1d10.1007_s11747-015-0455-4.html
   My bibliography  Save this article

Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies

Author

Listed:
  • Clay M. Voorhees

    (Michigan State University)

  • Michael K. Brady

    (Florida State University)

  • Roger Calantone

    (Michigan State University)

  • Edward Ramirez

    (University of Texas at El Paso)

Abstract

The results of this research suggest a new mandate for discriminant validity testing in marketing. Specifically, the authors demonstrate that the AVE-SV comparison (Fornell and Larcker 1981) and HTMT ratio (Henseler et al. 2015) with 0.85 cutoff provide the best assessment of discriminant validity and should be the standard for publication in marketing. These conclusions are based on a thorough assessment of the literature and the results of a Monte Carlo simulation. First, based on a content analysis of articles published in seven leading marketing journals from 1996 to 2012, the authors demonstrate that three tests—the constrained phi (Jöreskog 1971), AVE-SV (Fornell and Larcker 1981), and overlapping confidence intervals (Anderson and Gerbing 1988)—are by far most common. Further review reveals that (1) more than 20% of survey-based and over 80% of non-survey-based marketing studies fail to document tests for discriminant validity, (2) there is wide variance across journals and research streams in terms of whether discriminant validity tests are performed, (3) conclusions have already been drawn about the relative stringency of the three most common methods, and (4) the method that is generally perceived to be most generous is being consistently misapplied in a way that erodes its stringency. Second, a Monte Carlo simulation is conducted to assess the relative rigor of the three most common tests, as well as an emerging technique (HTMT). Results reveal that (1) on average, the four discriminant validity testing methods detect violations approximately 50% of the time, (2) the constrained phi and overlapping confidence interval approaches perform very poorly in detecting violations whereas the AVE-SV test and HTMT (with a ratio cutoff of 0.85) methods perform well, and (3) the HTMT.85 method offers the best balance between high detection and low arbitrary violation (i.e., false positive) rates.

Suggested Citation

  • Clay M. Voorhees & Michael K. Brady & Roger Calantone & Edward Ramirez, 2016. "Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies," Journal of the Academy of Marketing Science, Springer, vol. 44(1), pages 119-134, January.
    • Handle: RePEc:spr:joamsc:v:44:y:2016:i:1:d:10.1007_s11747-015-0455-4
    DOI: 10.1007/s11747-015-0455-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11747-015-0455-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11747-015-0455-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Frederic Lord, 1957. "A significance test for the hypothesis that two variables measure the same trait except for errors of measurement," Psychometrika, Springer;The Psychometric Society, vol. 22(3), pages 207-220, September.
    2. Rajdeep Grewal & Joseph A. Cote & Hans Baumgartner, 2004. "Multicollinearity and Measurement Error in Structural Equation Models: Implications for Theory Testing," Marketing Science, INFORMS, vol. 23(4), pages 519-529, June.
    3. Frambach, R.T. & Prabhu, J.C. & Verhallen, T.M.M., 2003. "The influence of business strategy on new product activity : The role of market orientation," Other publications TiSEM 64c2e300-9f26-4178-ba34-2, Tilburg University, School of Economics and Management.
    4. Farrell, Andrew M., 2010. "Insufficient discriminant validity: A comment on Bove, Pervan, Beatty, and Shiu (2009)," Journal of Business Research, Elsevier, vol. 63(3), pages 324-327, March.
    5. K. Jöreskog, 1971. "Simultaneous factor analysis in several populations," Psychometrika, Springer;The Psychometric Society, vol. 36(4), pages 409-426, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franke, George R. & Sarstedt, Marko & Danks, Nicholas P., 2021. "Assessing measure congruence in nomological networks," Journal of Business Research, Elsevier, vol. 130(C), pages 318-334.
    2. Shiu, Edward & Pervan, Simon J. & Bove, Liliana L. & Beatty, Sharon E., 2011. "Reflections on discriminant validity: Reexamining the Bove et al. (2009) findings," Journal of Business Research, Elsevier, vol. 64(5), pages 497-500, May.
    3. Claudia García-García & Catalina B. García-García & Román Salmerón, 2021. "Confronting collinearity in environmental regression models: evidence from world data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(3), pages 895-926, September.
    4. Dacko, Scott G. & Spalteholz, Carolin, 2014. "Upgrading the city: Enabling intermodal travel behaviour," Technological Forecasting and Social Change, Elsevier, vol. 89(C), pages 222-235.
    5. Sridhar, Shrihari & Naik, Prasad A. & Kelkar, Ajay, 2017. "Metrics unreliability and marketing overspending," International Journal of Research in Marketing, Elsevier, vol. 34(4), pages 761-779.
    6. Rajdeep Grewal & Murali Chandrashekaran & F. Robert Dwyer, 2008. "Navigating Local Environments with Global Strategies: A Contingency Model of Multinational Subsidiary Performance," Marketing Science, INFORMS, vol. 27(5), pages 886-902, 09-10.
    7. Femke Hilverda & Margôt Kuttschreuter, 2018. "Online Information Sharing About Risks: The Case of Organic Food," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1904-1920, September.
    8. Mahabubur Rahman & M. Ángeles Rodríguez-Serrano & Mary Lambkin, 2019. "Brand equity and firm performance: the complementary role of corporate social responsibility," Journal of Brand Management, Palgrave Macmillan, vol. 26(6), pages 691-704, November.
    9. K. Jöreskog, 1971. "Statistical analysis of sets of congeneric tests," Psychometrika, Springer;The Psychometric Society, vol. 36(2), pages 109-133, June.
    10. Petra Dickel & Monika Sienknecht & Jacob Hörisch, 2021. "The early bird catches the worm: an empirical analysis of imprinting in social entrepreneurship," Journal of Business Economics, Springer, vol. 91(2), pages 127-150, March.
    11. Vishal K. Gupta & Suman Niranjan & Banu A. Goktan & John Eriskon, 2016. "Individual entrepreneurial orientation role in shaping reactions to new technologies," International Entrepreneurship and Management Journal, Springer, vol. 12(4), pages 935-961, December.
    12. Kotler, Philip & Manrai, Lalita A. & Lascu, Dana-Nicoleta & Manrai, Ajay K., 2019. "Influence of country and company characteristics on international business decisions: A review, conceptual model, and propositions," International Business Review, Elsevier, vol. 28(3), pages 482-498.
    13. Lee, Ruby P. & Johnson, Jean L. & Grewal, Rajdeep, 2008. "Understanding the antecedents of collateral learning in new product alliances," International Journal of Research in Marketing, Elsevier, vol. 25(3), pages 192-200.
    14. Rogier van de Wetering & Sherah Kurnia & Svyatoslav Kotusev, 2020. "The Effect of Enterprise Architecture Deployment Practices on Organizational Benefits: A Dynamic Capability Perspective," Sustainability, MDPI, vol. 12(21), pages 1-21, October.
    15. You-Kyung Lee, 2021. "Impacts of Digital Technostress and Digital Technology Self-Efficacy on Fintech Usage Intention of Chinese Gen Z Consumers," Sustainability, MDPI, vol. 13(9), pages 1-15, April.
    16. McDonald, Heath & Karg, Adam J. & Vocino, Andrea, 2013. "Measuring season ticket holder satisfaction: Rationale, scale development and longitudinal validation," Sport Management Review, Elsevier, vol. 16(1), pages 41-53.
    17. Zhang, Jing & Brown, Colin & Qiao, Guanghua & Zhang, Bao, 2019. "Effect of Eco-compensation Schemes on Household Income Structures and Herder Satisfaction: Lessons From the Grassland Ecosystem Subsidy and Award Scheme in Inner Mongolia," Ecological Economics, Elsevier, vol. 159(C), pages 46-53.
    18. Christian Homburg, 2007. "Betriebswirtschaftslehre als Empirische Wissenschaft — Bestandsaufnahme und Empfehlungen," Schmalenbach Journal of Business Research, Springer, vol. 59(56), pages 27-60, January.
    19. Kee-Young Kwahk & Byoungsoo Kim, 2017. "Effects of social media on consumers’ purchase decisions: evidence from Taobao," Service Business, Springer;Pan-Pacific Business Association, vol. 11(4), pages 803-829, December.
    20. Horstmann, Felix, 2017. "Measuring the shopper's attitude toward the point of sale display: Scale development and validation," Journal of Retailing and Consumer Services, Elsevier, vol. 36(C), pages 112-123.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joamsc:v:44:y:2016:i:1:d:10.1007_s11747-015-0455-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.