IDEAS home Printed from https://ideas.repec.org/a/spr/joamsc/v44y2016i1d10.1007_s11747-015-0455-4.html
   My bibliography  Save this article

Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies

Author

Listed:
  • Clay M. Voorhees

    (Michigan State University)

  • Michael K. Brady

    (Florida State University)

  • Roger Calantone

    (Michigan State University)

  • Edward Ramirez

    (University of Texas at El Paso)

Abstract

The results of this research suggest a new mandate for discriminant validity testing in marketing. Specifically, the authors demonstrate that the AVE-SV comparison (Fornell and Larcker 1981) and HTMT ratio (Henseler et al. 2015) with 0.85 cutoff provide the best assessment of discriminant validity and should be the standard for publication in marketing. These conclusions are based on a thorough assessment of the literature and the results of a Monte Carlo simulation. First, based on a content analysis of articles published in seven leading marketing journals from 1996 to 2012, the authors demonstrate that three tests—the constrained phi (Jöreskog 1971), AVE-SV (Fornell and Larcker 1981), and overlapping confidence intervals (Anderson and Gerbing 1988)—are by far most common. Further review reveals that (1) more than 20% of survey-based and over 80% of non-survey-based marketing studies fail to document tests for discriminant validity, (2) there is wide variance across journals and research streams in terms of whether discriminant validity tests are performed, (3) conclusions have already been drawn about the relative stringency of the three most common methods, and (4) the method that is generally perceived to be most generous is being consistently misapplied in a way that erodes its stringency. Second, a Monte Carlo simulation is conducted to assess the relative rigor of the three most common tests, as well as an emerging technique (HTMT). Results reveal that (1) on average, the four discriminant validity testing methods detect violations approximately 50% of the time, (2) the constrained phi and overlapping confidence interval approaches perform very poorly in detecting violations whereas the AVE-SV test and HTMT (with a ratio cutoff of 0.85) methods perform well, and (3) the HTMT.85 method offers the best balance between high detection and low arbitrary violation (i.e., false positive) rates.

Suggested Citation

  • Clay M. Voorhees & Michael K. Brady & Roger Calantone & Edward Ramirez, 2016. "Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies," Journal of the Academy of Marketing Science, Springer, vol. 44(1), pages 119-134, January.
    • Handle: RePEc:spr:joamsc:v:44:y:2016:i:1:d:10.1007_s11747-015-0455-4
    DOI: 10.1007/s11747-015-0455-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11747-015-0455-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11747-015-0455-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Frederic Lord, 1957. "A significance test for the hypothesis that two variables measure the same trait except for errors of measurement," Psychometrika, Springer;The Psychometric Society, vol. 22(3), pages 207-220, September.
    2. Frambach, R.T. & Prabhu, J.C. & Verhallen, T.M.M., 2003. "The influence of business strategy on new product activity : The role of market orientation," Other publications TiSEM 64c2e300-9f26-4178-ba34-2, Tilburg University, School of Economics and Management.
    3. Rajdeep Grewal & Joseph A. Cote & Hans Baumgartner, 2004. "Multicollinearity and Measurement Error in Structural Equation Models: Implications for Theory Testing," Marketing Science, INFORMS, vol. 23(4), pages 519-529, June.
    4. Farrell, Andrew M., 2010. "Insufficient discriminant validity: A comment on Bove, Pervan, Beatty, and Shiu (2009)," Journal of Business Research, Elsevier, vol. 63(3), pages 324-327, March.
    5. K. Jöreskog, 1971. "Simultaneous factor analysis in several populations," Psychometrika, Springer;The Psychometric Society, vol. 36(4), pages 409-426, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franke, George R. & Sarstedt, Marko & Danks, Nicholas P., 2021. "Assessing measure congruence in nomological networks," Journal of Business Research, Elsevier, vol. 130(C), pages 318-334.
    2. Shiu, Edward & Pervan, Simon J. & Bove, Liliana L. & Beatty, Sharon E., 2011. "Reflections on discriminant validity: Reexamining the Bove et al. (2009) findings," Journal of Business Research, Elsevier, vol. 64(5), pages 497-500, May.
    3. Dacko, Scott G. & Spalteholz, Carolin, 2014. "Upgrading the city: Enabling intermodal travel behaviour," Technological Forecasting and Social Change, Elsevier, vol. 89(C), pages 222-235.
    4. Mahabubur Rahman & M. Ángeles Rodríguez-Serrano & Mary Lambkin, 2019. "Brand equity and firm performance: the complementary role of corporate social responsibility," Journal of Brand Management, Palgrave Macmillan, vol. 26(6), pages 691-704, November.
    5. K. Jöreskog, 1971. "Statistical analysis of sets of congeneric tests," Psychometrika, Springer;The Psychometric Society, vol. 36(2), pages 109-133, June.
    6. Petra Dickel & Monika Sienknecht & Jacob Hörisch, 2021. "The early bird catches the worm: an empirical analysis of imprinting in social entrepreneurship," Journal of Business Economics, Springer, vol. 91(2), pages 127-150, March.
    7. Vishal K. Gupta & Suman Niranjan & Banu A. Goktan & John Eriskon, 2016. "Individual entrepreneurial orientation role in shaping reactions to new technologies," International Entrepreneurship and Management Journal, Springer, vol. 12(4), pages 935-961, December.
    8. Lee, Ruby P. & Johnson, Jean L. & Grewal, Rajdeep, 2008. "Understanding the antecedents of collateral learning in new product alliances," International Journal of Research in Marketing, Elsevier, vol. 25(3), pages 192-200.
    9. You-Kyung Lee, 2021. "Impacts of Digital Technostress and Digital Technology Self-Efficacy on Fintech Usage Intention of Chinese Gen Z Consumers," Sustainability, MDPI, vol. 13(9), pages 1-15, April.
    10. Kee-Young Kwahk & Byoungsoo Kim, 2017. "Effects of social media on consumers’ purchase decisions: evidence from Taobao," Service Business, Springer;Pan-Pacific Business Association, vol. 11(4), pages 803-829, December.
    11. Horstmann, Felix, 2017. "Measuring the shopper's attitude toward the point of sale display: Scale development and validation," Journal of Retailing and Consumer Services, Elsevier, vol. 36(C), pages 112-123.
    12. Trong Tuan Luu, 2019. "CSR and Customer Value Co-creation Behavior: The Moderation Mechanisms of Servant Leadership and Relationship Marketing Orientation," Journal of Business Ethics, Springer, vol. 155(2), pages 379-398, March.
    13. Jorgensen, Bradley S. & Wilson, Mathew A. & Heberlein, Thomas A., 2001. "Fairness in the contingent valuation of environmental public goods: attitude toward paying for environmental improvements at two levels of scope," Ecological Economics, Elsevier, vol. 36(1), pages 133-148, January.
    14. Mittal, Divya & Agrawal, Shiv Ratan, 2016. "Price transparency reflects assurance and reliability," Journal of Retailing and Consumer Services, Elsevier, vol. 31(C), pages 43-51.
    15. François Lenglet, 2018. "FNS or the Varseek-scale? Proposals for a valid operationalization of neophilia," Post-Print halshs-02402036, HAL.
    16. Nizar Allouch & Arkadi Predtetchinski, 2008. "On the non-emptiness of the fuzzy core," International Journal of Game Theory, Springer;Game Theory Society, vol. 37(2), pages 203-210, June.
    17. Jane, Joan & Lago, Alejandro & Ariño, Africa, 2005. "Measuring the performance of international logistics outsourcing partnerships: A dyadic perspective analysis," IESE Research Papers D/608, IESE Business School.
    18. Waris, Idrees & Hameed, Irfan, 2019. "Using Extended Model of Theory of Planned Behavior to Predict Purchase Intention of Energy Efficient Home Appliances in Pakistan," MPRA Paper 109612, University Library of Munich, Germany.
    19. Nathaniel Boso & Paige S Carter & Jonathan Annan, 2016. "When is brand orientation a useful strategic posture?," Journal of Brand Management, Palgrave Macmillan, vol. 23(4), pages 363-382, July.
    20. Bhattarai, Charan Raj & Kwong, Caleb C.Y. & Tasavori, Misagh, 2019. "Market orientation, market disruptiveness capability and social enterprise performance: An empirical study from the United Kingdom," Journal of Business Research, Elsevier, vol. 96(C), pages 47-60.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joamsc:v:44:y:2016:i:1:d:10.1007_s11747-015-0455-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.