IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v67y2014i5p1035-1041.html
   My bibliography  Save this article

Convenience samples of college students and research reproducibility

Author

Listed:
  • Peterson, Robert A.
  • Merunka, Dwight R.

Abstract

Tests of theory in marketing and consumer behavior research are frequently based on convenience samples of undergraduate college students. In a study of business-related ethicality, analysis of data from four dozen convenience samples of undergraduate business students revealed significant differences in means, variances, intercorrelations, and path parameters across the samples. Depending on the particular convenience sample used, relationships between variables and constructs were positive or negative and statistically significant or insignificant. The present research empirically documents, for the first time, the uncertainty created by using convenience samples of college students as research subjects. Only through empirical replications can researchers pragmatically assess the reliability, validity, and generalizability of research findings.

Suggested Citation

  • Peterson, Robert A. & Merunka, Dwight R., 2014. "Convenience samples of college students and research reproducibility," Journal of Business Research, Elsevier, vol. 67(5), pages 1035-1041.
    • Handle: RePEc:eee:jbrese:v:67:y:2014:i:5:p:1035-1041
    DOI: 10.1016/j.jbusres.2013.08.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S014829631300307X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2013.08.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    2. Lynch, John G, Jr, 1982. "On the External Validity of Experiments in Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 9(3), pages 225-239, December.
    3. Park, Cheol & Lee, Thae Min, 2009. "Information direction, website reputation and eWOM effect: A moderating role of product type," Journal of Business Research, Elsevier, vol. 62(1), pages 61-67, January.
    4. Raman, Kalyan, 1994. "Inductive Inference and Replications: A Bayesian Perspective," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(4), pages 633-643, March.
    5. Wells, William D, 1993. "Discovery-Oriented Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 19(4), pages 489-504, March.
    6. Lynch, John G, Jr, 1983. "The Role of External Validity in Theoretical Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 10(1), pages 109-111, June.
    7. Daniel Bello & Kwok Leung & Lee Radebaugh & Rosalie L Tung & Arjen van Witteloostuijn, 2009. "From the Editors: Student samples in international business research," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 40(3), pages 361-364, April.
    8. Calder, Bobby J & Philips, Lynn W & Tybout, Alice M, 1983. "Beyond External Validity," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 10(1), pages 112-124, June.
    9. Calder, Bobby J & Phillips, Lynn W & Tybout, Alice M, 1982. "The Concept of External Validity," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 9(3), pages 240-244, December.
    10. Calder, Bobby J & Phillips, Lynn W & Tybout, Alice M, 1981. "Designing Research for Application," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 8(2), pages 197-207, September.
    11. Ashok K. Lalwani, 2009. "The Distinct Influence of Cognitive Busyness and Need for Closure on Cultural Differences in Socially Desirable Responding," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 36(2), pages 305-316.
    12. Ferber, Robert, 1977. "Research by Convenience," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 4(1), pages 57-58, June.
    13. Evanschitzky, Heiner & Baumgarth, Carsten & Hubbard, Raymond & Armstrong, J. Scott, 2007. "Replication research's disturbing trend," Journal of Business Research, Elsevier, vol. 60(4), pages 411-415, April.
    14. Easley, Richard W. & Madden, Charles S. & Dunn, Mark G., 2000. "Conducting Marketing Science: The Role of Replication in the Research Process," Journal of Business Research, Elsevier, vol. 48(1), pages 83-92, April.
    15. Peterson, Robert A, 2001. "On the Use of College Students in Social Science Research: Insights from a Second-Order Meta-analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 450-461, December.
    16. Nabil Ibrahim & Donald Howard & John Angelidis, 2008. "The Relationship between Religiousness and Corporate Social Responsibility Orientation: Are there Differences Between Business Managers and Students?," Journal of Business Ethics, Springer, vol. 78(1), pages 165-174, March.
    17. Tenenhaus, Michel & Vinzi, Vincenzo Esposito & Chatelin, Yves-Marie & Lauro, Carlo, 2005. "PLS path modeling," Computational Statistics & Data Analysis, Elsevier, vol. 48(1), pages 159-205, January.
    18. Yagci, Mehmet I. & Biswas, Abhijit & Dutta, Sujay, 2009. "Effects of comparative advertising format on consumer responses: The moderating effects of brand image and attribute relevance," Journal of Business Research, Elsevier, vol. 62(8), pages 768-774, August.
    19. Hong Wong, 2008. "Religiousness, Love of Money, and Ethical Attitudes of Malaysian Evangelical Christians in Business," Journal of Business Ethics, Springer, vol. 81(1), pages 169-191, August.
    20. Megehee, Carol M., 2009. "Advertising time expansion, compression, and cognitive processing influences on consumer acceptance of message and brand," Journal of Business Research, Elsevier, vol. 62(4), pages 420-431, April.
    21. Mikhailitchenko, Andrey & Javalgi, Rajshekhar (Raj) G. & Mikhailitchenko, Galina & Laroche, Michel, 2009. "Cross-cultural advertising communication: Visual imagery, brand familiarity, and brand recall," Journal of Business Research, Elsevier, vol. 62(10), pages 931-938, October.
    22. Wells, William D, 2001. "The Perils of N = 1," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 494-498, December.
    23. Yuksel, Ulku & Mryteza, Victoria, 2009. "An evaluation of strategic responses to consumer boycotts," Journal of Business Research, Elsevier, vol. 62(2), pages 248-259, February.
    24. Ashok Lalwani, 2009. "The Distinct Influence of Cognitive Busyness and Need for Closure on Cultural Differences in Socially Desirable Responding," Working Papers 0061, College of Business, University of Texas at San Antonio.
    25. Hunter, John E, 2001. "The Desperate Need for Replications," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 149-158, June.
    26. Strizhakova, Yuliya & Coulter, Robin A. & Price, Linda L., 2008. "The meanings of branded products: A cross-national scale development and meaning assessment," International Journal of Research in Marketing, Elsevier, vol. 25(2), pages 82-93.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Trafimow, David & Hyman, Michael R. & Kostyk, Alena, 2020. "The (im)precision of scholarly consumer behavior research," Journal of Business Research, Elsevier, vol. 114(C), pages 93-101.
    2. Marcel Lichters & Marko Sarstedt & Bodo Vogt, 2015. "On the practical relevance of the attraction effect: A cautionary note and guidelines for context effect experiments," AMS Review, Springer;Academy of Marketing Science, vol. 5(1), pages 1-19, June.
    3. McQuarrie, Edward F., 2004. "Integration of construct and external validity by means of proximal similarity:: Implications for laboratory experiments in marketing," Journal of Business Research, Elsevier, vol. 57(2), pages 142-153, February.
    4. Marcel Lichters & Marko Sarstedt & Bodo Vogt, 2015. "On the practical relevance of the attraction effect: A cautionary note and guidelines for context effect experiments," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 5(1), pages 1-19, June.
    5. Francisco J. Conejo & Lawrence F. Cunningham & Clifford E. Young, 2020. "Revisiting the Brand Luxury Index: new empirical evidence and future directions," Journal of Brand Management, Palgrave Macmillan, vol. 27(1), pages 108-122, January.
    6. Georg Wübker, 1999. "Sonderangebotspolitik und Preisbündelung," Schmalenbach Journal of Business Research, Springer, vol. 51(7), pages 693-713, July.
    7. Easley, Richard W. & Madden, Charles S. & Dunn, Mark G., 2000. "Conducting Marketing Science: The Role of Replication in the Research Process," Journal of Business Research, Elsevier, vol. 48(1), pages 83-92, April.
    8. Hubbard, Raymond & Lindsay, R. Murray, 2013. "From significant difference to significant sameness: Proposing a paradigm shift in business research," Journal of Business Research, Elsevier, vol. 66(9), pages 1377-1388.
    9. Paswan, Audhesh K. & Dant, Rajiv P. & Lumpkin, James R., 1998. "An Empirical Investigation of the Linkages among Relationalism, Environmental Uncertainty, and Bureaucratization," Journal of Business Research, Elsevier, vol. 43(3), pages 125-140, November.
    10. Roggeveen, Anne L. & Nordfält, Jens & Grewal, Dhruv, 2016. "Do Digital Displays Enhance Sales? Role of Retail Format and Message Content," Journal of Retailing, Elsevier, vol. 92(1), pages 122-131.
    11. Sebastian Lehmann, 2014. "Toward an Understanding of the BDM: Predictive Validity, Gambling Effects, and Risk Attitude," FEMM Working Papers 150001, Otto-von-Guericke University Magdeburg, Faculty of Economics and Management.
    12. Pillai, Kishore Gopalakrishna & Goldsmith, Ronald E., 2008. "How brand attribute typicality and consumer commitment moderate the influence of comparative advertising," Journal of Business Research, Elsevier, vol. 61(9), pages 933-941, September.
    13. Klenosky, David B. & Benet, Suzeanne B. & Chadraba, Petr, 1996. "Assessing Czech consumers' reactions to western marketing practices: A conjoint approach," Journal of Business Research, Elsevier, vol. 36(2), pages 189-198, June.
    14. Evanschitzky, Heiner & Baumgarth, Carsten & Hubbard, Raymond & Armstrong, J. Scott, 2007. "Replication research's disturbing trend," Journal of Business Research, Elsevier, vol. 60(4), pages 411-415, April.
    15. Bobby J. Calder & Alice M. Tybout, 2016. "What makes a good theory practical?," AMS Review, Springer;Academy of Marketing Science, vol. 6(3), pages 116-124, December.
    16. Lorenz Graf-Vlachy, 2019. "Like student like manager? Using student subjects in managerial debiasing research," Review of Managerial Science, Springer, vol. 13(2), pages 347-376, April.
    17. Evanschitzky, Heiner & Armstrong, J. Scott, 2013. "Research with In-built replications: Comment and further suggestions for replication research," Journal of Business Research, Elsevier, vol. 66(9), pages 1406-1408.
    18. Espinosa, Jennifer A. & Ortinau, David J., 2016. "Debunking legendary beliefs about student samples in marketing research," Journal of Business Research, Elsevier, vol. 69(8), pages 3149-3158.
    19. repec:dau:papers:123456789/4248 is not listed on IDEAS
    20. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    21. Ashish Arora & Michelle Gittelman & Sarah Kaplan & John Lynch & Will Mitchell & Nicolaj Siggelkow & Aaron K. Chatterji & Michael Findley & Nathan M. Jensen & Stephan Meier & Daniel Nielson, 2016. "Field experiments in strategy research," Strategic Management Journal, Wiley Blackwell, vol. 37(1), pages 116-132, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:67:y:2014:i:5:p:1035-1041. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.