IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v31y2014i3p317-326.html
   My bibliography  Save this article

Meta-analysis selection bias in marketing research

Author

Listed:
  • Eisend, Martin
  • Tarrahi, Farid

Abstract

The tendency of meta-analytic authors to select particular studies is called selection bias. Selection bias can affect the strength of the meta-analytic estimate and the attention that scholars devote to the results. This research is, in effect, a meta-analysis of the effect sizes reported or calculated from 94 meta-analysis studies of various topics in marketing research. The analysis reveals that estimates depend on the publication status of the included studies. The greater the percentage of studies that were published in academic journals vs. non-published studies, the greater is the size of the meta-effects, and the more published studies from leading journals the meta-analysis includes, the stronger the effect size. The meta-analytic effect size is a mediator for the influence of both the ratio of unpublished studies and the ratio of studies from leading journals on the probability of a meta-analysis to be published in a leading journal, which increases the number of citations to a meta-analysis. The findings of this study have several implications for meta-analysts, editors, reviewers and the marketing community on how to conduct and read current and future meta-analysis in marketing research.

Suggested Citation

  • Eisend, Martin & Tarrahi, Farid, 2014. "Meta-analysis selection bias in marketing research," International Journal of Research in Marketing, Elsevier, vol. 31(3), pages 317-326.
    • Handle: RePEc:eee:ijrema:v:31:y:2014:i:3:p:317-326
    DOI: 10.1016/j.ijresmar.2014.03.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167811614000317
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijresmar.2014.03.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paul D Ellis, 2010. "Effect sizes and the interpretation of research results in international business," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 41(9), pages 1581-1588, December.
    2. Jonathan Knight, 2003. "Null and void," Nature, Nature, vol. 422(6932), pages 554-555, April.
    3. Banks, George C. & McDaniel, Michael A., 2011. "The Kryptonite of Evidence-Based I–O Psychology," Industrial and Organizational Psychology, Cambridge University Press, vol. 4(1), pages 40-44, March.
    4. Kremer, Sara T.M. & Bijmolt, Tammo H.A. & Leeflang, Peter S.H. & Wieringa, Jaap E., 2008. "Generalizations on the effectiveness of pharmaceutical promotional expenditures," International Journal of Research in Marketing, Elsevier, vol. 25(4), pages 234-246.
    5. Sue Duval & Richard Tweedie, 2000. "Trim and Fill: A Simple Funnel-Plot–Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis," Biometrics, The International Biometric Society, vol. 56(2), pages 455-463, June.
    6. Leonard M. Lodish & Magid M. Abraham & Jeanne Livelsberger & Beth Lubetkin & Bruce Richardson & Mary Ellen Stevens, 1995. "A Summary of Fifty-Five In-Market Experimental Estimates of the Long-Term Effect of TV Advertising," Marketing Science, INFORMS, vol. 14(3_supplem), pages 133-140.
    7. repec:cup:judgdm:v:6:y:2011:i:8:p:870-881 is not listed on IDEAS
    8. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    9. Peterson, Robert A, 2001. "On the Use of College Students in Social Science Research: Insights from a Second-Order Meta-analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 450-461, December.
    10. Xinshu Zhao & John G. Lynch & Qimei Chen, 2010. "Reconsidering Baron and Kenny: Myths and Truths about Mediation Analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(2), pages 197-206, August.
    11. Marnik G. Dekimpe & Dominique M. Hanssens, 1995. "Empirical Generalizations About Market Evolution and Stationarity," Marketing Science, INFORMS, vol. 14(3_supplem), pages 109-121.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chang, Woojung & Ellinger, Alexander E. & Kim, Kyoungmi (Kate) & Franke, George R., 2016. "Supply chain integration and firm financial performance: A meta-analysis of positional advantage mediation and moderating factors," European Management Journal, Elsevier, vol. 34(3), pages 282-295.
    2. Rik Pieters, 2017. "Meaningful Mediation Analysis: Plausible Causal Inference and Informative Communication," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(3), pages 692-716.
    3. Okazaki, Shintaro & Eisend, Martin & Plangger, Kirk & de Ruyter, Ko & Grewal, Dhruv, 2020. "Understanding the Strategic Consequences of Customer Privacy Concerns: A Meta-Analytic Review," Journal of Retailing, Elsevier, vol. 96(4), pages 458-473.
    4. Mangirdas Morkunas & Elzė Rudienė & Lukas Giriūnas & Laura Daučiūnienė, 2020. "Assessment of Factors Causing Bias in Marketing- Related Publications," Publications, MDPI, vol. 8(4), pages 1-16, October.
    5. Eisend, Martin & Hermann, Erik, 2020. "Sexual orientation and consumption: Why and when do homosexuals and heterosexuals consume differently?," International Journal of Research in Marketing, Elsevier, vol. 37(4), pages 678-696.
    6. Mou, Jian & Benyoucef, Morad, 2021. "Consumer behavior in social commerce: Results from a meta-analysis," Technological Forecasting and Social Change, Elsevier, vol. 167(C).
    7. Wesley James Johnston & Angelina Nhat Hanh Le & Julian Ming-Sung Cheng, 2018. "A meta-analytic review of influence strategies in marketing channel relationships," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 674-702, July.
    8. François A. Carrillat & Renaud Legoux & Allègre L. Hadida, 2018. "Debates and assumptions about motion picture performance: a meta-analysis," Journal of the Academy of Marketing Science, Springer, vol. 46(2), pages 273-299, March.
    9. Arte, Pratik & Larimo, Jorma, 2022. "Moderating influence of product diversification on the international diversification-performance relationship: A meta-analysis," Journal of Business Research, Elsevier, vol. 139(C), pages 1408-1423.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alba Carrillo & María Rubio-Aparicio & Guadalupe Molinari & Ángel Enrique & Julio Sánchez-Meca & Rosa M Baños, 2019. "Effects of the Best Possible Self intervention: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-23, September.
    2. Viktoria Maria Baumeister & Leonie Petra Kuen & Maike Bruckes & Gerhard Schewe, 2021. "The Relationship of Work-Related ICT Use With Well-being, Incorporating the Role of Resources and Demands: A Meta-Analysis," SAGE Open, , vol. 11(4), pages 21582440211, November.
    3. Lianjie Liu & Zhuo Shao & Hang Yu & Wei Zhang & Hao Wang & Zubing Mei, 2020. "Is the platelet to lymphocyte ratio a promising biomarker to distinguish acute appendicitis? Evidence from a systematic review with meta-analysis," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-15, May.
    4. Kim, Yeolib & Kim, Seung Hyun & Peterson, Robert A. & Choi, Jeonghye, 2023. "Privacy concern and its consequences: A meta-analysis," Technological Forecasting and Social Change, Elsevier, vol. 196(C).
    5. Ioana A Cristea & Robin N Kok & Pim Cuijpers, 2016. "The Effectiveness of Cognitive Bias Modification Interventions for Substance Addictions: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-19, September.
    6. Je-Young Lee & Minkyung Baek, 2023. "Effects of Gamification on Students’ English Language Proficiency: A Meta-Analysis on Research in South Korea," Sustainability, MDPI, vol. 15(14), pages 1-19, July.
    7. Martin Polak & Norbert Tanzer & Per Carlbring, 2022. "PROTOCOL: Effects of virtual reality exposure therapy versus in vivo exposure in treating social anxiety disorder in adults: A systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(3), September.
    8. Muthanna Samara & Bruna Da Silva Nascimento & Aiman El-Asam & Sara Hammuda & Nabil Khattab, 2021. "How Can Bullying Victimisation Lead to Lower Academic Achievement? A Systematic Review and Meta-Analysis of the Mediating Role of Cognitive-Motivational Factors," IJERPH, MDPI, vol. 18(5), pages 1-21, February.
    9. Zhao-Feng Chen & Lufei Young & Chong Ho Yu & S. Pamela K. Shiao, 2018. "A Meta-Prediction of Methylenetetrahydrofolate-Reductase Polymorphisms and Air Pollution Increased the Risk of Ischemic Heart Diseases Worldwide," IJERPH, MDPI, vol. 15(7), pages 1-16, July.
    10. Chun-Yu Chang & Po-Chen Lin & Yung-Jiun Chien & Chien-Sheng Chen & Meng-Yu Wu, 2020. "Analysis of Chest-Compression Depth and Full Recoil in Two Infant Chest-Compression Techniques Performed by a Single Rescuer: Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 17(11), pages 1-17, June.
    11. Nawel Ayadi & Alexandre Lapeyre, 2016. "Consumer purchase intentions for green products: Mediating role of WTP and moderating effects of framing," Post-Print hal-03829732, HAL.
    12. Mohith M. Varma & Shengzi Zeng & Laura Singh & Emily A. Holmes & Jingyun Huang & Man Hey Chiu & Xiaoqing Hu, 2024. "A systematic review and meta-analysis of experimental methods for modulating intrusive memories following lab-analogue trauma exposure in non-clinical populations," Nature Human Behaviour, Nature, vol. 8(10), pages 1968-1987, October.
    13. Woodley of Menie, Michael A. & Peñaherrera-Aguirre, Mateo & Sarraf, Matthew A., 2022. "Signs of a Flynn effect in rodents? Secular differentiation of the manifold of general cognitive ability in laboratory mice (Mus musculus) and Norwegian rats (Rattus norvegicus) over a century—Results," Intelligence, Elsevier, vol. 95(C).
    14. Teresa Del Giudice & Carla Cavallo & Francesco Caracciolo & Gianni Cicia, 2015. "What attributes of extra virgin olive oil are really important for consumers: a meta-analysis of consumers’ stated preferences," Agricultural and Food Economics, Springer;Italian Society of Agricultural Economics (SIDEA), vol. 3(1), pages 1-15, December.
    15. Beaulieu, Myriam & Tremblay, Joël & Baudry, Claire & Pearson, Jessica & Bertrand, Karine, 2021. "A systematic review and meta-analysis of the efficacy of the long-term treatment and support of substance use disorders," Social Science & Medicine, Elsevier, vol. 285(C).
    16. Gijsenberg, Maarten J., 2014. "Going for gold: Investigating the (non)sense of increased advertising around major sports events," International Journal of Research in Marketing, Elsevier, vol. 31(1), pages 2-15.
    17. Se Young Kim & Mi-Kyoung Cho, 2022. "The Effect of Nurse Support Programs on Job Satisfaction and Organizational Behaviors among Hospital Nurses: A Meta-Analysis," IJERPH, MDPI, vol. 19(24), pages 1-23, December.
    18. Trood, Michael D. & Spivak, Benjamin L. & Ogloff, James R.P., 2021. "A systematic review and meta-analysis of the effects of judicial supervision on recidivism and well-being factors of criminal offenders," Journal of Criminal Justice, Elsevier, vol. 74(C).
    19. Dhruv Grewal & Nancy Puccinelli & Kent B. Monroe, 2018. "Meta-analysis: integrating accumulated knowledge," Journal of the Academy of Marketing Science, Springer, vol. 46(1), pages 9-30, January.
    20. Sergio Nolazco & Kaspar Delhey & Shinichi Nakagawa & Anne Peters, 2022. "Ornaments are equally informative in male and female birds," Nature Communications, Nature, vol. 13(1), pages 1-10, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:31:y:2014:i:3:p:317-326. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.