IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/cs4vy.html
   My bibliography  Save this paper

Bulletproof Bias? Considering the Type of Data in Common Proportion of Variance Effect Sizes

Author

Listed:
  • Buchanan, Erin Michelle

    (Harrisburg University of Science and Technology)

  • Scofield, John E.

Abstract

As effect sizes gain ground as important indicators of practical significance and as a meta-analytic tool, we must critically understand their limitations and biases. This project expands on research by @Okada2013, which highlighted the positive bias of eta squared and suggested the use of omega squared or epsilon for their lack of bias. These variance overlap measures were examined for potential bias in different data scenarios (i.e. truncated and Likert type data) to elucidate differences in bias from previous research. We found that data precision and truncation affected effect size bias, often lowering the bias in eta squared. This work expands our understanding of bias on variance overlap measures and allows researchers to make an informed choice about the type of effect to report given their research study. Implications for sample size planning and power are also discussed.

Suggested Citation

  • Buchanan, Erin Michelle & Scofield, John E., 2017. "Bulletproof Bias? Considering the Type of Data in Common Proportion of Variance Effect Sizes," OSF Preprints cs4vy, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:cs4vy
    DOI: 10.31219/osf.io/cs4vy
    as

    Download full text from publisher

    File URL: https://osf.io/download/599f3a566c613b0251368d6a/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/cs4vy?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fern, Edward F & Monroe, Kent B, 1996. "Effect-Size Estimates: Issues and Problems in Interpretation," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 23(2), pages 89-105, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohamed M. Mostafa, 2008. "Through the Eye of a Child," Global Business Review, International Management Institute, vol. 9(2), pages 243-255, August.
    2. Mourali, Mehdi & Yang, Zhiyong & Pons, Frank & Hassay, Derek, 2018. "Consumer power and choice deferral: The role of anticipated regret," International Journal of Research in Marketing, Elsevier, vol. 35(1), pages 81-99.
    3. Dutta, Sujay & Pullig, Chris, 2015. "A commentary on reporting effect size and confidence intervals: Response to Palmer and Strelan (2014)," Journal of Business Research, Elsevier, vol. 68(5), pages 1082-1085.
    4. Lehmann, Donald R., 2003. "Finding important findings," Journal of Business Research, Elsevier, vol. 56(1), pages 89-90, January.
    5. Fernando Oliveira Santini & Wagner Junior Ladeira & Claudio Hoffmann Sampaio & Diego Costa Pinto, 2018. "The brand experience extended model: a meta-analysis," Journal of Brand Management, Palgrave Macmillan, vol. 25(6), pages 519-535, November.
    6. Verlegh, Peeter W. J. & Steenkamp, Jan-Benedict E. M., 1999. "A review and meta-analysis of country-of-origin research," Journal of Economic Psychology, Elsevier, vol. 20(5), pages 521-546, October.
    7. Xia, Lan & Kukar-Kinney, Monika & Monroe, Kent B., 2010. "Effects of Consumers’ Efforts on Price and Promotion Fairness Perceptions," Journal of Retailing, Elsevier, vol. 86(1), pages 1-10.
    8. Freling, Traci H. & Yang, Zhiyong & Saini, Ritesh & Itani, Omar S. & Rashad Abualsamh, Ryan, 2020. "When poignant stories outweigh cold hard facts: A meta-analysis of the anecdotal bias," Organizational Behavior and Human Decision Processes, Elsevier, vol. 160(C), pages 51-67.
    9. García-Meca, Emma & Sánchez-Ballesta, Juan Pedro, 2006. "Influences on financial analyst forecast errors: A meta-analysis," International Business Review, Elsevier, vol. 15(1), pages 29-52, February.
    10. Hofmann, Julian & Clement, Michel & Völckner, Franziska & Hennig-Thurau, Thorsten, 2017. "Empirical generalizations on the impact of stars on the economic success of movies," International Journal of Research in Marketing, Elsevier, vol. 34(2), pages 442-461.
    11. Velasco, Franklin & Yang, Zhiyong & Janakiraman, Narayanan, 2021. "A meta-analytic investigation of consumer response to anthropomorphic appeals: The roles of product type and uncertainty avoidance," Journal of Business Research, Elsevier, vol. 131(C), pages 735-746.
    12. Capella, Michael L. & Webster, Cynthia & Kinard, Brian R., 2011. "A review of the effect of cigarette advertising," International Journal of Research in Marketing, Elsevier, vol. 28(3), pages 269-279.
    13. Dressler, William W. & Balieiro, Mauro C. & Ribeiro, Rosane P. & Ernesto Dos Santos, José, 2005. "Cultural consonance and arterial blood pressure in urban Brazil," Social Science & Medicine, Elsevier, vol. 61(3), pages 527-540, August.
    14. Simona Romani & Giacomo Gistri & Stefano Pace, 2012. "When counterfeits raise the appeal of luxury brands," Marketing Letters, Springer, vol. 23(3), pages 807-824, September.
    15. Hans H. Bauer & Ralf Mäder & Sandra-Nadine Wagner, 2006. "Übereinstimmung von Marken- und Konsumentenpersönlichkeit als Determinante des Kaufverhaltens — Eine Metaanalyse der Selbstkongruenzforschung," Schmalenbach Journal of Business Research, Springer, vol. 58(7), pages 838-863, November.
    16. Dhruv Grewal & Nancy Puccinelli & Kent B. Monroe, 2018. "Meta-analysis: integrating accumulated knowledge," Journal of the Academy of Marketing Science, Springer, vol. 46(1), pages 9-30, January.
    17. Bitencourt, Claudia Cristina & de Oliveira Santini, Fernando & Ladeira, Wagner Junior & Santos, Ana Clarissa & Teixeira, Eduardo Kunzel, 2020. "The extended dynamic capabilities model: A meta-analysis," European Management Journal, Elsevier, vol. 38(1), pages 108-120.
    18. Oduro, Stephen & De Nisco, Alessandro & Mainolfi, Giada, 2023. "Do digital technologies pay off? A meta-analytic review of the digital technologies/firm performance nexus," Technovation, Elsevier, vol. 128(C).
    19. Hans H. Bauer & Marc Fischer & Yvonne McInturff, 1999. "Der Bildkommunikationseffekt — eine Metaanalyse," Schmalenbach Journal of Business Research, Springer, vol. 51(9), pages 805-831, September.
    20. Saha, Sajeeb & Ranjan, Kumar Rakesh & Pappu, Ravi & Akhlaghpour, Saeed, 2023. "Corporate giving and its impact on consumer evaluations: A meta-analysis," Journal of Business Research, Elsevier, vol. 158(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:cs4vy. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.