IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v151y2022icp579-592.html
   My bibliography  Save this article

Are small measures big problems? A meta-analytic investigation of brief measures of the Big Five

Author

Listed:
  • Ellen, B. Parker
  • Mackey, Jeremy D.
  • McAllister, Charn P.
  • Mercer, Ian S.

Abstract

Pressures to maximize survey space or mitigate respondent fatigue can lead researchers to employ abbreviated during data collection. This is problematic because short-form measures can suffer from reduced reliability and validity. Thus, we conducted a meta-analysis to determine whether the use of brief measures of the Big Five in business research tends to produce psychometrically sound and criterion-valid results. We compared scale internal consistencies and effect size estimates from our study with meta-analytic estimates for long measures of the Big Five, as established in the literature. Our results indicated that, in general, internal consistency estimates were not substantively different. However, the criterion-related validity comparisons indicated that several point estimates for individual measures did not fall within the credibility intervals obtained from prior meta-analyses. This suggests that although brief measures of the Big Five might appear acceptable for use in business research, caution should be exercised when choosing a brief measure.

Suggested Citation

  • Ellen, B. Parker & Mackey, Jeremy D. & McAllister, Charn P. & Mercer, Ian S., 2022. "Are small measures big problems? A meta-analytic investigation of brief measures of the Big Five," Journal of Business Research, Elsevier, vol. 151(C), pages 579-592.
    • Handle: RePEc:eee:jbrese:v:151:y:2022:i:c:p:579-592
    DOI: 10.1016/j.jbusres.2022.07.027
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296322006324
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2022.07.027?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lindsey M. Greco & Ernest H. O'Boyle & Bethany S. Cockburn & Zhenyu Yuan, 2018. "Meta†Analysis of Coefficient Alpha: A Reliability Generalization Study," Journal of Management Studies, Wiley Blackwell, vol. 55(4), pages 583-618, June.
    2. Nikos Bozionelos & Giorgos Bozionelos & Panagiotis Polychroniou & Konstantinos Kostopouplos, 2014. "Mentoring receipt and personality: Evidence for non-linear relationships," Post-Print hal-00911043, HAL.
    3. Snyder, Hannah, 2019. "Literature review as a research methodology: An overview and guidelines," Journal of Business Research, Elsevier, vol. 104(C), pages 333-339.
    4. Charles Mosier, 1943. "On the reliability of a weighted composite," Psychometrika, Springer;The Psychometric Society, vol. 8(3), pages 161-168, September.
    5. Mackey, Jeremy D., 2021. "Why and how predators pick prey: Followers’ personality and performance as predictors of destructive leadership," Journal of Business Research, Elsevier, vol. 130(C), pages 159-169.
    6. Bozionelos, Nikos & Bozionelos, Giorgos & Polychroniou, Panagiotis & Kostopoulos, Kostantinos, 2014. "Mentoring receipt and personality: Evidence for non-linear relationships," Journal of Business Research, Elsevier, vol. 67(2), pages 171-181.
    7. James G. Combs & T. Russell Crook & Andreas Rauch, 2019. "Meta‐Analytic Research in Management: Contemporary Approaches, Unresolved Controversies, and Rising Standards," Journal of Management Studies, Wiley Blackwell, vol. 56(1), pages 1-18, January.
    8. Daly, Timothy M. & Nataraajan, Rajan, 2015. "Swapping bricks for clicks: Crowdsourcing longitudinal data on Amazon Turk," Journal of Business Research, Elsevier, vol. 68(12), pages 2603-2609.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mackey, Jeremy D. & Parker Ellen, B. & McAllister, Charn P. & Alexander, Katherine C., 2021. "The dark side of leadership: A systematic literature review and meta-analysis of destructive leadership research," Journal of Business Research, Elsevier, vol. 132(C), pages 705-718.
    2. Mackey, Jeremy D., 2022. "The effect of cultural values on the strength of the relationship between interpersonal and organizational workplace deviance," Journal of Business Research, Elsevier, vol. 149(C), pages 760-771.
    3. Soumaya Meddeb & Étienne St-Jean & Andreas Rauch, 2024. "The interaction of narcissism, agreeableness and conscientiousness in entrepreneurial mentoring: Implications for learning outcomes," Post-Print hal-04701307, HAL.
    4. Sandra Castro‐González & Belén Bande & Takuma Kimura, 2019. "How and when corporate social responsibility affects salespeople's organizational citizenship behaviors?: The moderating role of ethics and justice," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 26(3), pages 548-558, May.
    5. Jiaying Liu & Tao Tang & Xiangjie Kong & Amr Tolba & Zafer AL-Makhadmeh & Feng Xia, 2018. "Understanding the advisor–advisee relationship via scholarly data analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 161-180, July.
    6. Yin Ma & Shih-Chih Chen & Athapol Ruangkanjanases, 2021. "Understanding the Antecedents and Consequences of Green Human Capital," SAGE Open, , vol. 11(1), pages 21582440209, February.
    7. Alexander Flaig & Daniel Kindström & Mikael Ottosson, 2021. "Market-shaping phases—a qualitative meta-analysis and conceptual framework," AMS Review, Springer;Academy of Marketing Science, vol. 11(3), pages 354-374, December.
    8. Mackey, Jeremy D., 2021. "Why and how predators pick prey: Followers’ personality and performance as predictors of destructive leadership," Journal of Business Research, Elsevier, vol. 130(C), pages 159-169.
    9. Ali Zackery & Joseph Amankwah-Amoah & Zahra Heidari Darani & Shiva Ghasemi, 2022. "COVID-19 Research in Business and Management: A Review and Future Research Agenda," Sustainability, MDPI, vol. 14(16), pages 1-32, August.
    10. Eusebius Pantja Pramudya & Lukas Rumboko Wibowo & Fitri Nurfatriani & Iman Kasiman Nawireja & Dewi Ratna Kurniasari & Sakti Hutabarat & Yohanes Berenika Kadarusman & Ananda Oemi Iswardhani & Rukaiyah , 2022. "Incentives for Palm Oil Smallholders in Mandatory Certification in Indonesia," Land, MDPI, vol. 11(4), pages 1-28, April.
    11. Peter Schnell & Phillip Haag & Hans Christian Jünger, 2022. "Implementation of Digital Technologies in Construction Companies: Establishing a Holistic Process which Addresses Current Barriers," Businesses, MDPI, vol. 3(1), pages 1-18, December.
    12. Chen, Yanyan & Mandler, Timo & Meyer-Waarden, Lars, 2021. "Three decades of research on loyalty programs: A literature review and future research agenda," Journal of Business Research, Elsevier, vol. 124(C), pages 179-197.
    13. Hongxia Jin & Lu Lu & Haojun Fan, 2022. "Global Trends and Research Hotspots in Long COVID: A Bibliometric Analysis," IJERPH, MDPI, vol. 19(6), pages 1-14, March.
    14. Prince Donkor Ameyaw & Walter Timo de Vries, 2020. "Transparency of Land Administration and the Role of Blockchain Technology, a Four-Dimensional Framework Analysis from the Ghanaian Land Perspective," Land, MDPI, vol. 9(12), pages 1-25, December.
    15. Xie, Junyi & Ifie, Kemefasu & Gruber, Thorsten, 2022. "The dual threat of COVID-19 to health and job security – Exploring the role of mindfulness in sustaining frontline employee-related outcomes," Journal of Business Research, Elsevier, vol. 146(C), pages 216-227.
    16. Ginder, Whitney & Byun, Sang-Eun, 2022. "To trust or not to trust? The interplay between labor-related CSR claim type and prior CSR reputation of apparel retailers," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    17. Amal Almansour & Reem Alotaibi & Hajar Alharbi, 2022. "Text-rating review discrepancy (TRRD): an integrative review and implications for research," Future Business Journal, Springer, vol. 8(1), pages 1-15, December.
    18. Švarc, Jadranka & Dabić, Marina, 2021. "Transformative innovation policy or how to escape peripheral policy paradox in European research peripheral countries," Technology in Society, Elsevier, vol. 67(C).
    19. So, Hau Wing & Lafortezza, Raffaele, 2022. "Reviewing the impacts of eco-labelling of forest products on different dimensions of sustainability in Europe," Forest Policy and Economics, Elsevier, vol. 145(C).
    20. Mónica de Castro-Pardo & Pascual Fernández Martínez & Amelia Pérez Zabaleta & João C. Azevedo, 2021. "Dealing with Water Conflicts: A Comprehensive Review of MCDM Approaches to Manage Freshwater Ecosystem Services," Land, MDPI, vol. 10(5), pages 1-32, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:151:y:2022:i:c:p:579-592. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.