IDEAS home Printed from https://ideas.repec.org/a/bla/jomstd/v48y2011i1p178-197.html
   My bibliography  Save this article

Assessing Cumulative Evidence within ‘Macro’ Research: Why Meta‐Analysis Should be Preferred Over Vote Counting

Author

Listed:
  • James G. Combs
  • David J. Ketchen, Jr
  • T. Russell Crook
  • Philip L. Roth

Abstract

Understanding the conclusions a body of evidence offers involves accumulating findings. Two recent articles used vote counting to assess the evidence related to important macro theories: transaction cost theory and resource-based theory. Each concluded that its focal theory is not well supported. In contrast, recent meta‐analyses of the same theories concluded that both are strongly supported. We explain why macro researchers should trust the findings of meta‐analyses but not those of vote counts. A direct implication is that researchers interested in advancing transaction cost and resource‐based theories need to build upon the meta‐analytic evidence. A broader implication is that, as the preferred method for accumulating evidence, meta‐analysis can be a catalyst for the re‐evaluation of established theories and the development of new theory.

Suggested Citation

  • James G. Combs & David J. Ketchen, Jr & T. Russell Crook & Philip L. Roth, 2011. "Assessing Cumulative Evidence within ‘Macro’ Research: Why Meta‐Analysis Should be Preferred Over Vote Counting," Journal of Management Studies, Wiley Blackwell, vol. 48(1), pages 178-197, January.
    • Handle: RePEc:bla:jomstd:v:48:y:2011:i:1:p:178-197
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/j.1467-6486.2009.00899.x
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kimberly A. Eddleston & Franz Willi Kellermanns & Ravi Sarathy, 2008. "Resource Configuration in Family Firms: Linking Resources, Strategic Planning and Technological Opportunities to Performance," Journal of Management Studies, Wiley Blackwell, vol. 45(1), pages 26-50, January.
    2. Ricky Y. K. Chan, 2005. "Does the Natural‐Resource‐Based View of the Firm Apply in an Emerging Economy? A Survey of Foreign Invested Enterprises in China," Journal of Management Studies, Wiley Blackwell, vol. 42(3), pages 625-672, May.
    3. James G. Combs & David J. Ketchen & Alexa A. Perryman & Maura S. Donahue, 2007. "The Moderating Effect of CEO Power on the Board Composition–Firm Performance Relationship," Journal of Management Studies, Wiley Blackwell, vol. 44(8), pages 1299-1323, December.
    4. Raj Echambadi & Benjamin Campbell & Rajshree Agarwal, 2006. "Encouraging Best Practice in Quantitative Management Research: An Incomplete List of Opportunities," Journal of Management Studies, Wiley Blackwell, vol. 43(8), pages 1801-1820, December.
    5. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    6. Michel Lander & Pursey Heugens, 2009. "Structure! Agency! (And Other Quarrels): Meta-Analyzing Institutional Theories of Organization," Post-Print hal-00623835, HAL.
    7. Scott L. Newbert, 2007. "Empirical research on the resource‐based view of the firm: an assessment and suggestions for future research," Strategic Management Journal, Wiley Blackwell, vol. 28(2), pages 121-146, February.
    8. Sonali K. Shah & Kevin G. Corley, 2006. "Building Better Theory by Bridging the Quantitative–Qualitative Divide," Journal of Management Studies, Wiley Blackwell, vol. 43(8), pages 1821-1835, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stam, Wouter & Arzlanian, Souren & Elfring, Tom, 2014. "Social capital of entrepreneurs and small firm performance: A meta-analysis of contextual and methodological moderators," Journal of Business Venturing, Elsevier, vol. 29(1), pages 152-173.
    2. Tao Bai & Jialin Du & Angelo M. Solarino, 2018. "Performance of foreign subsidiaries “in” and “from” Asia: A review, synthesis and research agenda," Asia Pacific Journal of Management, Springer, vol. 35(3), pages 607-638, September.
    3. Patrick Velte & Martin Stawinoga, 2020. "Do chief sustainability officers and CSR committees influence CSR-related outcomes? A structured literature review based on empirical-quantitative research findings," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 31(4), pages 333-377, December.
    4. Frederik Plewnia & Edeltraud Guenther, 2017. "The benefits of doing good: a meta-analysis of corporate philanthropy business outcomes and its implications for management control," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 28(3), pages 347-376, October.
    5. Jan Endrikat, 2016. "Market Reactions to Corporate Environmental Performance Related Events: A Meta-analytic Consolidation of the Empirical Evidence," Journal of Business Ethics, Springer, vol. 138(3), pages 535-548, October.
    6. Hamad, Rita & Elser, Holly & Tran, Duy C. & Rehkopf, David H. & Goodman, Steven N., 2018. "How and why studies disagree about the effects of education on health: A systematic review and meta-analysis of studies of compulsory schooling laws," Social Science & Medicine, Elsevier, vol. 212(C), pages 168-178.
    7. Donthu, Naveen & Kumar, Satish & Mukherjee, Debmalya & Pandey, Nitesh & Lim, Weng Marc, 2021. "How to conduct a bibliometric analysis: An overview and guidelines," Journal of Business Research, Elsevier, vol. 133(C), pages 285-296.
    8. Oduro, Stephen & De Nisco, Alessandro & Mainolfi, Giada, 2023. "Do digital technologies pay off? A meta-analytic review of the digital technologies/firm performance nexus," Technovation, Elsevier, vol. 128(C).
    9. Patricio Duran & Nadine Kammerlander & Marc van Essen & Thomas Zellweger, 2016. "Doing More with Less : Innovation Input and Output in Family Firms," Post-Print hal-02276703, HAL.
    10. Donald D. Bergh & Herman Aguinis & Ciaran Heavey & David J. Ketchen & Brian K. Boyd & Peiran Su & Cubie L. L. Lau & Harry Joo, 2016. "Using meta-analytic structural equation modeling to advance strategic management research: Guidelines and an empirical illustration via the strategic leadership-performance relationship," Strategic Management Journal, Wiley Blackwell, vol. 37(3), pages 477-497, March.
    11. Devkar, Ganesh A. & Mahalingam, Ashwin & Deep, Akash & Thillairajan, A., 2013. "Impact of Private Sector Participation on access and quality in provision of electricity, telecom and water services in developing countries: A systematic review," Utilities Policy, Elsevier, vol. 27(C), pages 65-81.
    12. Clovia Hamilton & Simon P. Philbin, 2020. "Knowledge Based View of University Tech Transfer—A Systematic Literature Review and Meta-Analysis," Administrative Sciences, MDPI, vol. 10(3), pages 1-28, September.
    13. Marc van Essen & J. (Hans) van Oosterhout & Pursey P. M. A. R. Heugens, 2013. "Competition and Cooperation in Corporate Governance: The Effects of Labor Institutions on Blockholder Effectiveness in 23 European Countries," Organization Science, INFORMS, vol. 24(2), pages 530-551, April.
    14. Marta Gancarczyk, 2015. "Proces wzrostu przedsiębiorstwa w świetle podejścia zasobowego i teorii kosztów transakcyjnych," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 5, pages 5-31.
    15. Verver, Hugo & van Zelst, Marino & Lucas, Gerardus Johannes Maria & Meeus, Marius, 2019. "Understanding Heterogeneity in the Performance Feedback – Organizational Responsiveness Relationship: A Meta-Analysis," OSF Preprints hq4uw, Center for Open Science.
    16. Vishal K. Gupta & Gizem Atav & Dev K. Dutta, 2019. "Market orientation research: a qualitative synthesis and future research agenda," Review of Managerial Science, Springer, vol. 13(4), pages 649-670, August.
    17. Robert P. Garrett & Chao Miao & Shanshan Qian & Tae Jun Bae, 2017. "Entrepreneurial spawning and knowledge-based perspective: a meta-analysis," Small Business Economics, Springer, vol. 49(2), pages 355-378, August.
    18. Christian F. Durach & Joakim Kembro & Andreas Wieland, 2017. "A New Paradigm for Systematic Literature Reviews in Supply Chain Management," Journal of Supply Chain Management, Institute for Supply Management, vol. 53(4), pages 67-85, October.
    19. Xie, Xuemei & Liu, Xiaojie & Chen, Jialing, 2023. "A meta-analysis of the relationship between collaborative innovation and innovation performance: The role of formal and informal institutions," Technovation, Elsevier, vol. 124(C).
    20. Bailey, Nicholas, 2018. "Exploring the relationship between institutional factors and FDI attractiveness: A meta-analytic review," International Business Review, Elsevier, vol. 27(1), pages 139-148.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luis R. Gomez‐Mejia & Marianna Makri & Martin Larraza Kintana, 2010. "Diversification Decisions in Family‐Controlled Firms," Journal of Management Studies, Wiley Blackwell, vol. 47(2), pages 223-252, March.
    2. Meissner, Philip & Wulf, Torsten, 2014. "Antecendents and effects of decision comprehensiveness: The role of decision quality and perceived uncertainty," European Management Journal, Elsevier, vol. 32(4), pages 625-635.
    3. Ante Glavas & Jenny Mish, 2015. "Resources and Capabilities of Triple Bottom Line Firms: Going Over Old or Breaking New Ground?," Journal of Business Ethics, Springer, vol. 127(3), pages 623-642, March.
    4. Sariol, Ana M. & Abebe, Michael A., 2017. "The influence of CEO power on explorative and exploitative organizational innovation," Journal of Business Research, Elsevier, vol. 73(C), pages 38-45.
    5. Kimberly A. Eddleston & James J. Chrisman & Lloyd P. Steier & Jess H. Chua, 2010. "Governance and Trust in Family Firms: An Introduction," Entrepreneurship Theory and Practice, , vol. 34(6), pages 1043-1056, November.
    6. Jeremy S. Wolter & Dora Bock & Jeremy Mackey & Pei Xu & Jeffery S. Smith, 2019. "Employee satisfaction trajectories and their effect on customer satisfaction and repatronage intentions," Journal of the Academy of Marketing Science, Springer, vol. 47(5), pages 815-836, September.
    7. Alfredo De Massis & Josip Kotlar & Mike Wright & Franz W. Kellermanns, 2018. "Sector-Based Entrepreneurial Capabilities and the Promise of Sector Studies in Entrepreneurship," Entrepreneurship Theory and Practice, , vol. 42(1), pages 3-23, January.
    8. Cornil, Yann & Hardisty, David J. & Bart, Yakov, 2019. "Easy, breezy, risky: Lay investors fail to diversify because correlated assets feel more fluent and less risky," Organizational Behavior and Human Decision Processes, Elsevier, vol. 153(C), pages 103-117.
    9. Philip Meissner & Torsten Wulf, 2016. "Debiasing illusion of control in individual judgment: the role of internal and external advice seeking," Review of Managerial Science, Springer, vol. 10(2), pages 245-263, March.
    10. Thomas M. Zellweger & Franz W. Kellermanns & James J. Chrisman & Jess H. Chua, 2012. "Family Control and Family Firm Valuation by Family CEOs: The Importance of Intentions for Transgenerational Control," Organization Science, INFORMS, vol. 23(3), pages 851-868, June.
    11. Johannes Meuer & Christian Rupietta, 2017. "A review of integrated QCA and statistical analyses," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(5), pages 2063-2083, September.
    12. Mauro Romano & Alessandro Cirillo & Donata Mussolino & Luca Pennacchio, 2019. "CEO career horizons and when to go public: the relationship between risk-taking, speed and CEO power," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 23(1), pages 139-163, March.
    13. Zellweger, Thomas M. & Eddleston, Kimberly A. & Kellermanns, Franz W., 2010. "Exploring the concept of familiness: Introducing family firm identity," Journal of Family Business Strategy, Elsevier, vol. 1(1), pages 54-63, March.
    14. Mariano L. M. Heyden & Sebastian P. L. Fourné & Bastiaan A. S. Koene & Renate Werkman & Shahzad (Shaz) Ansari, 2017. "Rethinking ‘Top‐Down’ and ‘Bottom‐Up’ Roles of Top and Middle Managers in Organizational Change: Implications for Employee Support," Journal of Management Studies, Wiley Blackwell, vol. 54(7), pages 961-985, November.
    15. Dennis P. Slevin & Siri A. Terjesen, 2011. "Entrepreneurial Orientation: Reviewing Three Papers and Implications for Further Theoretical and Methodological Development," Entrepreneurship Theory and Practice, , vol. 35(5), pages 973-987, September.
    16. Andreas Hack & Frauke Bieberstein & Nils D. Kraiczy, 2016. "Reference point formation and new venture creation," Small Business Economics, Springer, vol. 46(3), pages 447-465, March.
    17. Cherchem, Naïma, 2017. "The relationship between organizational culture and entrepreneurial orientation in family firms: Does generational involvement matter?," Journal of Family Business Strategy, Elsevier, vol. 8(2), pages 87-98.
    18. Hannes Hauswald & Andreas Hack & Franz W. Kellermanns & Holger Patzelt, 2016. "Attracting New Talent to Family Firms: Who is Attracted and under what Conditions?," Entrepreneurship Theory and Practice, , vol. 40(5), pages 963-989, September.
    19. Shaker A. Zahra & Congcong Zheng & Jifeng Yu, 2018. "Learning advantages of newness: A reconceptualization and contingent framework," Journal of International Entrepreneurship, Springer, vol. 16(1), pages 12-37, March.
    20. Evelyn Stommel & Nicole Gottschalck & Andreas Hack & Kimberly A. Eddleston & Franz Kellermanns & Nils Kraiczy, 2024. "What is Your Reference Point? How Price Volatility and Organizational Context Affect the Reference Points of Family and Nonfamily Managers," Small Business Economics, Springer, vol. 63(2), pages 805-829, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jomstd:v:48:y:2011:i:1:p:178-197. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0022-2380 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.