IDEAS home Printed from https://ideas.repec.org/a/elg/ejeepi/v10y2013i2p207-220.html
   My bibliography  Save this article

Does economics add up? An introduction to meta-regression analysis

Author

Listed:
  • T.D. Stanley

    (Hendrix College)

Abstract

Meta-analysis is the statistical analysis of an entire empirical literature. It seeks to summarize, evaluate and analyse what we know about a given empirical question, phenomenon, or effect. Meta-regression analysis (MRA) is meta-econometrics, uses the very tools that produce economics research, and provides a rigorous, objective alternative to conventional narrative reviews in economics. MRA often reveals surprising truths about economics. To illustrate these methods, I discuss meta-analyses of the employment effect of the minimum wage, efficiency wages, the natural rate hypothesis and unemployment hysteresis, the last two of which provide a rigorous, empirical falsification of the natural rate hypothesis.

Suggested Citation

  • T.D. Stanley, 2013. "Does economics add up? An introduction to meta-regression analysis," European Journal of Economics and Economic Policies: Intervention, Edward Elgar Publishing, vol. 10(2), pages 207-220.
  • Handle: RePEc:elg:ejeepi:v:10:y:2013:i:2:p207-220
    as

    Download full text from publisher

    File URL: http://www.elgaronline.com/abstract/journals/ejeep/10-2/ejeep.2013.02.05.xml
    Download Restriction: Restricted access
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Olivier J. Blanchard & Lawrence H. Summers, 1986. "Hysteresis and the European Unemployment Problem," NBER Chapters, in: NBER Macroeconomics Annual 1986, Volume 1, pages 15-90, National Bureau of Economic Research, Inc.
    2. Avi J. Cohen, 2003. "Retrospectives: Whatever Happened to the Cambridge Capital Theory Controversies?," Journal of Economic Perspectives, American Economic Association, vol. 17(1), pages 199-214, Winter.
    3. Nijkamp, Peter & Poot, Jacques, 2004. "Meta-analysis of the effect of fiscal policies on long-run growth," European Journal of Political Economy, Elsevier, vol. 20(1), pages 91-124, March.
    4. T. D. Stanley & Stephen B. Jarrell, 2005. "Meta‐Regression Analysis: A Quantitative Method of Literature Surveys," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 299-308, July.
    5. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost Heckemeyer & Robert Johnston & Patrice Laroche & Jon Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall Rosenberger & Katja Rost, 2013. "Meta-analysis of economics research reporting guidelines," Post-Print hal-02137661, HAL.
    6. Marek Rusnak & Tomas Havranek & Roman Horvath, 2013. "How to Solve the Price Puzzle? A Meta‐Analysis," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(1), pages 37-70, February.
    7. George A. Akerlof, 2003. "Behavioral Macroeconomics and Macroeconomic Behavior," The American Economist, Sage Publications, vol. 47(1), pages 25-47, March.
    8. Card, David & Krueger, Alan B, 1995. "Time-Series Minimum-Wage Studies: A Meta-analysis," American Economic Review, American Economic Association, vol. 85(2), pages 238-243, May.
    9. T. D. Stanley, 2002. "When all are NAIRU: hysteresis and behavioural inertia," Applied Economics Letters, Taylor & Francis Journals, vol. 9(11), pages 753-757.
    10. Blanchard, Olivier J. & Summers, Lawrence H., 1987. "Hysteresis in unemployment," European Economic Review, Elsevier, vol. 31(1-2), pages 288-295.
    11. Eric Krassoi Peach & T. Stanley, 2009. "Efficiency Wages, Productivity and Simultaneity: A Meta-Regression Analysis," Journal of Labor Research, Springer, vol. 30(3), pages 262-268, September.
    12. T. D. Stanley, 2005. "Integrating the Empirical Tests of the Natural Rate Hypothesis: A Meta‐Regression Analysis," Kyklos, Wiley Blackwell, vol. 58(4), pages 611-634, November.
    13. Tomáš Havránek, 2010. "Rose effect and the euro: is the magic gone?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 146(2), pages 241-261, June.
    14. Stanley, T. D. & Doucouliagos, Chris, 2007. "Identifying and correcting publication selection bias in the efficiency-wage literature: Heckman Meta-Regression," Working Papers eco_2007_11, Deakin University, Department of Economics.
    15. T. D. Stanley, 2008. "Meta‐Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(1), pages 103-127, February.
    16. Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, June.
    17. Stanley, T. D. & Jarrell, Stephen B. & Doucouliagos, Hristos, 2010. "Could It Be Better to Discard 90% of the Data? A Statistical Paradox," The American Statistician, American Statistical Association, vol. 64(1), pages 70-77.
    18. George A. Akerlof, 1982. "Labor Contracts as Partial Gift Exchange," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 97(4), pages 543-569.
    19. Neal S Young, 2008. "Why Current Publication May Distort Science," Working Papers id:1757, eSocialSciences.
    20. Neal S Young & John P A Ioannidis & Omar Al-Ubaydli, 2008. "Why Current Publication Practices May Distort Science," PLOS Medicine, Public Library of Science, vol. 5(10), pages 1-5, October.
    21. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost H. Heckemeyer & Robert J. Johnston & Patrice Laroche & Jon P. Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall S. Rosenberger & , 2013. "Meta-Analysis Of Economics Research Reporting Guidelines," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 390-394, April.
    22. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer.
    23. Jeroen Klomp & Jakob De Haan, 2010. "Inflation And Central Bank Independence: A Meta‐Regression Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 24(4), pages 593-621, September.
    24. Chris Doucouliagos & T.D. Stanley, 2013. "Are All Economic Facts Greatly Exaggerated? Theory Competition And Selectivity," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 316-339, April.
    25. T. D. Stanley, 2004. "Does unemployment hysteresis falsify the natural rate hypothesis? a meta‐regression analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 18(4), pages 589-612, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. de Linde Leonard, Megan & Stanley, T.D., 2015. "Married with children: What remains when observable biases are removed from the reported male marriage wage premium," Labour Economics, Elsevier, vol. 33(C), pages 72-80.
    2. Obsa Urgessa Ayana & Jima Degaga, 2022. "Effects of rural electrification on household welfare: a meta-regression analysis," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 69(2), pages 209-261, June.
    3. Guilherme Spinato Morlin & Nikolas Passos & Riccardo Pariboni, 2021. "Growth theory and the growth model perspective: Insights from the supermultiplier," Department of Economics University of Siena 869, Department of Economics, University of Siena.
    4. Kluve, Jochen & Puerto, Olga Susana & Robalino, David A. & Romero, Jose M. & Rother, Friederike & Stöterau, Jonathan & Weidenkaff, Felix & Witte, Marc J., 2016. "Do Youth Employment Programs Improve Labor Market Outcomes? A Systematic Review," IZA Discussion Papers 10263, Institute of Labor Economics (IZA).
    5. Doucouliagos, Hristos & Paldam, Martin & Stanley, T.D., 2018. "Skating on thin evidence: Implications for public policy," European Journal of Political Economy, Elsevier, vol. 54(C), pages 16-25.
    6. Guilherme Spinato Morlin & Nikolas Passos & Riccardo Pariboni, 2024. "Growth Theory and the Growth Model Perspective: Insights from the Supermultiplier," Review of Political Economy, Taylor & Francis Journals, vol. 36(3), pages 1130-1155, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Markus Hang & Jerome Geyer‐Klingeberg & Andreas Rathgeber & Stefan Stöckl, 2018. "Economic Development Matters: A Meta‐Regression Analysis on the Relation between Environmental Management and Financial Performance," Journal of Industrial Ecology, Yale University, vol. 22(4), pages 720-744, August.
    2. Stephan B. Bruns, 2013. "Identifying Genuine Effects in Observational Research by Means of Meta-Regressions," Jena Economics Research Papers 2013-040, Friedrich-Schiller-University Jena.
    3. Petra Valickova & Tomas Havranek & Roman Horvath, 2015. "Financial Development And Economic Growth: A Meta-Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 29(3), pages 506-526, July.
    4. Tomas Kucera, 2020. "Are Employment Effects of Minimum Wage the Same Across the EU? A Meta-Regression Analysis," Working Papers IES 2020/2, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Jan 2020.
    5. Lan Nguyen, Thi Mai & Papyrakis, Elissaios & van Bergeijk, Peter A.G., 2021. "Publication bias in the price effects of monetary policy: A meta-regression analysis for emerging and developing economies," International Review of Economics & Finance, Elsevier, vol. 71(C), pages 567-583.
    6. Balima, Hippolyte W. & Kilama, Eric G. & Tapsoba, René, 2020. "Inflation targeting: Genuine effects or publication selection bias?," European Economic Review, Elsevier, vol. 128(C).
    7. Stanley, T. D. & Doucouliagos, Hristos, 2011. "Meta-regression approximations to reduce publication selection bias," Working Papers eco_2011_4, Deakin University, Department of Economics.
    8. Hippolyte W. Balima & Eric G. Kilama & Rene Tapsoba, 2017. "Settling the Inflation Targeting Debate: Lights from a Meta-Regression Analysis," IMF Working Papers 2017/213, International Monetary Fund.
    9. Hang, Markus & Geyer-Klingeberg, Jerome & Rathgeber, Andreas W. & Stöckl, Stefan, 2018. "Measurement matters—A meta-study of the determinants of corporate capital structure," The Quarterly Review of Economics and Finance, Elsevier, vol. 68(C), pages 211-225.
    10. Havranek, Tomas & Kokes, Ondrej, 2015. "Income elasticity of gasoline demand: A meta-analysis," Energy Economics, Elsevier, vol. 47(C), pages 77-86.
    11. Megan Linde Leonard & T. D. Stanley & Hristos Doucouliagos, 2014. "Does the UK Minimum Wage Reduce Employment? A Meta-Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 52(3), pages 499-520, September.
    12. Stefan Stöckl, 2017. "Measurement matters - A meta-Study of the determinants of corporate capital structure," Post-Print hal-01772346, HAL.
    13. Ugur, Mehmet & Trushin, Eshref & Solomon, Edna & Guidi, Francesco, 2016. "R&D and productivity in OECD firms and industries: A hierarchical meta-regression analysis," Research Policy, Elsevier, vol. 45(10), pages 2069-2086.
    14. Chris Doucouliagos & T.D. Stanley, 2013. "Are All Economic Facts Greatly Exaggerated? Theory Competition And Selectivity," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 316-339, April.
    15. Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2019. "Remittances and Economic Growth: A Quantitative Survey," EconStor Preprints 205812, ZBW - Leibniz Information Centre for Economics.
    16. Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, June.
    17. Stéphane Goutte & David Guerreiro & Bilel Sanhaji & Sophie Saglio & Julien Chevallier, 2019. "International Financial Markets," Post-Print halshs-02183053, HAL.
    18. Costa-Font, Joan & McGuire, Alistair & Stanley, Tom, 2013. "Publication selection in health policy research: The winner's curse hypothesis," Health Policy, Elsevier, vol. 109(1), pages 78-87.
    19. Awaworyi Churchill, S. & Yew, S.L., 2017. "Are government transfers harmful to economic growth? A meta-analysis," Economic Modelling, Elsevier, vol. 64(C), pages 270-287.
    20. Tomáš Havránek, 2010. "Rose effect and the euro: is the magic gone?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 146(2), pages 241-261, June.

    More about this item

    Keywords

    meta-regression analysis; empirical economics; minimum wage; efficiency wage; natural rate hypothesis;
    All these keywords.

    JEL classification:

    • E00 - Macroeconomics and Monetary Economics - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:elg:ejeepi:v:10:y:2013:i:2:p207-220. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Phillip Thompson (email available below). General contact details of provider: http://www.elgaronline.com/ejeep .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.