IDEAS home Printed from https://ideas.repec.org/p/zbw/ifwedp/201773.html
   My bibliography  Save this paper

Replication to assess statistical adequacy

Author

Listed:
  • Owen, Dorian

Abstract

"Statistical adequacy" is an important prerequisite for securing reliable inference in empirical modelling. This paper argues for more emphasis on replication that specifically assesses whether the results reported in empirical studies are based on statistically adequate models, i.e., models with valid underpinning statistical assumptions that satisfy relevant diagnostic tests of misspecification. A replication plan is briefly outlined to illustrate what this would involve in practice in the context of a specific study by Acemoglu, Gallego and Robinson (Institutions, human capital, and development, Annual Review of Economics, 2014).

Suggested Citation

  • Owen, Dorian, 2017. "Replication to assess statistical adequacy," Economics Discussion Papers 2017-73, Kiel Institute for the World Economy (IfW Kiel).
    • Handle: RePEc:zbw:ifwedp:201773
    as

    Download full text from publisher

    File URL: http://www.economics-ejournal.org/economics/discussionpapers/2017-73
    Download Restriction: no
    File URL: https://www.econstor.eu/bitstream/10419/169132/1/898637384.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Quamrul Ashraf & Oded Galor, 2011. "Dynamics and Stagnation in the Malthusian Epoch," American Economic Review, American Economic Association, vol. 101(5), pages 2003-2041, August.
    3. Enrico Spolaore & Romain Wacziarg, 2013. "How Deep Are the Roots of Economic Development?," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 325-369, June.
    4. Kleibergen, Frank & Paap, Richard, 2006. "Generalized reduced rank tests using the singular value decomposition," Journal of Econometrics, Elsevier, vol. 133(1), pages 97-126, July.
    5. P. Dorian Owen, 2017. "Evaluating Ingenious Instruments for Fundamental Determinants of Long-Run Economic Growth and Development," Econometrics, MDPI, vol. 5(3), pages 1-33, September.
    6. Enrico Spolaore & Romain Wacziarg, 2009. "The Diffusion of Development," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 469-529.
    7. Quamrul Ashraf & Oded Galor, 2013. "The 'Out of Africa' Hypothesis, Human Genetic Diversity, and Comparative Economic Development," American Economic Review, American Economic Association, vol. 103(1), pages 1-46, February.
    8. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    9. Quamrul Ashraf & Oded Galor, 2008. "Human Genetic Diversity and Comparative Economic Development," 2008 Meeting Papers 617, Society for Economic Dynamics.
    10. David F. Hendry & Bent Nielsen, 2007. "Preface to Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    11. Andrews,Donald W. K. & Stock,James H. (ed.), 2005. "Identification and Inference for Econometric Models," Cambridge Books, Cambridge University Press, number 9780521844413, January.
    12. Aris Spanos, 2015. "Revisiting Haavelmo's structural econometrics: bridging the gap between theory and data," Journal of Economic Methodology, Taylor & Francis Journals, vol. 22(2), pages 171-196, June.
    13. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    14. Maren Duvendack & Richard Palmer-Jones & W. Robert Reed, 2017. "What Is Meant by "Replication" and Why Does It Encounter Resistance in Economics?," American Economic Review, American Economic Association, vol. 107(5), pages 46-51, May.
    15. Brown, Annette N. & Wood, Benjamin Douglas Kuflick, 2018. "Which tests not witch hunts: A diagnostic approach for conducting replication research," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 12, pages 1-26.
    16. Estelle Dumas-Mallet & Katherine Button & Thomas Boraud & Marcus Munafo & François Gonon, 2016. "Replication Validity of Initial Association Studies: A Comparison between Psychiatry, Neurology and Four Somatic Diseases," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-20, June.
    17. Easterly, William & Levine, Ross, 2003. "Tropics, germs, and crops: how endowments influence economic development," Journal of Monetary Economics, Elsevier, vol. 50(1), pages 3-39, January.
    18. C. Glenn Begley & Lee M. Ellis, 2012. "Raise standards for preclinical cancer research," Nature, Nature, vol. 483(7391), pages 531-533, March.
    19. Louis Putterman & David N. Weil, 2010. "Post-1500 Population Flows and The Long-Run Determinants of Economic Growth and Inequality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1627-1682.
    20. Edward L. Glaeser & Rafael La Porta & Florencio Lopez-de-Silanes & Andrei Shleifer, 2004. "Do Institutions Cause Growth?," Journal of Economic Growth, Springer, vol. 9(3), pages 271-303, September.
    21. Anselin, Luc & Bera, Anil K. & Florax, Raymond & Yoon, Mann J., 1996. "Simple diagnostic tests for spatial dependence," Regional Science and Urban Economics, Elsevier, vol. 26(1), pages 77-104, February.
    22. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, Institute of Labor Economics (IZA).
    23. Woodberry, Robert D., 2012. "The Missionary Roots of Liberal Democracy," American Political Science Review, Cambridge University Press, vol. 106(2), pages 244-274, May.
    24. William Easterly & Ross Levine, 2016. "The European origins of economic development," Journal of Economic Growth, Springer, vol. 21(3), pages 225-257, September.
    25. Robert E. Hall & Charles I. Jones, 1999. "Why do Some Countries Produce So Much More Output Per Worker than Others?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 83-116.
    26. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    27. David F. Hendry & Bent Nielsen, 2007. "The Bernoulli model, from Econometric Modeling: A Likelihood Approach," Introductory Chapters, in: Econometric Modeling: A Likelihood Approach, Princeton University Press.
    28. Daron Acemoglu & Francisco A. Gallego & James A. Robinson, 2014. "Institutions, Human Capital, and Development ," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 875-912, August.
    29. Gilbert, Christopher L, 1986. "Professor Hendry's Econometric Methodology," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 48(3), pages 283-307, August.
    30. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    31. Daron Acemoglu & Simon Johnson & James A. Robinson, 2012. "The Colonial Origins of Comparative Development: An Empirical Investigation: Reply," American Economic Review, American Economic Association, vol. 102(6), pages 3077-3110, October.
    32. Cragg, John G. & Donald, Stephen G., 1993. "Testing Identifiability and Specification in Instrumental Variable Models," Econometric Theory, Cambridge University Press, vol. 9(2), pages 222-240, April.
    33. Aris Spanos, 2018. "Mis†Specification Testing In Retrospect," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 541-577, April.
    34. Jurgen A. Doornik & Henrik Hansen, 2008. "An Omnibus Test for Univariate and Multivariate Normality," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 927-939, December.
    35. McAleer, Michael, 1994. "Sherlock Holmes and the Search for Truth: A Diagnostic Tale," Journal of Economic Surveys, Wiley Blackwell, vol. 8(4), pages 317-370, December.
    36. David F. Hendry, 2009. "The Methodology of Empirical Econometric Modeling: Applied Econometrics Through the Looking-Glass," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 1, pages 3-67, Palgrave Macmillan.
    37. Phillips,Garry D. A. & Tzavalis,Elias (ed.), 2007. "The Refinement of Econometric Estimation and Test Procedures," Cambridge Books, Cambridge University Press, number 9780521870535, January.
    38. Spanos, Aris, 1990. "The simultaneous-equations model revisited : Statistical adequacy and identification," Journal of Econometrics, Elsevier, vol. 44(1-2), pages 87-105.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Trung V. Vu, 2021. "Are genetic traits associated with riots? The political legacy of prehistorically determined genetic diversity," Kyklos, Wiley Blackwell, vol. 74(4), pages 567-595, November.
    2. Reed, W. Robert, 2019. "Takeaways from the special issue on The Practice of Replication," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 13, pages 1-11.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. P. Dorian Owen, 2017. "Evaluating Ingenious Instruments for Fundamental Determinants of Long-Run Economic Growth and Development," Econometrics, MDPI, vol. 5(3), pages 1-33, September.
    2. Trung V. Vu, 2022. "Does institutional quality foster economic complexity? The fundamental drivers of productive capabilities," Empirical Economics, Springer, vol. 63(3), pages 1571-1604, September.
    3. Oyèkọ́lá, Ọláyínká, 2021. "Where do people live longer?," Research in Economics, Elsevier, vol. 75(1), pages 21-44.
    4. Casey, Gregory & Klemp, Marc, 2016. "Instrumental Variables in the Long Run," MPRA Paper 68696, University Library of Munich, Germany.
    5. Nunn, Nathan, 2014. "Historical Development," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 7, pages 347-402, Elsevier.
    6. Faria, Hugo J. & Montesinos-Yufa, Hugo M. & Morales, Daniel R. & Navarro, Carlos E., 2016. "Unbundling the roles of human capital and institutions in economic development," European Journal of Political Economy, Elsevier, vol. 45(S), pages 108-128.
    7. Jamie Bologna Pavlik & Andrew T. Young, 2021. "The legacy of representation in medieval Europe for incomes and institutions today," Southern Economic Journal, John Wiley & Sons, vol. 88(1), pages 414-448, July.
    8. Ertan, Arhan & Fiszbein, Martin & Putterman, Louis, 2016. "Who was colonized and when? A cross-country analysis of determinants," European Economic Review, Elsevier, vol. 83(C), pages 165-184.
    9. Sam Hak Kan Tang & Charles Ka Yui Leung, 2016. "The Deep Historical Roots of Macroeconomic Volatility," The Economic Record, The Economic Society of Australia, vol. 92(299), pages 568-589, December.
    10. Casey, Gregory & Klemp, Marc, 2021. "Historical instruments and contemporary endogenous regressors," Journal of Development Economics, Elsevier, vol. 149(C).
    11. William Easterly & Ross Levine, 2016. "The European origins of economic development," Journal of Economic Growth, Springer, vol. 21(3), pages 225-257, September.
    12. Pavlik, Jamie Bologna & Young, Andrew T., 2019. "Did technology transfer more rapidly East–West than North–South?," European Economic Review, Elsevier, vol. 119(C), pages 216-235.
    13. Enrico Spolaore & Romain Wacziarg, 2013. "How Deep Are the Roots of Economic Development?," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 325-369, June.
    14. Erkan Goeren, 2017. "The Role of Novelty-Seeking Traits in Contemporary Knowledge Creation," Working Papers V-402-17, University of Oldenburg, Department of Economics, revised Sep 2017.
    15. Rok Spruk & Mitja Kovac, 2019. "Transaction costs and economic growth under common legal system: State‐level evidence from Mexico," Economics and Politics, Wiley Blackwell, vol. 31(2), pages 240-292, July.
    16. Ho, Chi Pui, 2016. "GeoPopulation-Institution Hypothesis: Reconciling American Development Process and Reversal of Fortune within a Unified Growth Framework," MPRA Paper 73863, University Library of Munich, Germany.
    17. Maseland, Robbert, 2021. "Contingent determinants," Journal of Development Economics, Elsevier, vol. 151(C).
    18. Spolaore, Enrico & Wacziarg, Romain, 2014. "Long-Term Barriers to Economic Development," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 3, pages 121-176, Elsevier.
    19. Scott L. Fulford & Ivan Petkov & Fabio Schiantarelli, 2020. "Does it matter where you came from? Ancestry composition and economic performance of US counties, 1850–2010," Journal of Economic Growth, Springer, vol. 25(3), pages 341-380, September.
    20. Alberto Alesina & Johann Harnoss & Hillel Rapoport, 2016. "Birthplace diversity and economic prosperity," Journal of Economic Growth, Springer, vol. 21(2), pages 101-138, June.

    More about this item

    Keywords

    replication; statistical adequacy; inference; instrumental variables; reduced form; fundamental determinants of economic development;
    All these keywords.

    JEL classification:

    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • C36 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Instrumental Variables (IV) Estimation
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • P14 - Political Economy and Comparative Economic Systems - - Capitalist Economies - - - Property Rights
    • O10 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:ifwedp:201773. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/iwkiede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.