IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v24y2009i5p833-847.html
   My bibliography  Save this article

On reproducible econometric research

Author

Listed:
  • Roger Koenker

    (Department of Economics, University of Illinois at Urbana-Champaign, USA)

  • Achim Zeileis

    (Department of Statistics and Mathematics, WU Wirtschaftsuniversit‰t Wien, Austria)

Abstract

Recent software developments are reviewed from the vantage point of reproducible econometric research. We argue that the emergence of new tools, particularly in the open-source community, have greatly eased the burden of documenting and archiving both empirical and simulation work in econometrics. Some of these tools are highlighted in the discussion of two small replication exercises. Copyright © 2009 John Wiley & Sons, Ltd.

Suggested Citation

  • Roger Koenker & Achim Zeileis, 2009. "On reproducible econometric research," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(5), pages 833-847.
    • Handle: RePEc:jae:japmet:v:24:y:2009:i:5:p:833-847
    DOI: 10.1002/jae.1083
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.1083
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: http://qed.econ.queensu.ca:80/jae/2009-v24.5/
    File Function: Supporting data files and programs
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.1083?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    2. N. Gregory Mankiw & David Romer & David N. Weil, 1992. "A Contribution to the Empirics of Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(2), pages 407-437.
    3. Marius Ooms & Jurgen A. Doornik, 2006. "Econometric software development: past, present and future," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 60(2), pages 206-224, May.
    4. Christian Kleiber & Achim Zeileis, 2005. "Validating multiple structural change models-a case study," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(5), pages 685-690.
    5. Durlauf, Steven N & Johnson, Paul A, 1995. "Multiple Regimes and Cross-Country Growth Behaviour," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(4), pages 365-384, Oct.-Dec..
    6. Koenker, Roger, 1988. "Asymptotic Theory and Econometric Practice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 3(2), pages 139-147, April.
    7. McCullough, B. D. & McGeary, Kerry Anne & Harrison, Teresa D., 2006. "Lessons from the JMCB Archive," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(4), pages 1093-1107, June.
    8. Giovanni Baiocchi, 2007. "Reproducible research in computational economics: guidelines, integrated approaches, and open source software," Computational Economics, Springer;Society for Computational Economics, vol. 30(1), pages 19-40, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    2. Valérie Orozco & Christophe Bontemps & Élise Maigné & Virginie Piguet & Annie Hofstetter & Anne Marie Lacroix & Fabrice Levert & Jean-Marc Rousselle, 2017. "How to make a pie? Reproducible Research for Empirical Economics & Econometrics," Post-Print hal-01939942, HAL.
    3. Colliard, Jean-Edouard & Hurlin, Christophe & Pérignon, Christophe, 2019. "Reproducibility Certification in Economics Research," HEC Research Papers Series 1345, HEC Paris.
    4. Joachim Wagner, 2016. "From Estimation Results to Stylized Facts: Twelve Recommendations for Empirical Research in International Activities of Heterogeneous Firms," World Scientific Book Chapters, in: Microeconometrics of International Trade, chapter 15, pages 479-514, World Scientific Publishing Co. Pte. Ltd..
    5. Kleiber Christian & Zeileis Achim, 2013. "Reproducible Econometric Simulations," Journal of Econometric Methods, De Gruyter, vol. 2(1), pages 89-99, July.
    6. Arai, Mahmood & Karlsson, Jonas & Lundholm, Michael, 2008. "On Fragile Grounds: A Replication of Are Muslim Immigrants Different in Terms of Cultural Integration? Technical Documentation," Research Papers in Economics 2009:6, Stockholm University, Department of Economics.
    7. Roseline Bilina & Steve Lawford, 2012. "Python for Unified Research in Econometrics and Statistics," Econometric Reviews, Taylor & Francis Journals, vol. 31(5), pages 558-591, September.
    8. Michael S. Delgado & Christopher F. Parmeter, 2013. "Embarrassingly Easy Embarrassingly Parallel Processing in R: Implementation and Reproducibility," Working Papers 2013-06, University of Miami, Department of Economics.
    9. Mahmood Arai & Jonas Karlsson & Michael Lundholm, 2011. "On Fragile Grounds: A Replication Of “Are Muslim Immigrants Different In Terms Of Cultural Integration?”," Journal of the European Economic Association, European Economic Association, vol. 9(5), pages 1002-1011, October.
    10. Nicolas Vallois & Dorian Jullien, 2017. "Replication in Experimental Economics: A Historical and Quantitative Approach Focused on Public Good Game Experiments," GREDEG Working Papers 2017-21, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    11. Le Zhang & Andreas Ortmann, 2012. "A reproduction and replication of Engel’s meta-study of dictator game experiments," Discussion Papers 2012-44, School of Economics, The University of New South Wales.
    12. Rodolphe Buda, 2013. "SIMUL 3.2: An Econometric Tool for Multidimensional Modelling," Computational Economics, Springer;Society for Computational Economics, vol. 41(4), pages 517-524, April.
    13. Valérie Orozco & Christophe Bontemps & Elise Maigné & Virginie Piguet & Annie Hofstetter & Anne Lacroix & Fabrice Levert & Jean‐Marc Rousselle, 2020. "How To Make A Pie: Reproducible Research For Empirical Economics And Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(5), pages 1134-1169, December.
    14. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    15. Peter Egger & Sergey Nigai, 2013. "Energy Reform in Switzerland," KOF Working papers 13-327, KOF Swiss Economic Institute, ETH Zurich.
    16. Matthias Bannert, 2015. "timeseriesdb: Manage and Archive Time Series Data in Establishment Statistics with R and PostgreSQL," KOF Working papers 15-384, KOF Swiss Economic Institute, ETH Zurich.
    17. Rodrigues Bruno, 2016. "Version Control Systems to Facilitate Research Collaboration in Economics," Computational Economics, Springer;Society for Computational Economics, vol. 48(3), pages 547-553, October.
    18. Kirchkamp, Oliver, 2019. "Importing z-Tree data into R," Journal of Behavioral and Experimental Finance, Elsevier, vol. 22(C), pages 1-2.
    19. Charles, Amélie & Darné, Olivier, 2019. "Volatility estimation for Bitcoin: Replication and robustness," International Economics, Elsevier, vol. 157(C), pages 23-32.
    20. Matthias Bannert, 2013. "Gateveys," KOF Working papers 13-326, KOF Swiss Economic Institute, ETH Zurich.
    21. Rodolphe Buda, 2015. "Data Checking and Econometric Software Development: A Technique of Traceability by Fictive Data Encoding," Computational Economics, Springer;Society for Computational Economics, vol. 46(2), pages 325-357, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleiber Christian & Zeileis Achim, 2010. "The Grunfeld Data at 50," German Economic Review, De Gruyter, vol. 11(4), pages 404-417, December.
    2. repec:bla:germec:v:11:y:2010:i::p:404-417 is not listed on IDEAS
    3. Massimiliano Affinito, 2011. "Convergence clubs, the euro-area rank and the relationship between banking and real convergence," Temi di discussione (Economic working papers) 809, Bank of Italy, Economic Research and International Relations Area.
    4. Don J. Webber & Min-Hua Jen & Eoin O'Leary, 2014. "Regional productivity in a multi-speed Europe," Working Papers 20141408, Department of Accounting, Economics and Finance, Bristol Business School, University of the West of England, Bristol.
    5. Steven N. Durlauf & Andros Kourtellos & Chih Ming Tan, 2008. "Empirics of Growth and Development," Chapters, in: Amitava Krishna Dutt & Jaime Ros (ed.), International Handbook of Development Economics, Volumes 1 & 2, volume 0, chapter 3, Edward Elgar Publishing.
    6. Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.
    7. Zhang, Xiaobei & Wang, Xiaojun, 2021. "Measures of human capital and the mechanics of economic growth," China Economic Review, Elsevier, vol. 68(C).
    8. Michael S. Delgado & Daniel J. Henderson & Christopher F. Parmeter, 2014. "Does Education Matter for Economic Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(3), pages 334-359, June.
    9. Stöllinger, Roman, 2013. "International spillovers in a world of technology clubs," Structural Change and Economic Dynamics, Elsevier, vol. 27(C), pages 19-35.
    10. Nicholas Apergis & Christina Christou & Stephen Miller, 2012. "Convergence patterns in financial development: evidence from club convergence," Empirical Economics, Springer, vol. 43(3), pages 1011-1040, December.
    11. Walid Abdmoulah & Riadh Ben Jelili, 2013. "Access to Finance Thresholds and the Finance-Growth Nexus," Economic Papers, The Economic Society of Australia, vol. 32(4), pages 522-534, December.
    12. Peter Howitt, 2007. "Innovation, Competition and Growth: A Schumpeterian Perspective on Canada’s Economy," C.D. Howe Institute Commentary, C.D. Howe Institute, issue 246, February.
    13. Jakob Haan, 2007. "Political institutions and economic growth reconsidered," Public Choice, Springer, vol. 131(3), pages 281-292, June.
    14. Feng, Guohua & Gao, Jiti & Peng, Bin, 2022. "An integrated panel data approach to modelling economic growth," Journal of Econometrics, Elsevier, vol. 228(2), pages 379-397.
    15. Stolzenburg, Ulrich, 2014. "Growth determinants across time and space: A semiparametric panel data approach," Economics Working Papers 2014-11, Christian-Albrechts-University of Kiel, Department of Economics.
    16. Phu Nguyen Van, 2005. "Distribution Dynamics of CO 2 Emissions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 32(4), pages 495-508, December.
    17. Sven Wardenburg & Thomas Brenner, 2021. "Analysing the spatio-temporal diffusion of economic change - advanced statistical approach and exemplary application," Working Papers on Innovation and Space 2021-01, Philipps University Marburg, Department of Geography.
    18. Camilla Mastromarco & Laura Serlenga & Yongcheol Shin, 2012. "Is Globalization Driving Efficiency? A Threshold Stochastic Frontier Panel Data Modeling Approach," Review of International Economics, Wiley Blackwell, vol. 20(3), pages 563-579, August.
    19. Epstein, Philip & Howlett, Peter & Schulze, Max-Stephan, 2007. "Trade, convergence, and globalisation: The dynamics of the international income distribution, 1950-1998," Explorations in Economic History, Elsevier, vol. 44(1), pages 100-113, January.
    20. Thibaut Dort & Pierre-Guillaume Méon & Khalid Sekkat, 2014. "Does investment spur growth everywhere? Not where institutions are weak," Post-Print CEB, ULB -- Universite Libre de Bruxelles, vol. 67(4), pages 482-505, October.
    21. Andros Kourtellos, 2011. "Modeling parameter heterogeneity in cross-country regression models," University of Cyprus Working Papers in Economics 11-2011, University of Cyprus Department of Economics.

    More about this item

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. On Reproducible Econometric Research (Journal of Applied Econometrics 2009) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:24:y:2009:i:5:p:833-847. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.