IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v24y2009i5p833-847.html
   My bibliography  Save this article

On reproducible econometric research

Author

Listed:
  • Roger Koenker

    (Department of Economics, University of Illinois at Urbana-Champaign, USA)

  • Achim Zeileis

    (Department of Statistics and Mathematics, WU Wirtschaftsuniversit‰t Wien, Austria)

Abstract

Recent software developments are reviewed from the vantage point of reproducible econometric research. We argue that the emergence of new tools, particularly in the open-source community, have greatly eased the burden of documenting and archiving both empirical and simulation work in econometrics. Some of these tools are highlighted in the discussion of two small replication exercises. Copyright © 2009 John Wiley & Sons, Ltd.

Suggested Citation

  • Roger Koenker & Achim Zeileis, 2009. "On reproducible econometric research," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(5), pages 833-847.
    • Handle: RePEc:jae:japmet:v:24:y:2009:i:5:p:833-847
    DOI: 10.1002/jae.1083
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.1083
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: http://qed.econ.queensu.ca:80/jae/2009-v24.5/
    File Function: Supporting data files and programs
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.1083?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Christian Kleiber & Achim Zeileis, 2005. "Validating multiple structural change models-a case study," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(5), pages 685-690.
    2. Durlauf, Steven N & Johnson, Paul A, 1995. "Multiple Regimes and Cross-Country Growth Behaviour," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(4), pages 365-384, Oct.-Dec..
    3. N. Gregory Mankiw & David Romer & David N. Weil, 1992. "A Contribution to the Empirics of Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(2), pages 407-437.
    4. Giovanni Baiocchi, 2007. "Reproducible research in computational economics: guidelines, integrated approaches, and open source software," Computational Economics, Springer;Society for Computational Economics, vol. 30(1), pages 19-40, August.
    5. Koenker, Roger, 1988. "Asymptotic Theory and Econometric Practice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 3(2), pages 139-147, April.
    6. Marius Ooms & Jurgen A. Doornik, 2006. "Econometric software development: past, present and future," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 60(2), pages 206-224, May.
    7. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    8. McCullough, B. D. & McGeary, Kerry Anne & Harrison, Teresa D., 2006. "Lessons from the JMCB Archive," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(4), pages 1093-1107, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    2. Valérie Orozco & Christophe Bontemps & Élise Maigné & Virginie Piguet & Annie Hofstetter & Anne Marie Lacroix & Fabrice Levert & Jean-Marc Rousselle, 2017. "How to make a pie? Reproducible Research for Empirical Economics & Econometrics," Post-Print hal-01939942, HAL.
    3. Colliard, Jean-Edouard & Hurlin, Christophe & Pérignon, Christophe, 2019. "Reproducibility Certification in Economics Research," HEC Research Papers Series 1345, HEC Paris.
    4. Joachim Wagner, 2016. "From Estimation Results to Stylized Facts: Twelve Recommendations for Empirical Research in International Activities of Heterogeneous Firms," World Scientific Book Chapters, in: Microeconometrics of International Trade, chapter 15, pages 479-514, World Scientific Publishing Co. Pte. Ltd..
    5. Kleiber Christian & Zeileis Achim, 2013. "Reproducible Econometric Simulations," Journal of Econometric Methods, De Gruyter, vol. 2(1), pages 89-99, July.
    6. Arai, Mahmood & Karlsson, Jonas & Lundholm, Michael, 2008. "On Fragile Grounds: A Replication of Are Muslim Immigrants Different in Terms of Cultural Integration? Technical Documentation," Research Papers in Economics 2009:6, Stockholm University, Department of Economics.
    7. Roseline Bilina & Steve Lawford, 2012. "Python for Unified Research in Econometrics and Statistics," Econometric Reviews, Taylor & Francis Journals, vol. 31(5), pages 558-591, September.
    8. Michael S. Delgado & Christopher F. Parmeter, 2013. "Embarrassingly Easy Embarrassingly Parallel Processing in R: Implementation and Reproducibility," Working Papers 2013-06, University of Miami, Department of Economics.
    9. Mahmood Arai & Jonas Karlsson & Michael Lundholm, 2011. "On Fragile Grounds: A Replication Of “Are Muslim Immigrants Different In Terms Of Cultural Integration?”," Journal of the European Economic Association, European Economic Association, vol. 9(5), pages 1002-1011, October.
    10. Nicolas Vallois & Dorian Jullien, 2017. "Replication in Experimental Economics: A Historical and Quantitative Approach Focused on Public Good Game Experiments," GREDEG Working Papers 2017-21, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    11. Le Zhang & Andreas Ortmann, 2012. "A reproduction and replication of Engel’s meta-study of dictator game experiments," Discussion Papers 2012-44, School of Economics, The University of New South Wales.
    12. Rodolphe Buda, 2013. "SIMUL 3.2: An Econometric Tool for Multidimensional Modelling," Computational Economics, Springer;Society for Computational Economics, vol. 41(4), pages 517-524, April.
    13. Valérie Orozco & Christophe Bontemps & Elise Maigné & Virginie Piguet & Annie Hofstetter & Anne Lacroix & Fabrice Levert & Jean‐Marc Rousselle, 2020. "How To Make A Pie: Reproducible Research For Empirical Economics And Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(5), pages 1134-1169, December.
    14. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    15. Peter Egger & Sergey Nigai, 2013. "Energy Reform in Switzerland," KOF Working papers 13-327, KOF Swiss Economic Institute, ETH Zurich.
    16. Matthias Bannert, 2015. "timeseriesdb: Manage and Archive Time Series Data in Establishment Statistics with R and PostgreSQL," KOF Working papers 15-384, KOF Swiss Economic Institute, ETH Zurich.
    17. Rodrigues Bruno, 2016. "Version Control Systems to Facilitate Research Collaboration in Economics," Computational Economics, Springer;Society for Computational Economics, vol. 48(3), pages 547-553, October.
    18. Kirchkamp, Oliver, 2019. "Importing z-Tree data into R," Journal of Behavioral and Experimental Finance, Elsevier, vol. 22(C), pages 1-2.
    19. Charles, Amélie & Darné, Olivier, 2019. "Volatility estimation for Bitcoin: Replication and robustness," International Economics, Elsevier, vol. 157(C), pages 23-32.
    20. Matthias Bannert, 2013. "Gateveys," KOF Working papers 13-326, KOF Swiss Economic Institute, ETH Zurich.
    21. Rodolphe Buda, 2015. "Data Checking and Econometric Software Development: A Technique of Traceability by Fictive Data Encoding," Computational Economics, Springer;Society for Computational Economics, vol. 46(2), pages 325-357, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleiber Christian & Zeileis Achim, 2010. "The Grunfeld Data at 50," German Economic Review, De Gruyter, vol. 11(4), pages 404-417, December.
    2. repec:bla:germec:v:11:y:2010:i::p:404-417 is not listed on IDEAS
    3. Mihály Borsi & Norbert Metiu, 2015. "The evolution of economic convergence in the European Union," Empirical Economics, Springer, vol. 48(2), pages 657-681, March.
    4. Massimiliano Affinito, 2011. "Convergence clubs, the euro-area rank and the relationship between banking and real convergence," Temi di discussione (Economic working papers) 809, Bank of Italy, Economic Research and International Relations Area.
    5. Théophile T. Azomahou & Jalal El Ouardighi & Phu Nguyen Van & Thi Kim Cuong Pham, 2006. "Estimation semi-paramétrique de la convergence des régions européennes," Economie & Prévision, La Documentation Française, vol. 0(2), pages 97-110.
    6. Don J. Webber & Min-Hua Jen & Eoin O'Leary, 2014. "Regional productivity in a multi-speed Europe," Working Papers 20141408, Department of Accounting, Economics and Finance, Bristol Business School, University of the West of England, Bristol.
    7. Steven N. Durlauf & Andros Kourtellos & Chih Ming Tan, 2008. "Empirics of Growth and Development," Chapters, in: Amitava Krishna Dutt & Jaime Ros (ed.), International Handbook of Development Economics, Volumes 1 & 2, volume 0, chapter 3, Edward Elgar Publishing.
    8. Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.
    9. Zhang, Xiaobei & Wang, Xiaojun, 2021. "Measures of human capital and the mechanics of economic growth," China Economic Review, Elsevier, vol. 68(C).
    10. Manfred Fischer, 2011. "A spatial Mankiw–Romer–Weil model: theory and evidence," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 47(2), pages 419-436, October.
    11. Michael S. Delgado & Daniel J. Henderson & Christopher F. Parmeter, 2014. "Does Education Matter for Economic Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(3), pages 334-359, June.
    12. Stöllinger, Roman, 2013. "International spillovers in a world of technology clubs," Structural Change and Economic Dynamics, Elsevier, vol. 27(C), pages 19-35.
    13. Shana M. Sundstrom & Craig R. Allen & David G. Angeler, 2020. "Scaling and discontinuities in the global economy," Journal of Evolutionary Economics, Springer, vol. 30(2), pages 319-345, April.
    14. Sandy Dall'erba & Julie Le Gallo, 2008. "Regional convergence and the impact of European structural funds over 1989–1999: A spatial econometric analysis," Papers in Regional Science, Wiley Blackwell, vol. 87(2), pages 219-244, June.
    15. Cutrini, Eleonora & Mendez, Carlos, 2023. "Convergence clubs and spatial structural change in the European Union," Structural Change and Economic Dynamics, Elsevier, vol. 67(C), pages 167-181.
    16. William Brock & M. Taylor, 2010. "The Green Solow model," Journal of Economic Growth, Springer, vol. 15(2), pages 127-153, June.
    17. Nicholas Apergis & Christina Christou & Stephen Miller, 2012. "Convergence patterns in financial development: evidence from club convergence," Empirical Economics, Springer, vol. 43(3), pages 1011-1040, December.
    18. Panagiotis Reppas & Efthymios Tsionas & Dimitris Christopoulos, 2001. "European common stochastic long-run trends," Journal of Economics, Springer, vol. 74(2), pages 119-130, June.
    19. Walid Abdmoulah & Riadh Ben Jelili, 2013. "Access to Finance Thresholds and the Finance-Growth Nexus," Economic Papers, The Economic Society of Australia, vol. 32(4), pages 522-534, December.
    20. Winford H. Masanjala & Chris Papageorgiou, 2004. "The Solow model with CES technology: nonlinearities and parameter heterogeneity," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(2), pages 171-201.
    21. Andreoli-Versbach, Patrick & Mueller-Langer, Frank, 2014. "Open access to data: An ideal professed but not practised," Research Policy, Elsevier, vol. 43(9), pages 1621-1633.

    More about this item

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. On Reproducible Econometric Research (Journal of Applied Econometrics 2009) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:24:y:2009:i:5:p:833-847. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.