IDEAS home Printed from https://ideas.repec.org/a/bpj/jecome/v2y2013i1p89-99n2.html
   My bibliography  Save this article

Reproducible Econometric Simulations

Author

Listed:
  • Kleiber Christian

    (Universität Basel – Faculty of Business and Economics, Peter Merian-Weg 6, 4002 Basel, Switzerland)

  • Zeileis Achim

    (Faculty of Economics and Statistics, Universität Innsbruck, Universitätsstr. 15, 6020 Innsbruck, Austria)

Abstract

Reproducibility of economic research has attracted considerable attention in recent years. So far, the discussion has focused mainly on reproducibility of empirical analyses. This paper addresses a further aspect of reproducibility, the reproducibility of computational experiments. More specifically, we contribute to the emerging literature on reproducibility in economics along three lines: (i) we document how simulations of various types are an integral part of publications in modern econometrics, (ii) we provide some general guidelines about how to set up reproducible simulation experiments, and, finally, (iii) we provide a case study from time series econometrics that illustrates the main issues arising in connection with reproducibility, emphasizing the use of modular tools.

Suggested Citation

  • Kleiber Christian & Zeileis Achim, 2013. "Reproducible Econometric Simulations," Journal of Econometric Methods, De Gruyter, vol. 2(1), pages 89-99, July.
    • Handle: RePEc:bpj:jecome:v:2:y:2013:i:1:p:89-99:n:2
    DOI: 10.1515/jem-2012-0004
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jem-2012-0004
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.1515/jem-2012-0004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. MacKinnon, James G & Haug, Alfred A & Michelis, Leo, 1999. "Numerical Distribution Functions of Likelihood Ratio Tests for Cointegration," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 563-577, Sept.-Oct.
    2. Peter Kugler & Beatrice Weder, 2004. "International Portfolio Holdings and Swiss Franc Asset Returns," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 140(III), pages 301-325, September.
    3. Zeileis, Achim & Leisch, Friedrich & Hornik, Kurt & Kleiber, Christian, 2002. "strucchange: An R Package for Testing for Structural Change in Linear Regression Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 7(i02).
    4. Hansen, Bruce E, 1997. "Approximate Asymptotic P Values for Structural-Change Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(1), pages 60-67, January.
    5. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    6. Peter Bernholz, 2003. "Monetary Regimes and Inflation," Books, Edward Elgar Publishing, number 2873.
    7. Ernst Juerg Weber, 1988. "Currency Competition in Switzerland, 1826‐1850," Kyklos, Wiley Blackwell, vol. 41(3), pages 459-478, August.
    8. Kugler, Peter & Weder, Beatrice, 2005. "Why are Returns on Swiss Franc Asset so Low?," Working papers 2005/08, Faculty of Business and Economics - University of Basel.
    9. Moon, Hyungsik Roger & Schorfheide, Frank, 2009. "Estimation with overidentifying inequality moment conditions," Journal of Econometrics, Elsevier, vol. 153(2), pages 136-154, December.
    10. Peter Kugler & Beatrice Weder, 2002. "The Puzzle of the Swiss Interest Rate Island: Stylized Facts and a New Interpretation," Aussenwirtschaft, University of St. Gallen, School of Economics and Political Science, Swiss Institute for International Economics and Applied Economics Research, vol. 57(01), pages 49-64, March.
    11. Hansen, Bruce E., 1992. "Testing for parameter instability in linear models," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 517-533, August.
    12. Peter Kugler & Beatrice Weder, 2004. "International Portfolio Holdings and Swiss Franc Asset Returns," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 140(III), pages 301-325, September.
    13. Kugler, Peter & Weder di Mauro, Beatrice, 2005. "Why Are Returns on Swiss Franc Assets So Low? Rare Events May Solve the Puzzle," CEPR Discussion Papers 5181, C.E.P.R. Discussion Papers.
    14. Hellekalek, P., 1998. "Good random number generators are (not so) easy to find," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 46(5), pages 485-505.
    15. Roger Koenker & Achim Zeileis, 2009. "On reproducible econometric research," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(5), pages 833-847.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christian Zimmermann, 2015. "On the Need for a Replication Journal," Working Papers 2015-16, Federal Reserve Bank of St. Louis.
    2. Jan Pablo Burgard & Hanna Dieckmann & Joscha Krause & Hariolf Merkle & Ralf Münnich & Kristina M. Neufang & Simon Schmaus, 2020. "A generic business process model for conducting microsimulation studies," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 191-211, August.
    3. Burgard Jan Pablo & Dieckmann Hanna & Krause Joscha & Merkle Hariolf & Münnich Ralf & Neufang Kristina M. & Schmaus Simon, 2020. "A generic business process model for conducting microsimulation studies," Statistics in Transition New Series, Statistics Poland, vol. 21(4), pages 191-211, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mathias Hoffmann & Rahel Suter, 2010. "The Swiss Franc Exchange Rate and Deviations from Uncovered Interest Parity: Global vs Domestic Factors," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 146(I), pages 349-371, March.
    2. Niko Hauzenberger & Daniel Kaufmann & Rebecca Stuart & Cédric Tille, 2022. "What Drives Long-Term Interest Rates? Evidence from the Entire Swiss Franc History 1852-2020," IRENE Working Papers 22-03, IRENE Institute of Economic Research.
    3. Jean-Pierre Danthine, 2017. "Taux négatifs: made for Switzerland," Working Papers hal-01884328, HAL.
    4. Feld, Lars P. & Köhler, Ekkehard A., 2015. "Is Switzerland an interest rate island after all? Time series and non-linear switching regime evidence," Freiburg Discussion Papers on Constitutional Economics 15/08, Walter Eucken Institut e.V..
    5. Jean-Pierre Danthine, 2017. "Taux négatifs: made for Switzerland," Post-Print hal-01884328, HAL.
    6. Zeileis, Achim, 2006. "Implementing a class of structural change tests: An econometric computing approach," Computational Statistics & Data Analysis, Elsevier, vol. 50(11), pages 2987-3008, July.
    7. David R. Haab & Thomas Nitschka, 2020. "Carry trade and forward premium puzzle from the perspective of a safe‐haven currency," Review of International Economics, Wiley Blackwell, vol. 28(2), pages 376-394, May.
    8. Ricardo Hausmann & Federico Sturzenegger, 2006. "The Implications of Dark Matter for Assessing the US External Imbalance," CID Working Papers 137, Center for International Development at Harvard University.
    9. Ricardo Hausmann & Federico Sturzenegger, 2006. "Global Imbalances or Bad Accounting? The Missing Dark Matter in the Wealth of Nations," CID Working Papers 124, Center for International Development at Harvard University.
    10. Edgar Merkle & Achim Zeileis, 2013. "Tests of Measurement Invariance Without Subgroups: A Generalization of Classical Methods," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 59-82, January.
    11. Christoph Sax & Rolf Weder, 2009. "How to Explain the High Prices in Switzerland?," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(IV), pages 463-483, December.
    12. Nicolas Stoffels & Cédric Tille, 2007. "Why are Switzerland's foreign assets so low? The growing financial exposure of a small open economy," Staff Reports 283, Federal Reserve Bank of New York.
    13. Mile Bošnjak, 2018. "Swiss Franc from the Croatian Perspective," Journal of Central Banking Theory and Practice, Central bank of Montenegro, vol. 7(3), pages 41-56.
    14. Edgar C. Merkle & Achim Zeileis, 2011. "Generalized Measurement Invariance Tests with Application to Factor Analysis," Working Papers 2011-09, Faculty of Economics and Statistics, Universität Innsbruck.
    15. Christoph Sax, 2006. "Interest Rates and Exchange Rate Movements: Analyzing Short-term Investments in Long-term Bonds," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 20(2), pages 205-220, June.
    16. Gómez-Puig, Marta & Sosvilla-Rivero, Simón, 2014. "Causality and contagion in EMU sovereign debt markets," International Review of Economics & Finance, Elsevier, vol. 33(C), pages 12-27.
    17. Jean-Pierre Danthine & Samuel Danthine, 2018. "On the rewards to international investing: a safe haven currency perspective," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 154(1), pages 1-12, December.
    18. Philippe Bacchetta & Kenza Benhima & Jean-Paul Renne, 2022. "Understanding Swiss real interest rates in a financially globalized world," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 158(1), pages 1-17, December.
    19. Bernstein, Ronald & Madlener, Reinhard, 2015. "Short- and long-run electricity demand elasticities at the subsectoral level: A cointegration analysis for German manufacturing industries," Energy Economics, Elsevier, vol. 48(C), pages 178-187.
    20. Pereira Manuel Coutinho & Lopes Artur Silva, 2014. "Time-varying fiscal policy in the US," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(2), pages 157-184, April.

    More about this item

    Keywords

    computational experiment; reproducibility; simulation; software;
    All these keywords.

    JEL classification:

    • C - Mathematical and Quantitative Methods
    • C - Mathematical and Quantitative Methods
    • C - Mathematical and Quantitative Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:jecome:v:2:y:2013:i:1:p:89-99:n:2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.