IDEAS home Printed from https://ideas.repec.org/a/ejw/journl/v4y2007i3p326-337.html
   My bibliography  Save this article

Got Replicability? The _Journal of Money, Credit and Banking_ Archive

Author

Listed:
  • B. D. McCullough

Abstract

In a paper published in the Journal of Money, Credit and Banking, McGeary, Harrison, and I showed that the JMCB’s data+code archive of generally did not support the replication of the journal’s published results. We recommended several procedures for ensuring that the archived data and code would reproduce the published results. The JMCB Editors recently adopted a few new procedures, ignoring most of the recommendations. This paper checks to see whether the new procedures are working. They are not.

Suggested Citation

  • B. D. McCullough, 2007. "Got Replicability? The _Journal of Money, Credit and Banking_ Archive," Econ Journal Watch, Econ Journal Watch, vol. 4(3), pages 326-337, September.
    • Handle: RePEc:ejw:journl:v:4:y:2007:i:3:p:326-337
    as

    Download full text from publisher

    File URL: https://econjwatch.org/File+download/170/2007-09-mccullough-econ_practice.pdf?mimetype=pdf
    Download Restriction: no
    File URL: https://econjwatch.org/250
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Steven D. Levitt, 2002. "Using Electoral Cycles in Police Hiring to Estimate the Effects of Police on Crime: Reply," American Economic Review, American Economic Association, vol. 92(4), pages 1244-1250, September.
    2. Levitt, Steven D, 1997. "Using Electoral Cycles in Police Hiring to Estimate the Effect of Police on Crime," American Economic Review, American Economic Association, vol. 87(3), pages 270-290, June.
    3. McCullough, B. D. & McGeary, Kerry Anne & Harrison, Teresa D., 2006. "Lessons from the JMCB Archive," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(4), pages 1093-1107, June.
    4. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    5. Justin McCrary, 2002. "Using Electoral Cycles in Police Hiring to Estimate the Effect of Police on Crime: Comment," American Economic Review, American Economic Association, vol. 92(4), pages 1236-1243, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    RePEc Biblio mentions

    As found on the RePEc Biblio, the curated bibliography for Economics:
    1. > Economics Profession > Publishing in Economics > Replication

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vlaeminck, Sven & Podkrajac, Felix, 2017. "Journals in Economic Sciences: Paying Lip Service to Reproducible Research?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 41(1-4), pages 1-16.
    2. Dimitris Hatzinikolaou, 2010. "Econometric Errors in an _Applied Economics_ Article," Econ Journal Watch, Econ Journal Watch, vol. 7(2), pages 107-112, May.
    3. Vlaeminck, Sven, 2013. "Data Management in Scholarly Journals and Possible Roles for Libraries - Some Insights from EDaWaX," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 23(1), pages 49-79.
    4. B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008. "Do economics journal archives promote replicable research?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(4), pages 1406-1420, November.
    5. Cristobal Young & Charles Varner, 2015. "A Reply to “A Replication of “Millionaire Migration and State Taxation of Top Incomes," Public Finance Review, , vol. 43(2), pages 226-234, March.
    6. Evanschitzky, Heiner & Armstrong, J. Scott, 2010. "Replications of forecasting research," International Journal of Forecasting, Elsevier, vol. 26(1), pages 4-8, January.
    7. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    8. Robert A. Moffitt, 2011. "Report of the Editor: American Economic Review (with Appendix by Philip J. Glandon)," American Economic Review, American Economic Association, vol. 101(3), pages 684-693, May.
    9. Vlaeminck, Sven & Herrmann, Lisa-Kristin, 2015. "Data Policies and Data Archives: A New Paradigm for Academic Publishing in Economic Sciences?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, pages 145-155.
    10. Brendan K. Beare, 2008. "The Soviet Economic Decline Revisited," Econ Journal Watch, Econ Journal Watch, vol. 5(2), pages 135-144, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008. "Do economics journal archives promote replicable research?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(4), pages 1406-1420, November.
    2. Maren Duvendack & Richard Palmer-Jones, 2013. "Replication of quantitative work in development studies: Experiences and suggestions," Progress in Development Studies, , vol. 13(4), pages 307-322, October.
    3. Valérie Orozco & Christophe Bontemps & Elise Maigné & Virginie Piguet & Annie Hofstetter & Anne Lacroix & Fabrice Levert & Jean‐Marc Rousselle, 2020. "How To Make A Pie: Reproducible Research For Empirical Economics And Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(5), pages 1134-1169, December.
    4. Stephen Machin & Olivier Marie, 2011. "Crime And Police Resources: The Street Crime Initiative," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 678-701, August.
    5. Philip A. Curry & Anindya Sen & George Orlov, 2016. "Crime, apprehension and clearance rates: Panel data evidence from Canadian provinces," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 49(2), pages 481-514, May.
    6. Paolo Buonanno & Giovanni Mastrobuoni, 2012. "Police and Crime: Evidence from Dictated Delays in Centralized Police Hiring," Carlo Alberto Notebooks 244, Collegio Carlo Alberto.
    7. Klick, Jonathan & Tabarrok, Alexander, 2005. "Using Terror Alert Levels to Estimate the Effect of Police on Crime," Journal of Law and Economics, University of Chicago Press, vol. 48(1), pages 267-279, April.
    8. Reyes, Luis Carlos, 2014. "Estimating the Causal Effect of Forced Eradication on Coca Cultivation in Colombian Municipalities," World Development, Elsevier, vol. 61(C), pages 70-84.
    9. Lin, Ming-Jen, 2009. "More police, less crime: Evidence from US state data," International Review of Law and Economics, Elsevier, vol. 29(2), pages 73-80, June.
    10. Mirko Draca & Stephen Machin & Robert Witt, 2011. "Panic on the Streets of London: Police, Crime, and the July 2005 Terror Attacks," American Economic Review, American Economic Association, vol. 101(5), pages 2157-2181, August.
    11. Cunningham, Jamein P., 2016. "An evaluation of the Federal Legal Services Program: Evidence from crime rates and property values," Journal of Urban Economics, Elsevier, vol. 92(C), pages 76-90.
    12. Olugbenga Ajilore & John Smith, 2011. "Ethnic fragmentation and police spending," Applied Economics Letters, Taylor & Francis Journals, vol. 18(4), pages 329-332.
    13. Robert Chernomas & Ian Hudson, 2013. "Steven Levitt on Abortion and Crime: Old Economics in New Bottles," American Journal of Economics and Sociology, Wiley Blackwell, vol. 72(3), pages 675-700, July.
    14. Arvate, Paulo & Souza, André Portela, 2022. "Armed police and violence: Evidence from a quasi-natural experiment in Brazil," Economic Modelling, Elsevier, vol. 111(C).
    15. Jason M. Lindo & Charles Stoecker, 2014. "Drawn Into Violence: Evidence On “What Makes A Criminal” From The Vietnam Draft Lotteries," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 239-258, January.
    16. Cho, Sungwoo & Gonçalves, Felipe & Weisburst, Emily, 2021. "Do Police Make Too Many Arrests? The Effect of Enforcement Pullbacks on Crime," IZA Discussion Papers 14907, Institute of Labor Economics (IZA).
    17. Mirko Draca & Stephen Machin & Robert Witt, 2010. "Crime Displacement and Police Interventions: Evidence from London's "Operation Theseus"," NBER Chapters, in: The Economics of Crime: Lessons For and From Latin America, pages 359-374, National Bureau of Economic Research, Inc.
    18. Ross, Amanda, 2012. "Crime, police, and truth-in-sentencing: The impact of state sentencing policy on local communities," Regional Science and Urban Economics, Elsevier, vol. 42(1-2), pages 144-152.
    19. Bebonchu Atems, 2020. "Identifying the Dynamic Effects of Income Inequality on Crime," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(4), pages 751-782, August.
    20. Steven N. Durlauf & Daniel S. Nagin, 2010. "The Deterrent Effect of Imprisonment," NBER Chapters, in: Controlling Crime: Strategies and Tradeoffs, pages 43-94, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    code; data; replication; reproducible research;
    All these keywords.

    JEL classification:

    • B4 - Schools of Economic Thought and Methodology - - Economic Methodology
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ejw:journl:v:4:y:2007:i:3:p:326-337. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jason Briggeman (email available below). General contact details of provider: https://edirc.repec.org/data/edgmuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.