IDEAS home Printed from https://ideas.repec.org/p/boc/usug23/02.html
   My bibliography  Save this paper

iedorep: Quickly locate reproducibility failures in Stata code

Author

Listed:
  • Benjamin Daniels

    (The World Bank, Development Impact Evaluation)

Abstract

iedorep is a new Stata command in DIME Analytics ietoolkit package to check reproducibility of each line of Stata do-files. First, iedorep takes a single do-file as an argument, runs it, and stores the Stata state after each line executes. This includes the current data signature, the state of the RNG, and the state of the sort RNG. Then, it runs the do-file again, checking the state at all the same points. Finally, it reports exactly which lines (if any) have produced unstable states — quickly and accurately identifying hard-to-find reproducibility failures. This presentation will cover potential ways of using iedorep. We will discuss how it detects reproducibility errors, how it provides an efficient way to debug and check reproducibility of Stata code, and how it encourages users to write more accessible code. We will also explore how iedorep can be used in workshops and teaching activities and how it can serve as an important tool in research teams to review code and ensure project reproducibility. Finally, we will highlight areas for improvement and development challenges, such as within-loop implementation and recursive use in projects that use run or do to manage subtasks.

Suggested Citation

  • Benjamin Daniels, 2023. "iedorep: Quickly locate reproducibility failures in Stata code," 2023 Stata Conference 02, Stata Users Group.
  • Handle: RePEc:boc:usug23:02
    as

    Download full text from publisher

    File URL: http://repec.org/usug2023/US23_Daniels.pptx
    Download Restriction: no
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:boc:usug23:02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F Baum (email available below). General contact details of provider: https://edirc.repec.org/data/stataea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.