IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp5140.html
   My bibliography  Save this paper

The Elephant in the Corner: A Cautionary Tale about Measurement Error in Treatment Effects Models

Author

Listed:
  • Millimet, Daniel L.

    (Southern Methodist University)

Abstract

Researchers in economics and other disciplines are often interested in the causal effect of a binary treatment on outcomes. Econometric methods used to estimate such effects are divided into one of two strands depending on whether they require the conditional independence assumption (i.e., independence of potential outcomes and treatment assignment conditional on a set of observable covariates). When this assumption holds, researchers now have a wide array of estimation techniques from which to choose. However, very little is known about their performance – both in absolute and relative terms – when measurement error is present. In this study, the performance of several estimators that require the conditional independence assumption, as well as some that do not, are evaluated in a Monte Carlo study. In all cases, the data-generating process is such that conditional independence holds with the 'real' data. However, measurement error is then introduced. Specifically, three types of measurement error are considered: (i) errors in treatment assignment, (ii) errors in the outcome, and (iii) errors in the vector of covariates. Recommendations for researchers are provided.

Suggested Citation

  • Millimet, Daniel L., 2010. "The Elephant in the Corner: A Cautionary Tale about Measurement Error in Treatment Effects Models," IZA Discussion Papers 5140, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp5140
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp5140.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Scott Marchi & James Hamilton, 2006. "Assessing the Accuracy of Self-Reported Data: an Evaluation of the Toxics Release Inventory," Journal of Risk and Uncertainty, Springer, vol. 32(1), pages 57-76, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Husain, Zakir & Ghosh, Saswata & Dutta, Mousumi, 2022. "Changes in dietary practices of mother and child during the COVID-19 lockdown: Results from a household survey in Bihar, India," Food Policy, Elsevier, vol. 112(C).
    2. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    3. Susan Chen & Le Wang, 2021. "SNAP participation, diet quality, and obesity: robust evidence with estimation techniques without external instrumental variables," Empirical Economics, Springer, vol. 61(3), pages 1641-1667, September.
    4. Gundersen, Craig & Kreider, Brent & Pepper, John, 2012. "The impact of the National School Lunch Program on child health: A nonparametric bounds analysis," Journal of Econometrics, Elsevier, vol. 166(1), pages 79-91.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fraas, Art & Egorenkov, Alex, 2015. "A Retrospective Study of EPA’s Air Toxics Program under the Revised Section 112 Requirements of the Clean Air Act," RFF Working Paper Series dp-15-23, Resources for the Future.
    2. Louie Rivers & Tamara Dempsey & Jade Mitchell & Carole Gibbs, 2015. "Environmental Regulation and Enforcement: Structures, Processes and the Use of Data for Fraud Detection," Journal of Environmental Assessment Policy and Management (JEAPM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1-29, December.
    3. Alex Hollingsworth & Ivan Rudik, 2021. "The Effect of Leaded Gasoline on Elderly Mortality: Evidence from Regulatory Exemptions," American Economic Journal: Economic Policy, American Economic Association, vol. 13(3), pages 345-373, August.
    4. Sitsofe Tsagbey & Miguel de Carvalho & Garritt L. Page, 2017. "All Data are Wrong, but Some are Useful? Advocating the Need for Data Auditing," The American Statistician, Taylor & Francis Journals, vol. 71(3), pages 231-235, July.
    5. Shinsuke Tanaka & Kensuke Teshima & Eric Verhoogen, 2022. "North-South Displacement Effects of Environmental Regulation: The Case of Battery Recycling," American Economic Review: Insights, American Economic Association, vol. 4(3), pages 271-288, September.
    6. Dang, Tri Vi & Wang, Youan & Wang, Zigan, 2022. "The role of financial constraints in firm investment under pollution abatement regulation," Journal of Corporate Finance, Elsevier, vol. 76(C).
    7. Hannah Aoyagi & Oladele A. Ogunseitan, 2015. "Toxic Releases and Risk Disparity: A Spatiotemporal Model of Industrial Ecology and Social Empowerment," IJERPH, MDPI, vol. 12(6), pages 1-19, June.
    8. De Silva, Dakshina G. & McComb, Robert P. & Schiller, Anita R. & Slechten, Aurelie, 2021. "Firm behavior and pollution in small geographies," European Economic Review, Elsevier, vol. 136(C).
    9. Thomas Stoerk, 2015. "Statistical corruption in Beijing’s air quality data has likely ended in 2012," GRI Working Papers 194, Grantham Research Institute on Climate Change and the Environment.
    10. John Xuefeng Jiang & Jing Kong, 2024. "Green dies in darkness? environmental externalities of newspaper closures," Review of Accounting Studies, Springer, vol. 29(4), pages 3564-3599, December.
    11. Janet Currie, 2011. "Ungleichheiten bei der Geburt: Einige Ursachen und Folgen," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(s1), pages 42-65, May.
    12. Alm, James & Shimshack, Jay, 2014. "Environmental Enforcement and Compliance: Lessons from Pollution, Safety, and Tax Settings," Foundations and Trends(R) in Microeconomics, now publishers, vol. 10(4), pages 209-274, December.
    13. Sunzenauer, Paul, 2024. "How Sustainable Is Private Equity? Unlocking the Impact of Private Equity on Asset-Level Sustainability: An Empirical Investigation," Junior Management Science (JUMS), Junior Management Science e. V., vol. 9(1), pages 1100-1122.
    14. J. Scott Holladay, 2016. "Exporters and the environment," Canadian Journal of Economics, Canadian Economics Association, vol. 49(1), pages 147-172, February.
    15. Arthur J. Caplan, 2023. "Missing the Warning Signs? The Case of “Yellow Air Day” Advisories in Northern Utah," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 85(2), pages 479-522, June.
    16. Donna Ramirez Harrington & George Deltas & Madhu Khanna, 2014. "Does Pollution Prevention Reduce Toxic Releases? A Dynamic Panel Data Model," Land Economics, University of Wisconsin Press, vol. 90(2), pages 199-221.
    17. Pat Akey & Ian Appel, 2021. "The Limits of Limited Liability: Evidence from Industrial Pollution," Journal of Finance, American Finance Association, vol. 76(1), pages 5-55, February.
    18. Morrow, John, 2014. "Benford's Law, families of distributions and a test basis," LSE Research Online Documents on Economics 60364, London School of Economics and Political Science, LSE Library.
    19. Auffhammer, Maximilian & Carson, Richard T., 2008. "Forecasting the path of China's CO2 emissions using province-level information," Journal of Environmental Economics and Management, Elsevier, vol. 55(3), pages 229-247, May.
    20. Nilanjana Dutt & Andrew A. King, 2014. "The Judgment of Garbage: End-of-Pipe Treatment and Waste Reduction," Management Science, INFORMS, vol. 60(7), pages 1812-1828, July.

    More about this item

    Keywords

    measurement error; selection on observables; propensity score; unconfoundedness; treatment effects;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp5140. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.