IDEAS home Printed from https://ideas.repec.org/h/eme/aecozz/s0731-9053(2011)000027a004.html
   My bibliography  Save this book chapter

The Elephant in the Corner: A Cautionary Tale about Measurement Error in Treatment Effects Models

In: Missing Data Methods: Cross-sectional Methods and Applications

Author

Listed:
  • Daniel L. Millimet

Abstract

Researchers in economics and other disciplines are often interested in the causal effect of a binary treatment on outcomes. Econometric methods used to estimate such effects are divided into one of two strands depending on whether they require unconfoundedness (i.e., independence of potential outcomes and treatment assignment conditional on a set of observable covariates). When this assumption holds, researchers now have a wide array of estimation techniques from which to choose. However, very little is known about their performance – both in absolute and relative terms – when measurement error is present. In this study, the performance of several estimators that require unconfoundedness, as well as some that do not, are evaluated in a Monte Carlo study. In all cases, the data-generating process is such that unconfoundedness holds with the ‘real’ data. However, measurement error is then introduced. Specifically, three types of measurement error are considered: (i) errors in treatment assignment, (ii) errors in the outcome, and (iii) errors in the vector of covariates. Recommendations for researchers are provided.

Suggested Citation

  • Daniel L. Millimet, 2011. "The Elephant in the Corner: A Cautionary Tale about Measurement Error in Treatment Effects Models," Advances in Econometrics, in: Missing Data Methods: Cross-sectional Methods and Applications, pages 1-39, Emerald Group Publishing Limited.
    • Handle: RePEc:eme:aecozz:s0731-9053(2011)000027a004
    DOI: 10.1108/S0731-9053(2011)000027A004
    as

    Download full text from publisher

    File URL: https://www.emerald.com/insight/content/doi/10.1108/S0731-9053(2011)000027A004/full/html?utm_source=repec&utm_medium=feed&utm_campaign=repec
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://www.emerald.com/insight/content/doi/10.1108/S0731-9053(2011)000027A004/full/epub?utm_source=repec&utm_medium=feed&utm_campaign=repec&title=10.1108/S0731-9053(2011)000027A004
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://www.emerald.com/insight/content/doi/10.1108/S0731-9053(2011)000027A004/full/pdf?utm_source=repec&utm_medium=feed&utm_campaign=repec
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://libkey.io/10.1108/S0731-9053(2011)000027A004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Scott Marchi & James Hamilton, 2006. "Assessing the Accuracy of Self-Reported Data: an Evaluation of the Toxics Release Inventory," Journal of Risk and Uncertainty, Springer, vol. 32(1), pages 57-76, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Husain, Zakir & Ghosh, Saswata & Dutta, Mousumi, 2022. "Changes in dietary practices of mother and child during the COVID-19 lockdown: Results from a household survey in Bihar, India," Food Policy, Elsevier, vol. 112(C).
    2. Gundersen, Craig & Kreider, Brent & Pepper, John, 2012. "The impact of the National School Lunch Program on child health: A nonparametric bounds analysis," Journal of Econometrics, Elsevier, vol. 166(1), pages 79-91.
    3. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    4. Susan Chen & Le Wang, 2021. "SNAP participation, diet quality, and obesity: robust evidence with estimation techniques without external instrumental variables," Empirical Economics, Springer, vol. 61(3), pages 1641-1667, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fraas, Art & Egorenkov, Alex, 2015. "A Retrospective Study of EPA’s Air Toxics Program under the Revised Section 112 Requirements of the Clean Air Act," RFF Working Paper Series dp-15-23, Resources for the Future.
    2. Louie Rivers & Tamara Dempsey & Jade Mitchell & Carole Gibbs, 2015. "Environmental Regulation and Enforcement: Structures, Processes and the Use of Data for Fraud Detection," Journal of Environmental Assessment Policy and Management (JEAPM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1-29, December.
    3. Jeremy G. Moulton & Nicholas J. Sanders & Scott A. Wentland, 2024. "Toxic Assets: How the Housing Market Responds to Environmental Information Shocks," Land Economics, University of Wisconsin Press, vol. 100(1), pages 66-88.
    4. Bauckloh, Michael Tobias & Beyer, Victor & Klein, Christian, 2022. "Does it pay to invest in dirty industries? New insights on the shunned-stock hypothesis," CFR Working Papers 22-07, University of Cologne, Centre for Financial Research (CFR).
    5. Auffhammer, Maximilian & Carson, Richard T., 2006. "Forecasting the Path of China's CO2 Emissions: Offsetting Kyoto - and Then Some," CUDARE Working Papers 7197, University of California, Berkeley, Department of Agricultural and Resource Economics.
    6. Alex Hollingsworth & Ivan Rudik, 2021. "The Effect of Leaded Gasoline on Elderly Mortality: Evidence from Regulatory Exemptions," American Economic Journal: Economic Policy, American Economic Association, vol. 13(3), pages 345-373, August.
    7. J. Scott Holladay & Lawrence D. LaPlue, 2021. "Decomposing changes in establishment‐level emissions with entry and exit," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 54(3), pages 1046-1071, November.
    8. Sitsofe Tsagbey & Miguel de Carvalho & Garritt L. Page, 2017. "All Data are Wrong, but Some are Useful? Advocating the Need for Data Auditing," The American Statistician, Taylor & Francis Journals, vol. 71(3), pages 231-235, July.
    9. Farrelly, Trisia & Tucker, Corrina, 2014. "Action research and residential waste minimisation in Palmerston North, New Zealand," Resources, Conservation & Recycling, Elsevier, vol. 91(C), pages 11-26.
    10. Philip E Hulme & Danish A Ahmed & Phillip J Haubrock & Brooks A Kaiser & Melina Kourantidou & Boris Leroy & Shana M Mcdermott, 2024. "Widespread imprecision in estimates of the economic costs of invasive alien species worldwide," Post-Print hal-04633043, HAL.
    11. Shinsuke Tanaka & Kensuke Teshima & Eric Verhoogen, 2022. "North-South Displacement Effects of Environmental Regulation: The Case of Battery Recycling," American Economic Review: Insights, American Economic Association, vol. 4(3), pages 271-288, September.
    12. Dang, Tri Vi & Wang, Youan & Wang, Zigan, 2022. "The role of financial constraints in firm investment under pollution abatement regulation," Journal of Corporate Finance, Elsevier, vol. 76(C).
    13. Matthew A. Cole & David J. Maddison & Liyun Zhang, 2020. "Testing the emission reduction claims of CDM projects using the Benford’s Law," Climatic Change, Springer, vol. 160(3), pages 407-426, June.
    14. Hannah Aoyagi & Oladele A. Ogunseitan, 2015. "Toxic Releases and Risk Disparity: A Spatiotemporal Model of Industrial Ecology and Social Empowerment," IJERPH, MDPI, vol. 12(6), pages 1-19, June.
    15. De Silva, Dakshina G. & McComb, Robert P. & Schiller, Anita R. & Slechten, Aurelie, 2021. "Firm behavior and pollution in small geographies," European Economic Review, Elsevier, vol. 136(C).
    16. Zou, Eric, 2017. "Unwatched Pollution: The Effect of Incomplete Monitoring on Air Quality," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258274, Agricultural and Applied Economics Association.
    17. John Morrow, 2014. "Benford's Law, Families of Distributions and a Test Basis," CEP Discussion Papers dp1291, Centre for Economic Performance, LSE.
    18. Thomas Stoerk, 2015. "Statistical corruption in Beijing’s air quality data has likely ended in 2012," GRI Working Papers 194, Grantham Research Institute on Climate Change and the Environment.
    19. John Xuefeng Jiang & Jing Kong, 2024. "Green dies in darkness? environmental externalities of newspaper closures," Review of Accounting Studies, Springer, vol. 29(4), pages 3564-3599, December.
    20. Janet Currie, 2011. "Ungleichheiten bei der Geburt: Einige Ursachen und Folgen," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(s1), pages 42-65, May.

    More about this item

    Keywords

    Treatment effects; propensity score; unconfoundedness; selection on observables; measurement error;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eme:aecozz:s0731-9053(2011)000027a004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emerald Support (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.