IDEAS home Printed from https://ideas.repec.org/h/eme/aecozz/s0731-9053(2011)000027a004.html
   My bibliography  Save this book chapter

The Elephant in the Corner: A Cautionary Tale about Measurement Error in Treatment Effects Models

In: Missing Data Methods: Cross-sectional Methods and Applications

Author

Listed:
  • Daniel L. Millimet

Abstract

Researchers in economics and other disciplines are often interested in the causal effect of a binary treatment on outcomes. Econometric methods used to estimate such effects are divided into one of two strands depending on whether they require unconfoundedness (i.e., independence of potential outcomes and treatment assignment conditional on a set of observable covariates). When this assumption holds, researchers now have a wide array of estimation techniques from which to choose. However, very little is known about their performance – both in absolute and relative terms – when measurement error is present. In this study, the performance of several estimators that require unconfoundedness, as well as some that do not, are evaluated in a Monte Carlo study. In all cases, the data-generating process is such that unconfoundedness holds with the ‘real’ data. However, measurement error is then introduced. Specifically, three types of measurement error are considered: (i) errors in treatment assignment, (ii) errors in the outcome, and (iii) errors in the vector of covariates. Recommendations for researchers are provided.

Suggested Citation

  • Daniel L. Millimet, 2011. "The Elephant in the Corner: A Cautionary Tale about Measurement Error in Treatment Effects Models," Advances in Econometrics, in: Missing Data Methods: Cross-sectional Methods and Applications, pages 1-39, Emerald Group Publishing Limited.
    • Handle: RePEc:eme:aecozz:s0731-9053(2011)000027a004
    DOI: 10.1108/S0731-9053(2011)000027A004
    as

    Download full text from publisher

    File URL: https://www.emerald.com/insight/content/doi/10.1108/S0731-9053(2011)000027A004/full/html?utm_source=repec&utm_medium=feed&utm_campaign=repec
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://www.emerald.com/insight/content/doi/10.1108/S0731-9053(2011)000027A004/full/epub?utm_source=repec&utm_medium=feed&utm_campaign=repec&title=10.1108/S0731-9053(2011)000027A004
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://www.emerald.com/insight/content/doi/10.1108/S0731-9053(2011)000027A004/full/pdf?utm_source=repec&utm_medium=feed&utm_campaign=repec
    Download Restriction: Access to full text is restricted to subscribers
    File URL: https://libkey.io/10.1108/S0731-9053(2011)000027A004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Scott Marchi & James Hamilton, 2006. "Assessing the Accuracy of Self-Reported Data: an Evaluation of the Toxics Release Inventory," Journal of Risk and Uncertainty, Springer, vol. 32(1), pages 57-76, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Susan Chen & Le Wang, 2021. "SNAP participation, diet quality, and obesity: robust evidence with estimation techniques without external instrumental variables," Empirical Economics, Springer, vol. 61(3), pages 1641-1667, September.
    2. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    3. Gundersen, Craig & Kreider, Brent & Pepper, John, 2012. "The impact of the National School Lunch Program on child health: A nonparametric bounds analysis," Journal of Econometrics, Elsevier, vol. 166(1), pages 79-91.
    4. Husain, Zakir & Ghosh, Saswata & Dutta, Mousumi, 2022. "Changes in dietary practices of mother and child during the COVID-19 lockdown: Results from a household survey in Bihar, India," Food Policy, Elsevier, vol. 112(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fraas, Art & Egorenkov, Alex, 2015. "A Retrospective Study of EPA’s Air Toxics Program under the Revised Section 112 Requirements of the Clean Air Act," RFF Working Paper Series dp-15-23, Resources for the Future.
    2. Auffhammer, Maximilian & Carson, Richard T., 2008. "Forecasting the path of China's CO2 emissions using province-level information," Journal of Environmental Economics and Management, Elsevier, vol. 55(3), pages 229-247, May.
    3. Louie Rivers & Tamara Dempsey & Jade Mitchell & Carole Gibbs, 2015. "Environmental Regulation and Enforcement: Structures, Processes and the Use of Data for Fraud Detection," Journal of Environmental Assessment Policy and Management (JEAPM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1-29, December.
    4. H. Spencer Banzhaf & Randall P. Walsh, 2010. "Segregation and Tiebout Sorting: Investigating the Link between Investments in Public Goods and Neighborhood Tipping," NBER Working Papers 16057, National Bureau of Economic Research, Inc.
    5. Nilanjana Dutt & Andrew A. King, 2014. "The Judgment of Garbage: End-of-Pipe Treatment and Waste Reduction," Management Science, INFORMS, vol. 60(7), pages 1812-1828, July.
    6. Jeremy G. Moulton & Nicholas J. Sanders & Scott A. Wentland, 2024. "Toxic Assets: How the Housing Market Responds to Environmental Information Shocks," Land Economics, University of Wisconsin Press, vol. 100(1), pages 66-88.
    7. Bauckloh, Michael Tobias & Beyer, Victor & Klein, Christian, 2022. "Does it pay to invest in dirty industries? New insights on the shunned-stock hypothesis," CFR Working Papers 22-07, University of Cologne, Centre for Financial Research (CFR).
    8. Lee, Kang-Bok & Han, Sumin & Jeong, Yeasung, 2020. "COVID-19, flattening the curve, and Benford’s law," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 559(C).
    9. Kishore Singh & Peter Best, 2020. "Implementing Benford’s Law in Continuous Monitoring Applications," Journal of Accounting and Management Information Systems, Faculty of Accounting and Management Information Systems, The Bucharest University of Economic Studies, vol. 19(2), pages 379-404, June.
    10. Auffhammer, Maximilian & Carson, Richard T., 2006. "Forecasting the Path of China's CO2 Emissions: Offsetting Kyoto - and Then Some," CUDARE Working Papers 7197, University of California, Berkeley, Department of Agricultural and Resource Economics.
    11. Nathan Cooper & Donna Green & Katrin J. Meissner, 2017. "The Australian National Pollutant Inventory Fails to Fulfil Its Legislated Goals," IJERPH, MDPI, vol. 14(5), pages 1-18, May.
    12. Alex Hollingsworth & Ivan Rudik, 2021. "The Effect of Leaded Gasoline on Elderly Mortality: Evidence from Regulatory Exemptions," American Economic Journal: Economic Policy, American Economic Association, vol. 13(3), pages 345-373, August.
    13. J. Scott Holladay & Lawrence D. LaPlue, 2021. "Decomposing changes in establishment‐level emissions with entry and exit," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 54(3), pages 1046-1071, November.
    14. Goeschl, Timo & Oestreich, Marcel & Soldà, Alice, 2021. "Competitive vs. Random Audit Mechanisms in Environmental Regulation: Emissions, Self-Reporting, and the Role of Peer Information," Working Papers 0699, University of Heidelberg, Department of Economics.
    15. Luca Berchicci & Murat Tarakci, 2022. "Aspiration formation and attention rules," Strategic Management Journal, Wiley Blackwell, vol. 43(8), pages 1575-1601, August.
    16. Sitsofe Tsagbey & Miguel de Carvalho & Garritt L. Page, 2017. "All Data are Wrong, but Some are Useful? Advocating the Need for Data Auditing," The American Statistician, Taylor & Francis Journals, vol. 71(3), pages 231-235, July.
    17. Janet Currie & Lucas Davis & Michael Greenstone & Reed Walker, 2013. "Do Housing Prices Reflect Environmental Health Risks? Evidence From More Than 1600 Toxic Plant Openings And Closings," Working Papers 13-14, Center for Economic Studies, U.S. Census Bureau.
    18. Farrelly, Trisia & Tucker, Corrina, 2014. "Action research and residential waste minimisation in Palmerston North, New Zealand," Resources, Conservation & Recycling, Elsevier, vol. 91(C), pages 11-26.
    19. Philip E Hulme & Danish A Ahmed & Phillip J Haubrock & Brooks A Kaiser & Melina Kourantidou & Boris Leroy & Shana M Mcdermott, 2024. "Widespread imprecision in estimates of the economic costs of invasive alien species worldwide," Post-Print hal-04633043, HAL.
    20. Jacqz, Irene, 2022. "Toxic test scores: The impact of chemical releases on standardized test performance within U.S. schools," Journal of Environmental Economics and Management, Elsevier, vol. 115(C).

    More about this item

    Keywords

    Treatment effects; propensity score; unconfoundedness; selection on observables; measurement error;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eme:aecozz:s0731-9053(2011)000027a004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emerald Support (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.