IDEAS home Printed from https://ideas.repec.org/a/wly/soecon/v86y2019i1p230-253.html
   My bibliography  Save this article

Misreporting of Government Transfers: How Important Are Survey Design and Geography?

Author

Listed:
  • Bruce D. Meyer
  • Nikolas Mittag

Abstract

Recent studies linking household surveys to administrative records reveal high rates of misreporting of program receipt. We use the FoodAPS survey to examine whether the findings of these studies of general household surveys using one or two states generalize to a survey with a narrow focus and across many states. First, we study how reporting errors differ from other surveys. We find a lower rate of false negatives (failures to report true receipt) in FoodAPS, likely partly due to the shorter recall period of FoodAPS. Misreporting varies with household characteristics and between interviewers. Second, we examine geographic heterogeneity in survey error to assess whether we can extrapolate from linked data from a few states. We find systematic differences between states in unconditional error rates but no evidence of substantial differences conditional on common covariates. Thus, extrapolating error rates across states may yield more accurate receipt estimates than uncorrected survey estimates.

Suggested Citation

  • Bruce D. Meyer & Nikolas Mittag, 2019. "Misreporting of Government Transfers: How Important Are Survey Design and Geography?," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 230-253, July.
  • Handle: RePEc:wly:soecon:v:86:y:2019:i:1:p:230-253
    DOI: 10.1002/soej.12366
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/soej.12366
    Download Restriction: no

    File URL: https://libkey.io/10.1002/soej.12366?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bruce D. Meyer & Nikolas Mittag, 2019. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness, and Holes in the Safety Net," American Economic Journal: Applied Economics, American Economic Association, vol. 11(2), pages 176-204, April.
    2. Bruce Meyer & Robert Goerge, 2011. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," Working Papers 11-14, Center for Economic Studies, U.S. Census Bureau.
    3. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2015. "Household Surveys in Crisis," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 199-226, Fall.
    4. Charles Courtemanche & Augustine Denteh & Rusty Tchernis, 2019. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 202-228, July.
    5. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    6. Benjamin Cerf Harris, 2014. "Within and Across County Variation in SNAP Misreporting: Evidence from Linked ACS and Administrative Records," CARRA Working Papers 2014-05, Center for Economic Studies, U.S. Census Bureau.
    7. J. B. Copas & F. J. Hilton, 1990. "Record Linkage: Statistical Models for Matching Computer Records," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 153(3), pages 287-312, May.
    8. Nikolas Mittag, 2019. "Correcting for Misreporting of Government Benefits," American Economic Journal: Economic Policy, American Economic Association, vol. 11(2), pages 142-164, May.
    9. Meyer, Bruce D. & Mittag, Nikolas & Goerge, Robert M., 2018. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," IZA Discussion Papers 11776, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Olbrich, Lukas & Kosyakova, Yuliya & Sakshaug, Joseph W., 2022. "The reliability of adult self-reported height: The role of interviewers," Economics & Human Biology, Elsevier, vol. 45(C).
    2. Coleman-Jensen, Alisha & Rabbitt, Matthew P & Gregory, Christian A & Singh, Anita, 2021. "Household Food Security in the United States in 2020," Economic Research Report 327186, United States Department of Agriculture, Economic Research Service.
    3. Ha Trong Nguyen & Huong Thu Le & Luke Connelly & Francis Mitrou, 2023. "Accuracy of self‐reported private health insurance coverage," Health Economics, John Wiley & Sons, Ltd., vol. 32(12), pages 2709-2729, December.
    4. Rabbitt, Matthew P. & Hales, Laura J. & Burke, Michael P. & Coleman-Jensen, Alisha, 2023. "Household Food Security in the United States in 2022," Economic Research Report 338945, United States Department of Agriculture, Economic Research Service.
    5. Otto Lenhart, 2023. "The earned income tax credit and food insecurity," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(5), pages 1543-1570, October.
    6. Coleman-Jensen, Alisha & Rabbitt, Matthew & Gregory, Christian & Singh, Anita, 2022. "Household Food Security in the United States in 2021," Amber Waves:The Economics of Food, Farming, Natural Resources, and Rural America, United States Department of Agriculture, Economic Research Service, vol. 2022(Economic ), September.
    7. Seung Jin Cho, 2022. "The effect of aging out of the Women, Infants, and Children (WIC) program on food insecurity," Health Economics, John Wiley & Sons, Ltd., vol. 31(4), pages 664-685, April.
    8. Pablo A. Celhay & Bruce D. Meyer & Nikolas Mittag, 2022. "What Leads to Measurement Errors? Evidence from Reports of Program Participation in Three Surveys," NBER Working Papers 29652, National Bureau of Economic Research, Inc.
    9. Marianne P. Bitler & Christian Gregory, 2019. "Food Access, Program Participation, and Health: Research Using FoodAPS," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 9-17, July.
    10. Celhay, Pablo & Meyer, Bruce D. & Mittag, Nikolas, 2024. "What leads to measurement errors? Evidence from reports of program participation in three surveys," Journal of Econometrics, Elsevier, vol. 238(2).
    11. Coleman-Jensen, Alisha & Rabbitt, Matthew & Gregory, Christian & Singh, Anita, 2022. "Household Food Security in the United States in 2021," Amber Waves:The Economics of Food, Farming, Natural Resources, and Rural America, United States Department of Agriculture, Economic Research Service, vol. 2022(Economic ), September.
    12. Coleman-Jensen, Alisha & Rabbitt, Matthew P & Gregory, Christian A & Singh, Anita, 2020. "Household Food Security in the United States in 2019," Economic Research Report 327207, United States Department of Agriculture, Economic Research Service.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meyer, Bruce D. & Mittag, Nikolas, 2018. "Misreporting of Government Transfers: How Important Are Survey Design and Geography?," IZA Discussion Papers 12038, Institute of Labor Economics (IZA).
    2. James X. Sullivan, 2020. "A Cautionary Tale of Using Data From the Tail," Demography, Springer;Population Association of America (PAA), vol. 57(6), pages 2361-2368, December.
    3. Charles Courtemanche & Augustine Denteh & Rusty Tchernis, 2019. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 202-228, July.
    4. Colleen Heflin & Michah W. Rothbart & Mattie Mackenzie-Liu, 2022. "Below the Tip of the Iceberg: Examining Early Childhood Participation in SNAP and TANF from Birth to Age Six," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 41(2), pages 729-755, April.
    5. Ha Trong Nguyen & Huong Thu Le & Luke Connelly & Francis Mitrou, 2023. "Accuracy of self‐reported private health insurance coverage," Health Economics, John Wiley & Sons, Ltd., vol. 32(12), pages 2709-2729, December.
    6. Bruce D. Meyer & Nikolas Mittag, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," NBER Working Papers 25738, National Bureau of Economic Research, Inc.
    7. Celhay, Pablo & Meyer, Bruce D. & Mittag, Nikolas, 2024. "What leads to measurement errors? Evidence from reports of program participation in three surveys," Journal of Econometrics, Elsevier, vol. 238(2).
    8. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    9. Mark Brooks & Rattiya S. Lippe & Hermann Waibel, 2020. "Comprehensive data quality studies as a component of poverty assessments," TVSEP Working Papers wp-019, Leibniz Universitaet Hannover, Institute of Development and Agricultural Economics, Project TVSEP.
    10. Meyer, Bruce D. & Mittag, Nikolas, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," IZA Discussion Papers 12266, Institute of Labor Economics (IZA).
    11. Bruckmeier, Kerstin & Riphahn, Regina T. & Wiemers, Jürgen, 2019. "Benefit underreporting in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," IAB-Discussion Paper 201906, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    12. Vitor Possebom, 2021. "Crime and Mismeasured Punishment: Marginal Treatment Effect with Misclassification," Papers 2106.00536, arXiv.org, revised Jul 2023.
    13. Martijn van Hasselt & Christopher R. Bollinger & Jeremy W. Bray, 2022. "A Bayesian approach to account for misclassification in prevalence and trend estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 351-367, March.
    14. Bronchetti, Erin T. & Christensen, Garret & Hoynes, Hilary W., 2019. "Local food prices, SNAP purchasing power, and child health," Journal of Health Economics, Elsevier, vol. 68(C).
    15. Meyer, Bruce D. & Mittag, Nikolas, 2021. "An empirical total survey error decomposition using data combination," Journal of Econometrics, Elsevier, vol. 224(2), pages 286-305.
    16. Brooks, Mark & Lippe, Rattiya S. & Waibel, Hermann, 2021. "PAPI is gone, but errors remain: Non-sampling errors in household surveys," 2021 Conference, August 17-31, 2021, Virtual 315277, International Association of Agricultural Economists.
    17. Meyer, Bruce D. & Mittag, Nikolas, 2017. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," IZA Discussion Papers 10943, Institute of Labor Economics (IZA).
    18. Adam Bee & Joshua Mitchell & Nikolas Mittag & Jonathan Rothbaum & Carl Sanders & Lawrence Schmidt & Matthew Unrath, 2023. "National Experimental Wellbeing Statistics - Version 1," Working Papers 23-04, Center for Economic Studies, U.S. Census Bureau.
    19. Pourya Valizadeh & Travis A Smith, 2020. "How Did The American Recovery and Reinvestment Act Affect the Material Well‐Being of SNAP Participants? A Distributional Approach," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 42(3), pages 455-476, September.
    20. Kerstin Bruckmeier & Regina T. Riphahn & Jürgen Wiemers, 2021. "Misreporting of program take-up in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," Empirical Economics, Springer, vol. 61(3), pages 1567-1616, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:soecon:v:86:y:2019:i:1:p:230-253. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2325-8012 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.