IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v98y2012i1p19-33.html
   My bibliography  Save this article

Improving consumption measurement and other survey data through CAPI: Evidence from a randomized experiment

Author

Listed:
  • Caeyers, Bet
  • Chalmers, Neil
  • De Weerdt, Joachim

Abstract

This paper reports on a randomized survey experiment among 1840 households, designed to compare pen-and-paper interviewing (PAPI) to computer-assisted personal interviewing (CAPI). We find that PAPI data contain a large number of errors, which can be avoided in CAPI. Error counts are not randomly distributed across the sample, but are correlated with household characteristics, potentially introducing sample bias if dubious observations need to be dropped. We demonstrate a tendency for the spread of total measured consumption to be higher on paper compared to CAPI, translating into significantly higher measured inequality. Investigating further the nature of PAPI's measurement error for consumption, we fail to reject the hypothesis that it is classical: it attenuates the coefficient on consumption when used as explanatory variable and we find no evidence of bias when consumption is used as dependent variable. Finally, CAPI and PAPI are compared in terms of interview length, costs and respondents' perceptions.

Suggested Citation

  • Caeyers, Bet & Chalmers, Neil & De Weerdt, Joachim, 2012. "Improving consumption measurement and other survey data through CAPI: Evidence from a randomized experiment," Journal of Development Economics, Elsevier, vol. 98(1), pages 19-33.
  • Handle: RePEc:eee:deveco:v:98:y:2012:i:1:p:19-33
    DOI: 10.1016/j.jdeveco.2011.12.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387811001167
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2011.12.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrew Chesher & Christian Schluter, 2002. "Welfare Measurement and Measurement Error," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 69(2), pages 357-378.
    2. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    3. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    4. Edith de Leeuw & William Nicholls II, 1996. "Technological Innovations in Data Collection: Acceptance, Data Quality and Costs," Sociological Research Online, , vol. 1(4), pages 23-37, December.
    5. Bart Capéau & Stefan Dercon, 2006. "Prices, Unit Values and Local Measurement Units in Rural Surveys: an Econometric Approach with an Application to Poverty Measurement in Ethiopia," Journal of African Economies, Centre for the Study of African Economies, vol. 15(2), pages 181-211, June.
    6. Fafchamps, Marcel & McKenzie, David & Quinn, Simon & Woodruff, Christopher, 2012. "Using PDA consistency checks to increase the precision of profits and sales measurement in panels," Journal of Development Economics, Elsevier, vol. 98(1), pages 51-57.
    7. Fafchamps, Marcel & McKenzie, David & Quinn, Simon & Woodruff, Christopher, 2012. "Using PDA consistency checks to increase the precision of profits and sales measurement in panels," Journal of Development Economics, Elsevier, vol. 98(1), pages 51-57.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicoletti, Cheti & Peracchi, Franco & Foliano, Francesca, 2011. "Estimating Income Poverty in the Presence of Missing Data and Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 61-72.
    2. García-Suaza, A & Lobo, J & Montoya, S & Ordóñez, J & Oviedo, J. D, 2022. "Impact of the collection mode on labor income data. A study in the times of COVID19," Documentos de Trabajo 20396, Universidad del Rosario.
    3. John Abowd & Martha Stinson, 2011. "Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data," Working Papers 11-20, Center for Economic Studies, U.S. Census Bureau.
    4. Peter Gottschalk & Minh Huynh, 2010. "Are Earnings Inequality and Mobility Overstated? The Impact of Nonclassical Measurement Error," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 302-315, May.
    5. Stella Martin & Kevin Stabenow & Mark Trede, 2024. "Measurement Error in Earnings," CQE Working Papers 10824, Center for Quantitative Economics (CQE), University of Muenster.
    6. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    7. Ingrid Woolard & Stephan Klasen, 2005. "Determinants of Income Mobility and Household Poverty Dynamics in South Africa," Journal of Development Studies, Taylor & Francis Journals, vol. 41(5), pages 865-897.
    8. Lisa M. Dragoset & Gary S. Fields, 2006. "U.S. Earnings Mobility: Comparing Survey-Based and Administrative-Based Estimates," Working Papers 55, ECINEQ, Society for the Study of Economic Inequality.
    9. Meghir, Costas & Pistaferri, Luigi, 2011. "Earnings, Consumption and Life Cycle Choices," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 9, pages 773-854, Elsevier.
    10. Ana Cinta G. Cabral & Norman Gemmell & Nazila Alinaghi, 2021. "Are survey-based self-employment income underreporting estimates biased? New evidence from matched register and survey data," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 28(2), pages 284-322, April.
    11. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.
    12. D. O'Neill & Sweetman. O. & Van de gaer D., 2005. "The Consequences of Non-Classical Measurement Error for Distributional Analysis," Economics Department Working Paper Series n1490205, Department of Economics, National University of Ireland - Maynooth.
    13. Yingyao Hu & Geert Ridder, 2012. "Estimation of nonlinear models with mismeasured regressors using marginal information," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(3), pages 347-385, April.
    14. Hu, Yingyao & Schennach, Susanne & Shiu, Ji-Liang, 2022. "Identification of nonparametric monotonic regression models with continuous nonclassical measurement errors," Journal of Econometrics, Elsevier, vol. 226(2), pages 269-294.
    15. Daniel Wilhelm, 2018. "Testing for the presence of measurement error," CeMMAP working papers CWP45/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. Francisca Antman & David McKenzie, 2007. "Poverty traps and nonlinear income dynamics with measurement error and individual heterogeneity," Journal of Development Studies, Taylor & Francis Journals, vol. 43(6), pages 1057-1083.
    17. Stüber, Heiko & Grabka, Markus M. & Schnitzlein, Daniel D., 2023. "A tale of two data sets: comparing German administrative and survey data using wage inequality as an example," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 57, pages 1-8.
    18. Costas Meghir & Luigi Pistaferri, 2004. "Income Variance Dynamics and Heterogeneity," Econometrica, Econometric Society, vol. 72(1), pages 1-32, January.
    19. John Gibson & Kathleen Beegle & Joachim De Weerdt & Jed Friedman, 2015. "What does Variation in Survey Design Reveal about the Nature of Measurement Errors in Household Consumption?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(3), pages 466-474, June.
    20. Donal O'Neill, 2015. "Correcting for Self-Reporting Bias in BMI: A Multiple Imputation Approach," Economics Department Working Paper Series n263-15.pdf, Department of Economics, National University of Ireland - Maynooth.

    More about this item

    Keywords

    CAPI; Household surveys; Consumption measurement; Measurement error;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:98:y:2012:i:1:p:19-33. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.