IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v35y2019i3p599-624n5.html
   My bibliography  Save this article

Imprecise Imputation: A Nonparametric Micro Approach Reflecting the Natural Uncertainty of Statistical Matching with Categorical Data

Author

Listed:
  • Endres Eva

    (Ludwig-Maximilians-University of Munich, Ludwigstrasse 33, 80539Munich, Germany.)

  • Fink Paul

    (Ludwig-Maximilians-University of Munich, Ludwigstrasse 33, 80539Munich, Germany.)

  • Augustin Thomas

    (Ludwig-Maximilians-University of Munich, Ludwigstrasse 33, 80539Munich, Germany.)

Abstract

Statistical matching is the term for the integration of two or more data files that share a partially overlapping set of variables. Its aim is to obtain joint information on variables collected in different surveys based on different observation units. This naturally leads to an identification problem, since there is no observation that contains information on all variables of interest.We develop the first statistical matching micro approach reflecting the natural uncertainty of statistical matching arising from the identification problem in the context of categorical data. A complete synthetic file is obtained by imprecise imputation, replacing missing entries by sets of suitable values. Altogether, we discuss three imprecise imputation strategies and propose ideas for potential refinements.Additionally, we show how the results of imprecise imputation can be embedded into the theory of finite random sets, providing tight lower and upper bounds for probability statements. The results based on a newly developed simulation design–which is customised to the specific requirements for assessing the quality of a statistical matching procedure for categorical data–corroborate that the narrowness of these bounds is practically relevant and that these bounds almost always cover the true parameters.

Suggested Citation

  • Endres Eva & Fink Paul & Augustin Thomas, 2019. "Imprecise Imputation: A Nonparametric Micro Approach Reflecting the Natural Uncertainty of Statistical Matching with Categorical Data," Journal of Official Statistics, Sciendo, vol. 35(3), pages 599-624, September.
    • Handle: RePEc:vrs:offsta:v:35:y:2019:i:3:p:599-624:n:5
    DOI: 10.2478/jos-2019-0025
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2019-0025
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2019-0025?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Conti, Pier Luigi & Marella, Daniela & Scanu, Mauro, 2008. "Evaluation of matching noise for imputation techniques based on nonparametric local linear regression estimators," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 354-365, December.
    2. Rebecca R. Andridge & Roderick J. A. Little, 2010. "A Review of Hot Deck Imputation for Survey Non‐response," International Statistical Review, International Statistical Institute, vol. 78(1), pages 40-64, April.
    3. Pier Luigi Conti & Daniela Marella & Mauro Scanu, 2017. "How far from identifiability? A systematic overview of the statistical matching problem in a non parametric framework," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 46(2), pages 967-994, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicklas Pettersson, 2013. "Bias reduction of finite population imputation by kernel methods," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 14(1), pages 139-160, March.
    2. Riccardo D’Alberto & Matteo Zavalloni & Meri Raggi & Davide Viaggi, 2018. "AES Impact Evaluation With Integrated Farm Data: Combining Statistical Matching and Propensity Score Matching," Sustainability, MDPI, vol. 10(11), pages 1-24, November.
    3. Raymundo M. Campos-Vázquez, 2013. "Efectos de los ingresos no reportados en el nivel y tendencia de la pobreza laboral en México," Ensayos Revista de Economia, Universidad Autonoma de Nuevo Leon, Facultad de Economia, vol. 0(2), pages 23-54, November.
    4. Paul T. von Hippel, 2013. "Should a Normal Imputation Model be Modified to Impute Skewed Variables?," Sociological Methods & Research, , vol. 42(1), pages 105-138, February.
    5. Siedschlag Iulia & Kaitila Ville & McQuinn John & Zhang Xiaoheng, 2014. "International Investment and Firm Performance: Empirical Evidence from Small Open Economies," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 234(6), pages 662-687, December.
    6. Miller, Elizabeth A. & Paschall, Katherine W. & Azar, Sandra T., 2017. "Latent classes of older foster youth: Prospective associations with outcomes and exits from the foster care system during the transition to adulthood," Children and Youth Services Review, Elsevier, vol. 79(C), pages 495-505.
    7. Meyer, Bruce D. & Mittag, Nikolas, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," IZA Discussion Papers 12266, Institute of Labor Economics (IZA).
    8. Nancy, Jane Y. & Khanna, Nehemiah H. & Arputharaj, Kannan, 2017. "Imputing missing values in unevenly spaced clinical time series data to build an effective temporal classification framework," Computational Statistics & Data Analysis, Elsevier, vol. 112(C), pages 63-79.
    9. D'Alberto, Riccardo & Zavalloni, Matteo & Raggi, Meri & Viaggi, Davide, 2021. "A Statistical Matching approach to reproduce the heterogeneity of willingness to pay in benefit transfer," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    10. Thomas Masterson & Kijong Kim & Fernando Rios-Avila, 2016. "Simulations of Employment for Individuals in LIMTCP Consumption-poor Households in Tanzania and Ghana, 2012," Economics Working Paper Archive wp_871, Levy Economics Institute.
    11. McDonough, Ian K. & Millimet, Daniel L., 2017. "Missing data, imputation, and endogeneity," Journal of Econometrics, Elsevier, vol. 199(2), pages 141-155.
    12. Hamrick, Karen S., 2012. "Nonresponse Bias Analysis of Body Mass Index in the Eating and Health Module," Technical Bulletins 184303, United States Department of Agriculture, Economic Research Service.
    13. Ahfock, Daniel & Pyne, Saumyadipta & McLachlan, Geoffrey J., 2022. "Statistical file-matching of non-Gaussian data: A game theoretic approach," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    14. Lingyun Lyu & Yu Cheng & Abdus S. Wahed, 2023. "Imputation‐based Q‐learning for optimizing dynamic treatment regimes with right‐censored survival outcome," Biometrics, The International Biometric Society, vol. 79(4), pages 3676-3689, December.
    15. Yijie Xue & Nicole Lazar, 2012. "Empirical likelihood-based hot deck imputation methods," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(3), pages 629-646.
    16. Marcello D’Orazio, 2015. "Integration and imputation of survey data in R: the StatMatch package," Romanian Statistical Review, Romanian Statistical Review, vol. 63(2), pages 57-68, June.
    17. Zhong, Hua & Hu, Wuyang, 2015. "Farmers’ Willingness to Engage in Best Management Practices: an Application of Multiple Imputation," 2015 Annual Meeting, January 31-February 3, 2015, Atlanta, Georgia 196962, Southern Agricultural Economics Association.
    18. Thomas Masterson, 2014. "Quality of Statistical Match and Employment Simulations Used in the Estimation of the Levy Institute Measure of Time and Income Poverty (LIMTIP) for South Korea, 2009," Economics Working Paper Archive wp_793, Levy Economics Institute.
    19. Yanqing Sun & Li Qi & Fei Heng & Peter B. Gilbert, 2020. "A hybrid approach for the stratified mark‐specific proportional hazards model with missing covariates and missing marks, with application to vaccine efficacy trials," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(4), pages 791-814, August.
    20. Młodak Andrzej, 2021. "An application of a complex measure to model–based imputation in business statistics," Statistics in Transition New Series, Statistics Poland, vol. 22(1), pages 1-28, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:35:y:2019:i:3:p:599-624:n:5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.