IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v30y2014i4p26n6.html
   My bibliography  Save this article

The Utility of Nonparametric Transformations for Imputation of Survey Data

Author

Listed:
  • Robbins Michael W.

    (Associate Statistician, RAND Corporation, Pittsburgh, PA 15213 U.S.A.)

Abstract

Missing values present a prevalent problem in the analysis of establishment survey data. Multivariate imputation algorithms (which are used to fill in missing observations) tend to have the common limitation that imputations for continuous variables are sampled from Gaussian distributions. This limitation is addressed here through the use of robust marginal transformations. Specifically, kernel-density and empirical distribution-type transformations are discussed and are shown to have favorable properties when used for imputation of complex survey data. Although such techniques have wide applicability (i.e., they may be easily applied in conjunction with a wide array of imputation techniques), the proposed methodology is applied here with an algorithm for imputation in the USDA’s Agricultural Resource Management Survey. Data analysis and simulation results are used to illustrate the specific advantages of the robust methods when compared to the fully parametric techniques and to other relevant techniques such as predictive mean matching. To summarize, transformations based upon parametric densities are shown to distort several data characteristics in circumstances where the parametric model is ill fit; however, no circumstances are found in which the transformations based upon parametric models outperform the nonparametric transformations. As a result, the transformation based upon the empirical distribution (which is the most computationally efficient) is recommended over the other transformation procedures in practice.

Suggested Citation

  • Robbins Michael W., 2014. "The Utility of Nonparametric Transformations for Imputation of Survey Data," Journal of Official Statistics, Sciendo, vol. 30(4), pages 675-700, December.
  • Handle: RePEc:vrs:offsta:v:30:y:2014:i:4:p:26:n:6
    DOI: 10.2478/jos-2014-0043
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2014-0043
    Download Restriction: no

    File URL: https://libkey.io/10.2478/jos-2014-0043?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mishra, Ashok K. & Holthausen, Duncan M., 2002. "Effect of Farm Income and Off-Farm Wage Variability on Off-Farm Labor Supply," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 31(2), pages 1-13, October.
    2. Chul‐Woo Kwon & Peter F. Orazem & Daniel M. Otto, 2006. "Off‐farm labor supply responses to permanent and transitory farm income," Agricultural Economics, International Association of Agricultural Economists, vol. 34(1), pages 59-67, January.
    3. Huffman, Wallace E, 1980. "Farm and Off-Farm Work Decisions: The Role of Human Capital," The Review of Economics and Statistics, MIT Press, vol. 62(1), pages 14-23, February.
    4. Huffman, Wallace E & Lange, Mark D, 1989. "Off-Farm Work Decisions of Husbands and Wives: Joint Decision Making," The Review of Economics and Statistics, MIT Press, vol. 71(3), pages 471-480, August.
    5. Templ, Matthias & Kowarik, Alexander & Filzmoser, Peter, 2011. "Iterative stepwise regression imputation using standard and robust methods," Computational Statistics & Data Analysis, Elsevier, vol. 55(10), pages 2793-2806, October.
    6. Michael W. Robbins & T. Kirk White, 2011. "Farm Commodity Payments and Imputation in the Agricultural Resource Management Survey," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(2), pages 606-612.
    7. Javaras, Kristin N. & Van Dyk, David A., 2003. "Multiple Imputation for Incomplete Data With Semicontinuous Variables," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 703-715, January.
    8. Michael W. Robbins & Sujit K. Ghosh & Joshua D. Habiger, 2013. "Imputation in High-Dimensional Economic Data as Applied to the Agricultural Resource Management Survey," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 81-95, March.
    9. Jerome P. Reiter, 2005. "Releasing multiply imputed, synthetic public use microdata: an illustration and empirical study," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(1), pages 185-205, January.
    10. Su, Yu-Sung & Gelman, Andrew & Hill, Jennifer & Yajima, Masanao, 2011. "Multiple Imputation with Diagnostics (mi) in R: Opening Windows into the Black Box," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 45(i02).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chang, Hung-Hao & Mishra, Ashok, 2008. "Impact of off-farm labor supply on food expenditures of the farm household," Food Policy, Elsevier, vol. 33(6), pages 657-664, December.
    2. Gerko Vink & Laurence E. Frank & Jeroen Pannekoek & Stef Buuren, 2014. "Predictive mean matching imputation of semicontinuous variables," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 68(1), pages 61-90, February.
    3. Vergara, Oscar & Coble, Keith H. & Patrick, George F. & Knight, Thomas O. & Baquet, Alan E., 2004. "Farm Income Variability and the Supply of Off-Farm Labor by Limited-Resource Farmers," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 36(2), pages 1-13, August.
    4. Mishra, Ashok K. & Paudel, Krishna P., 2008. "Policy Reform and Off-farm Labor Supply by Operators in the Delta Region: A," 2008 Annual Meeting, February 2-6, 2008, Dallas, Texas 6725, Southern Agricultural Economics Association.
    5. Chang, Yang-Ming & Huang, Biing-Wen & Chen, Yun-Ju, 2012. "Labor supply, income, and welfare of the farm household," Labour Economics, Elsevier, vol. 19(3), pages 427-437.
    6. Corsi, Alessandro & Salvioni, Cristina, 2017. "Once part-timer always part-timer? Causes for persistence in off farm work state of farmers," Bio-based and Applied Economics Journal, Italian Association of Agricultural and Applied Economics (AIEAA), vol. 6(2), September.
    7. Wang, Xiaobing & Herzfeld, Thomas & Glauben, Thomas, 2007. "Labor allocation in transition: Evidence from Chinese rural households," China Economic Review, Elsevier, vol. 18(3), pages 287-308.
    8. Almeida, Alexandre N. & Bravo-Ureta, Boris E., 2019. "Agricultural productivity, shadow wages and off-farm labor decisions in Nicaragua," Economic Systems, Elsevier, vol. 43(1), pages 99-110.
    9. Athanasios P. Papadopoulos & Gregory T. Papanikos, 2005. "The determinants of vinegrowers employment and policy implications: the case of a Greek island," Agricultural Economics, International Association of Agricultural Economists, vol. 32(1), pages 61-72, January.
    10. Huffman, Wallace E., 1996. "Farm Labor: Key Conceptual and Measurement Issues on the Route to Better Farm Cost and Return Estimates," ISU General Staff Papers 199604010800001279, Iowa State University, Department of Economics.
    11. Thia C. Hennessy & Tahir Rehman, 2008. "Assessing the Impact of the ‘Decoupling’ Reform of the Common Agricultural Policy on Irish Farmers’ Off‐farm Labour Market Participation Decisions," Journal of Agricultural Economics, Wiley Blackwell, vol. 59(1), pages 41-56, February.
    12. Hastings, Steven E. & Mackenzie, John & Mukherjee, Jaideep, 1991. "An Analysis Of The Off-Farm Work Decision Of Farm Opera Tors And Their Spouses," 1991 Annual Meeting, August 4-7, Manhattan, Kansas 271083, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    13. Marcel Fafchamps & Agnes R. Quisumbing, 1999. "Human Capital, Productivity, and Labor Allocation in Rural Pakistan," Journal of Human Resources, University of Wisconsin Press, vol. 34(2), pages 369-406.
    14. Brown, Jason P. & Weber, Jeremy, 2013. "The Off-Farm Occupations of U.S. Farm Operators and Their Spouses," Economic Information Bulletin 156535, United States Department of Agriculture, Economic Research Service.
    15. Drall, Anviksha & Mandal, Sabuj Kumar, 2021. "Investigating the existence of entry barriers in rural non-farm sector (RNFS) employment in India: A theoretical modelling and an empirical analysis," World Development, Elsevier, vol. 141(C).
    16. Huffman, Wallace E. & El-Osta, Hisham, 1997. "Off-Farm Work Participation, Off-Farm Labor Supply and On-Farm Labor Demand of U.S. Farm Operators," ISU General Staff Papers 199712010800001290, Iowa State University, Department of Economics.
    17. Gedikoglu, Haluk, 2013. "A Comprehensive Analysis of Adoption of Energy Crops, GM Crops and Conservation Practices," 2013 Annual Meeting, February 2-5, 2013, Orlando, Florida 142928, Southern Agricultural Economics Association.
    18. Dries, Liesbeth & Ciaian, Pavel & Kancs, d’Artis, 2012. "Job creation and job destruction in EU agriculture," Food Policy, Elsevier, vol. 37(6), pages 600-608.
    19. Bjornsen, Hild-Marte, 1999. "Off-farm labour decisions of Norwegian farm Households," ERSA conference papers ersa99pa025, European Regional Science Association.
    20. Donnellan, Trevor & Hennessy, Thia, 2012. "Defining a theoretical model of farm households’ labour allocation decisions," Factor Markets Working Papers 140, Centre for European Policy Studies.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:30:y:2014:i:4:p:26:n:6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.