IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v91y2023i1p55-71.html
   My bibliography  Save this article

Diagnostic Tests for the Necessity of Weight in Regression With Survey Data

Author

Listed:
  • Feng Wang
  • HaiYing Wang
  • Jun Yan

Abstract

To weight or not to weight in regression analyses with survey data has been debated in the literature. The problem is essentially a tradeoff between the bias and the variance of the regression coefficient estimator. An array of diagnostic tests for informative weights have been developed. Nonetheless, studies comparing the performance of the tests, especially for finite samples, are scarce, and the theoretical equivalence of some tests has not been investigated. Focusing on the linear regression setting, we review a collection of such tests and propose enhanced versions of some of them that require an auxiliary regression model for the weight. Further, the equivalence of two popular tests is established which has not been reported before. In contrast to existing reviews with no empirical comparison, we compare the sizes and powers of the tests in simulation studies. The reviewed tests are applied to a regression analysis of the family expenditure using the data from the China Family Panel Study.

Suggested Citation

  • Feng Wang & HaiYing Wang & Jun Yan, 2023. "Diagnostic Tests for the Necessity of Weight in Regression With Survey Data," International Statistical Review, International Statistical Institute, vol. 91(1), pages 55-71, April.
  • Handle: RePEc:bla:istatr:v:91:y:2023:i:1:p:55-71
    DOI: 10.1111/insr.12509
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/insr.12509
    Download Restriction: no

    File URL: https://libkey.io/10.1111/insr.12509?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Konstantin Gluschenko, 2018. "Measuring regional inequality: to weight or not to weight?," Spatial Economic Analysis, Taylor & Francis Journals, vol. 13(1), pages 36-59, January.
    2. Sophia Rabe‐Hesketh & Anders Skrondal, 2006. "Multilevel modelling of complex survey data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(4), pages 805-827, October.
    3. Xiaochen Ma & Ziyue Wang & Xiaoyun Liu, 2019. "Progress on Catastrophic Health Expenditure in China: Evidence from China Family Panel Studies (CFPS) 2010 to 2016," IJERPH, MDPI, vol. 16(23), pages 1-11, November.
    4. Lumley, Thomas, 2004. "Analysis of Complex Survey Samples," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 9(i08).
    5. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    6. Chang-ming Hsieh, 2004. "To Weight or not to Weight: The Role of Domain Importance in Quality of Life Measurement," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 68(2), pages 163-174, September.
    7. Nancy Duong Nguyen & Patrick Murphy, 2015. "To Weight or Not To Weight? A Statistical Analysis of How Weights Affect the Reliability of the Quarterly National Household Survey for Immigration Research in Ireland," The Economic and Social Review, Economic and Social Studies, vol. 46(4), pages 567-603.
    8. Gary Solon & Steven J. Haider & Jeffrey M. Wooldridge, 2015. "What Are We Weighting For?," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 301-316.
    9. Kott, Phillip S., 1991. "What Does Performing Linear Regression on Sample Survey Data Mean?," Journal of Agricultural Economics Research, United States Department of Agriculture, Economic Research Service, vol. 43(1), pages 1-4.
    10. Pfeffermann, Danny & Sverchkov, Michail, 2007. "Small-Area Estimation Under Informative Probability Sampling of Areas and Within the Selected Areas," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1427-1439, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sloczynski, Tymon, 2018. "A General Weighted Average Representation of the Ordinary and Two-Stage Least Squares Estimands," IZA Discussion Papers 11866, Institute of Labor Economics (IZA).
    2. Mark E. McGovern & Slawa Rokicki, 2023. "The Great Recession, Household Income, and Children's Test Scores," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 69(3), pages 555-580, September.
    3. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    4. Joseph L Dieleman & Tara Templin, 2014. "Random-Effects, Fixed-Effects and the within-between Specification for Clustered Data in Observational Health Studies: A Simulation Study," PLOS ONE, Public Library of Science, vol. 9(10), pages 1-17, October.
    5. Ana Maria Osorio & Catalina Bolancé & Nyovane Madise & Katharina Rathmann, 2013. "Social Determinants of Child Health in Colombia: Can Community Education Moderate the Effect of Family Characteristics?," Working Papers XREAP2013-02, Xarxa de Referència en Economia Aplicada (XREAP), revised Mar 2013.
    6. Sheyla Rodrigues Cassy & Samuel Manda & Filipe Marques & Maria do Rosário Oliveira Martins, 2022. "Accounting for Sampling Weights in the Analysis of Spatial Distributions of Disease Using Health Survey Data, with an Application to Mapping Child Health in Malawi and Mozambique," IJERPH, MDPI, vol. 19(10), pages 1-15, May.
    7. Kang, Shijia & Frick, Fabian & Ait Sidhoum, Amer & Sauer, Johannes & Zheng, Shaofeng, 2023. "Does food quality certification improve eco-efficiency? Empirical evidence from Chinese vegetable production," Food Policy, Elsevier, vol. 121(C).
    8. Cooray, Arusha, 2011. "The role of the government in financial sector development," Economic Modelling, Elsevier, vol. 28(3), pages 928-938, May.
    9. Campbell, Randall C. & Nagel, Gregory L., 2016. "Private information and limitations of Heckman's estimator in banking and corporate finance research," Journal of Empirical Finance, Elsevier, vol. 37(C), pages 186-195.
    10. Herrera, Santiago, 2000. "Determinantes y composición del endeudamiento público en Colombia," IDB Publications (Working Papers) 2110, Inter-American Development Bank.
    11. Thomas A. Garrett & Russell S. Sobel, 2004. "State Lottery Revenue: The Importance of Game Characteristics," Public Finance Review, , vol. 32(3), pages 313-330, May.
    12. Mehzabin Tuli, Farzana & Mitra, Suman & Crews, Mariah B., 2021. "Factors influencing the usage of shared E-scooters in Chicago," Transportation Research Part A: Policy and Practice, Elsevier, vol. 154(C), pages 164-185.
    13. Venkatesh Shankar & Pablo Azar & Matthew Fuller, 2008. "—: A Multicategory Brand Equity Model and Its Application at Allstate," Marketing Science, INFORMS, vol. 27(4), pages 567-584, 07-08.
    14. Cuesta, Lizeth & Ruiz, Yomara, 2021. "Efecto de la globalización sobre la desigualdad. Un estudio global para 104 países usando regresiones cuantílicas [Effect of globalization on inequality. A global study for 104 countries using quan," MPRA Paper 111022, University Library of Munich, Germany.
    15. Giuseppe Croce & Emanuela Ghignoni, 2011. "Overeducation and spatial flexibility in Italian local labour markets," Working Papers in Public Economics 145, Department of Economics and Law, Sapienza University of Roma.
    16. Peppel-Srebrny, Jemima, 2021. "Not all government budget deficits are created equal: Evidence from advanced economies' sovereign bond markets," Journal of International Money and Finance, Elsevier, vol. 118(C).
    17. Meghamrita Chakraborty, 2023. "Linking Migration, Diversity and Regional Development in India," Journal of Development Policy and Practice, , vol. 8(1), pages 55-72, January.
    18. Jessica M. Mc Lay & Roy Lay-Yee & Barry J. Milne & Peter Davis, 2015. "Regression-Style Models for Parameter Estimation in Dynamic Microsimulation: An Empirical Performance Assessment," International Journal of Microsimulation, International Microsimulation Association, vol. 8(2), pages 83-127.
    19. Susan Woodward, 1982. "Strike Activity and Wage Settlements," UCLA Economics Working Papers 249, UCLA Department of Economics.
    20. Machado, Matilde P., 2001. "Dollars and performance: treating alcohol misuse in Maine," Journal of Health Economics, Elsevier, vol. 20(4), pages 639-666, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:91:y:2023:i:1:p:55-71. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.