IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v37y2009i3p319-343.html
   My bibliography  Save this article

Estimation for Volunteer Panel Web Surveys Using Propensity Score Adjustment and Calibration Adjustment

Author

Listed:
  • Sunghee Lee

    (University of California, Los Angeles, slee9@ucla.edu)

  • Richard Valliant

    (University of Michigan and University of Maryland)

Abstract

A combination of propensity score and calibration adjustment is shown to reduce bias in volunteer panel Web surveys. In this combination, the design weights are adjusted by propensity scores to correct for selection bias due to nonrandomized sampling. These adjusted weights are then calibrated to control totals for the target population and correct for coverage bias. The final set of weights is comprised of multiple components, and the estimator of a total no longer takes a linear form. Therefore, approximate methods are needed to derive variance estimates. This study compares three variance estimation methods through simulation. The first method resembles what is used in commercial statistical software based on squared residuals. The second approach uses a variance estimator originally derived for the generalized regression estimator. The third method uses jackknife replication. Results indicate bias reduction is crucial for valid variance estimation and favor the replication method over the other approaches.

Suggested Citation

  • Sunghee Lee & Richard Valliant, 2009. "Estimation for Volunteer Panel Web Surveys Using Propensity Score Adjustment and Calibration Adjustment," Sociological Methods & Research, , vol. 37(3), pages 319-343, February.
    • Handle: RePEc:sae:somere:v:37:y:2009:i:3:p:319-343
    DOI: 10.1177/0049124108329643
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124108329643
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124108329643?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthias Schonlau & Arthur Van Soest & Arie Kapteyn, 2007. "Are 'Webographic' or Attitudinal Questions Useful for Adjusting Estimates From Web Surveys Using Propensity Scoring?," Working Papers 506, RAND Corporation.
    2. Matthias Schonlau & Arthur Van Soest & Arie Kapteyn, 2007. "Are 'Webographic' or Attitudinal Questions Useful for Adjusting Estimates From Web Surveys Using Propensity Scoring?," Working Papers WR-506, RAND Corporation.
    3. Czajka, John L, et al, 1992. "Projecting from Advance Data Using Propensity Modeling: An Application to Income and Tax Statistics," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(2), pages 117-131, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria del Mar Rueda, 2019. "Comments on: Deville and Särndal’s calibration: revisiting a 25 years old successful optimization problem," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(4), pages 1077-1081, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard Valliant & Jill A. Dever, 2011. "Estimating Propensity Adjustments for Volunteer Web Surveys," Sociological Methods & Research, , vol. 40(1), pages 105-137, February.
    2. Ramón Ferri-García & María del Mar Rueda, 2022. "Variable selection in Propensity Score Adjustment to mitigate selection bias in online surveys," Statistical Papers, Springer, vol. 63(6), pages 1829-1881, December.
    3. Luis Castro-Martín & Maria del Mar Rueda & Ramón Ferri-García, 2020. "Inference from Non-Probability Surveys with Statistical Matching and Propensity Score Adjustment Using Modern Prediction Techniques," Mathematics, MDPI, vol. 8(6), pages 1-19, June.
    4. Stéphane Legleye & Géraldine Charrance & Nicolas Razafindratsima & Nathalie Bajos & Aline Bohet & Caroline Moreau, 2018. "The Use of a Nonprobability Internet Panel to Monitor Sexual and Reproductive Health in the General Population," Sociological Methods & Research, , vol. 47(2), pages 314-348, March.
    5. Buil-Gil, David & Solymosi, Reka & Moretti, Angelo, 2019. "Non-parametric bootstrap and small area estimation to mitigate bias in crowdsourced data. Simulation study and application to perceived safety," SocArXiv 8hgjt, Center for Open Science.
    6. repec:aia:aiaswp:wp76 is not listed on IDEAS
    7. Amang Sukasih & Donsig Jang & Sonya Vartivarian & Stephen Cohen & Fan Zhang, "undated". "A Simulation Study to Compare Weighting Methods for Survey Nonresponses in the National Survey of Recent College Graduates," Mathematica Policy Research Reports 613f000cac94492f91b53813f, Mathematica Policy Research.
    8. Amarendra Sharma, 2019. "Indira Awas Yojana and Housing Adequacy: An Evaluation using Propensity Score Matching," ASARC Working Papers 2019-05, The Australian National University, Australia South Asia Research Centre.
    9. Matthias Schonlau & Arthur van Soest & Arie Kapteyn & Mick Couper, 2009. "Selection Bias in Web Surveys and the Use of Propensity Scores," Sociological Methods & Research, , vol. 37(3), pages 291-318, February.
    10. Dongcheng Zhang & Kunpeng Zhang, 2020. "Weighting-Based Treatment Effect Estimation via Distribution Learning," Papers 2012.13805, arXiv.org, revised May 2023.
    11. Lingxiao Wang & Barry I. Graubard & Hormuzd A. Katki & and Yan Li, 2020. "Improving external validity of epidemiologic cohort analyses: a kernel weighting approach," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1293-1311, June.
    12. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    13. Hao Chen & Dylan S. Small, 2022. "New multivariate tests for assessing covariate balance in matched observational studies," Biometrics, The International Biometric Society, vol. 78(1), pages 202-213, March.
    14. repec:mpr:mprres:6579 is not listed on IDEAS
    15. Petreski, Marjan & Jovanovic, Branimir, 2013. "Do Remittances Reduce Poverty and Inequality in the Western Balkans? Evidence from Macedonia," MPRA Paper 51413, University Library of Munich, Germany.
    16. Jason K. Luellen & William R. Shadish & M. H. Clark, 2005. "Propensity Scores," Evaluation Review, , vol. 29(6), pages 530-558, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:37:y:2009:i:3:p:319-343. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.