IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v163y2016icp45-53.html
   My bibliography  Save this article

Web based health surveys: Using a Two Step Heckman model to examine their potential for population health analysis

Author

Listed:
  • Morrissey, Karyn
  • Kinderman, Peter
  • Pontin, Eleanor
  • Tai, Sara
  • Schwannauer, Mathias

Abstract

In June 2011 the BBC Lab UK carried out a web-based survey on the causes of mental distress. The ‘Stress Test’ was launched on ‘All in the Mind’ a BBC Radio 4 programme and the test’s URL was publicised on radio and TV broadcasts, and made available via BBC web pages and social media. Given the large amount of data created, over 32,800 participants, with corresponding diagnosis, demographic and socioeconomic characteristics; the dataset are potentially an important source of data for population based research on depression and anxiety. However, as respondents self-selected to participate in the online survey, the survey may comprise a non-random sample. It may be only individuals that listen to BBC Radio 4 and/or use their website that participated in the survey. In this instance using the Stress Test data for wider population based research may create sample selection bias. Focusing on the depression component of the Stress Test, this paper presents an easy-to-use method, the Two Step Probit Selection Model, to detect and statistically correct selection bias in the Stress Test. Using a Two Step Probit Selection Model; this paper did not find a statistically significant selection on unobserved factors for participants of the Stress Test. That is, survey participants who accessed and completed an online survey are not systematically different from non-participants on the variables of substantive interest.

Suggested Citation

  • Morrissey, Karyn & Kinderman, Peter & Pontin, Eleanor & Tai, Sara & Schwannauer, Mathias, 2016. "Web based health surveys: Using a Two Step Heckman model to examine their potential for population health analysis," Social Science & Medicine, Elsevier, vol. 163(C), pages 45-53.
    • Handle: RePEc:eee:socmed:v:163:y:2016:i:c:p:45-53
    DOI: 10.1016/j.socscimed.2016.06.053
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953616303434
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socscimed.2016.06.053?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    2. repec:bla:obuest:v:62:y:2000:i:2:p:305-22 is not listed on IDEAS
    3. Jelke Bethlehem, 2010. "Selection Bias in Web Surveys," International Statistical Review, International Statistical Institute, vol. 78(2), pages 161-188, August.
    4. Byung‐Joo Lee & L. C. Marsh, 2000. "Sample Selection Bias Correction for Missing Response Observations," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 62(2), pages 305-322, May.
    5. Moffitt, Robert A., 1999. "New developments in econometric methods for labor market analysis," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 24, pages 1367-1397, Elsevier.
    6. Greene, William H, 1981. "Sample Selection Bias as a Specification Error: Comment," Econometrica, Econometric Society, vol. 49(3), pages 795-798, May.
    7. Heckman, James J, 1978. "Dummy Endogenous Variables in a Simultaneous Equation System," Econometrica, Econometric Society, vol. 46(4), pages 931-959, July.
    8. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    9. Geneletti, Sara & Mason, Alexina & Best, Nicky, 2011. "Adjusting for selection effects in epidemiologic studies: why sensitivity analysis is the only “solution”," LSE Research Online Documents on Economics 31520, London School of Economics and Political Science, LSE Library.
    10. Van de Ven, Wynand P. M. M. & Van Praag, Bernard M. S., 1981. "The demand for deductibles in private health insurance : A probit model with sample selection," Journal of Econometrics, Elsevier, vol. 17(2), pages 229-252, November.
    11. Peter J Rentfrow & Markus Jokela & Michael E Lamb, 2015. "Regional Personality Differences in Great Britain," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-20, March.
    12. William H. Greene, 1995. "Sample Selection in the Poisson Regression Model," Working Papers 95-06, New York University, Leonard N. Stern School of Business, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Saman Nazir & Cynthia Cready, 2020. "The C-Section Epidemic in Pakistan," PIDE-Working Papers 2020:176, Pakistan Institute of Development Economics.
    2. Kai Xiong & Fanbin Kong & Ning Zhang & Ni Lei & Chuanwang Sun, 2018. "Analysis of the Factors Influencing Willingness to Pay and Payout Level for Ecological Environment Improvement of the Ganjiang River Basin," Sustainability, MDPI, vol. 10(7), pages 1-17, June.
    3. Shahriar Kabir & Bindu Prashad Kairy & Mirza Kainath Ashrafi Khusbu, 2024. "Microcredit versus Child Schooling Nexus: Exploring Child Schooling Decisions in Rural Bangladesh (Article)," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 63(2), pages 185-202.
    4. Antonio Baselice & Mariarosaria Lombardi & Maurizio Prosperi & Antonio Stasi & Antonio Lopolito, 2021. "Key Drivers of the Engagement of Farmers in Social Innovation for Marginalised Rural Areas," Sustainability, MDPI, vol. 13(15), pages 1-18, July.
    5. Ubi-Abai, Itoro, 2024. "Households’ Willingness to Pay and Payments for Water Services by the Akwa Ibom Water Company Limited, Akwa Ibom State, Nigeria," MPRA Paper 122512, University Library of Munich, Germany.
    6. Tan, Ruipeng & Lin, Boqiang, 2019. "Public perception of new energy vehicles: Evidence from willingness to pay for new energy bus fares in China," Energy Policy, Elsevier, vol. 130(C), pages 347-354.
    7. Otitoju, Moradeyo Adebanjo & Fidelis, Emeka Solomon & Abah, Emmanuel Ogaje, 2022. "Factors Influencing Farmers' Willingness-to-Pay for Biofortified Maize in Federal Capital Territory, Nigeria," Review of Agricultural and Applied Economics (RAAE), Faculty of Economics and Management, Slovak Agricultural University in Nitra, vol. 25(2), December.
    8. Jaehee Hwang, 2022. "Who Becomes a Fisherman? A Two-Stage Sample Selection Analysis on Small-Scale Fishery Choice and Income in Korea," Sustainability, MDPI, vol. 14(4), pages 1-21, February.
    9. Kai Xiong & Ning Zhang & Chih-Chun Kung & Fanbin Kong, 2019. "Determinants of Residents’ Willingness to Accept and Their Levels for Ecological Conservation in Ganjiang River Basin, China: An Empirical Analysis of Survey Data for 677 Households," Sustainability, MDPI, vol. 11(21), pages 1-18, November.
    10. Laura C. Dawkins & Daniel B. Williamson & Stewart W. Barr & Sally R. Lampkin, 2020. "‘What drives commuter behaviour?': a Bayesian clustering approach for understanding opposing behaviours in social surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 251-280, January.
    11. Paul S. F. Yip & Chenhong Peng & Ho Kit Wong & Bing Kwan So, 2020. "Social Welfare Transfers and Poverty Transitions in Hong Kong: Evidence from Two-Wave Panel Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(3), pages 841-864, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Miguel Santolino & Magnus Söderberg, 2014. "Modelling appellate courts’ responses in motor injury disputes," European Journal of Law and Economics, Springer, vol. 38(3), pages 393-407, December.
    2. Hirschauer, Norbert & Gruener, Sven & Mußhoff, Oliver & Becker, Claudia & Jantsch, Antje, 2019. "Can p-values be meaningfully interpreted without random sampling?," SocArXiv yazr8_v1, Center for Open Science.
    3. William H. Greene & David A. Hensher, 2008. "Modeling Ordered Choices: A Primer and Recent Developments," Working Papers 08-26, New York University, Leonard N. Stern School of Business, Department of Economics.
    4. Hirschauer, Norbert & Grüner, Sven & Mußhoff, Oliver & Becker, Claudia & Jantsch, Antje, 2020. "Can p-values be meaningfully interpreted without random sampling?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 14, pages 71-91.
    5. Marra Giampiero & Radice Rosalba, 2017. "A joint regression modeling framework for analyzing bivariate binary data in R," Dependence Modeling, De Gruyter, vol. 5(1), pages 268-294, December.
    6. P.W. Miller & S. Rummery, 1989. "Gender Wage Discrimination in Australia: A reassessment," Economics Discussion / Working Papers 89-21, The University of Western Australia, Department of Economics.
    7. Takashi Yamagata & Chris Orme, 2005. "On Testing Sample Selection Bias Under the Multicollinearity Problem," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 467-481.
    8. Glenn W. Harrison & Morten I. Lau & Hong Il Yoo, 2020. "Risk Attitudes, Sample Selection, and Attrition in a Longitudinal Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 552-568, July.
    9. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    10. Miguel Santolino & Catalina Bolancé & Manuela Alcañiz, 2011. "Factors affecting hospital admission and recovery stay duration of in-patient motor victims in Spain," IREA Working Papers 201119, University of Barcelona, Research Institute of Applied Economics, revised Oct 2011.
    11. Glenn W. Harrison, 2017. "Behavioral responses to surveys about nicotine dependence," Health Economics, John Wiley & Sons, Ltd., vol. 26(S3), pages 114-123, December.
    12. Habiba Al-Shaer & Mahbub Zaman, 2019. "CEO Compensation and Sustainability Reporting Assurance: Evidence from the UK," Journal of Business Ethics, Springer, vol. 158(1), pages 233-252, August.
    13. Coates, Dennis & Humphreys, Brad R. & Kane, John & Vachris, Michelle A., 2004. ""No significant distance" between face-to-face and online instruction: evidence from principles of economics," Economics of Education Review, Elsevier, vol. 23(5), pages 533-546, October.
    14. Tripathi, Amarnath & Sardar, Sucheta & Shyam, Hari Shankar, 2023. "Hybrid crops, income, and food security of smallholder families: Empirical evidence from poor states of India," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    15. Katrin Hussinger, 2008. "R&D and subsidies at the firm level: an application of parametric and semiparametric two-step selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(6), pages 729-747.
    16. Terza, Joseph V., 1998. "Estimating count data models with endogenous switching: Sample selection and endogenous treatment effects," Journal of Econometrics, Elsevier, vol. 84(1), pages 129-154, May.
    17. Ricardo Henriquez Hofter, 2006. "Private health insurance and utilization of health services in Chile," Applied Economics, Taylor & Francis Journals, vol. 38(4), pages 423-439.
    18. Garcia, Serge & Harou, Patrice & Montagné, Claire & Stenger, Anne, 2009. "Models for sample selection bias in contingent valuation: Application to forest biodiversity," Journal of Forest Economics, Elsevier, vol. 15(1-2), pages 59-78, January.
    19. Seonho Shin, 2022. "To work or not? Wages or subsidies?: Copula-based evidence of subsidized refugees’ negative selection into employment," Empirical Economics, Springer, vol. 63(4), pages 2209-2252, October.
    20. Arnstein Aassve & Pierluigi Conzo & Francesco Mattioli, 2021. "Was Banfield right? New insights from a nationwide laboratory experiment," Journal of Regional Science, Wiley Blackwell, vol. 61(5), pages 1029-1064, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:163:y:2016:i:c:p:45-53. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.