IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v163y2016icp45-53.html
   My bibliography  Save this article

Web based health surveys: Using a Two Step Heckman model to examine their potential for population health analysis

Author

Listed:
  • Morrissey, Karyn
  • Kinderman, Peter
  • Pontin, Eleanor
  • Tai, Sara
  • Schwannauer, Mathias

Abstract

In June 2011 the BBC Lab UK carried out a web-based survey on the causes of mental distress. The ‘Stress Test’ was launched on ‘All in the Mind’ a BBC Radio 4 programme and the test’s URL was publicised on radio and TV broadcasts, and made available via BBC web pages and social media. Given the large amount of data created, over 32,800 participants, with corresponding diagnosis, demographic and socioeconomic characteristics; the dataset are potentially an important source of data for population based research on depression and anxiety. However, as respondents self-selected to participate in the online survey, the survey may comprise a non-random sample. It may be only individuals that listen to BBC Radio 4 and/or use their website that participated in the survey. In this instance using the Stress Test data for wider population based research may create sample selection bias. Focusing on the depression component of the Stress Test, this paper presents an easy-to-use method, the Two Step Probit Selection Model, to detect and statistically correct selection bias in the Stress Test. Using a Two Step Probit Selection Model; this paper did not find a statistically significant selection on unobserved factors for participants of the Stress Test. That is, survey participants who accessed and completed an online survey are not systematically different from non-participants on the variables of substantive interest.

Suggested Citation

  • Morrissey, Karyn & Kinderman, Peter & Pontin, Eleanor & Tai, Sara & Schwannauer, Mathias, 2016. "Web based health surveys: Using a Two Step Heckman model to examine their potential for population health analysis," Social Science & Medicine, Elsevier, vol. 163(C), pages 45-53.
    • Handle: RePEc:eee:socmed:v:163:y:2016:i:c:p:45-53
    DOI: 10.1016/j.socscimed.2016.06.053
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953616303434
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socscimed.2016.06.053?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492, National Bureau of Economic Research, Inc.
    2. repec:bla:obuest:v:62:y:2000:i:2:p:305-22 is not listed on IDEAS
    3. Geneletti, Sara & Mason, Alexina & Best, Nicky, 2011. "Adjusting for selection effects in epidemiologic studies: why sensitivity analysis is the only “solution”," LSE Research Online Documents on Economics 31520, London School of Economics and Political Science, LSE Library.
    4. Van de Ven, Wynand P. M. M. & Van Praag, Bernard M. S., 1981. "The demand for deductibles in private health insurance : A probit model with sample selection," Journal of Econometrics, Elsevier, vol. 17(2), pages 229-252, November.
    5. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    6. Peter J Rentfrow & Markus Jokela & Michael E Lamb, 2015. "Regional Personality Differences in Great Britain," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-20, March.
    7. Heckman, James J, 1978. "Dummy Endogenous Variables in a Simultaneous Equation System," Econometrica, Econometric Society, vol. 46(4), pages 931-959, July.
    8. William H. Greene, 1995. "Sample Selection in the Poisson Regression Model," Working Papers 95-06, New York University, Leonard N. Stern School of Business, Department of Economics.
    9. Greene, William H, 1981. "Sample Selection Bias as a Specification Error: Comment," Econometrica, Econometric Society, vol. 49(3), pages 795-798, May.
    10. Jelke Bethlehem, 2010. "Selection Bias in Web Surveys," International Statistical Review, International Statistical Institute, vol. 78(2), pages 161-188, August.
    11. Byung‐Joo Lee & L. C. Marsh, 2000. "Sample Selection Bias Correction for Missing Response Observations," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 62(2), pages 305-322, May.
    12. Moffitt, Robert A., 1999. "New developments in econometric methods for labor market analysis," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 24, pages 1367-1397, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tan, Ruipeng & Lin, Boqiang, 2019. "Public perception of new energy vehicles: Evidence from willingness to pay for new energy bus fares in China," Energy Policy, Elsevier, vol. 130(C), pages 347-354.
    2. Antonio Baselice & Mariarosaria Lombardi & Maurizio Prosperi & Antonio Stasi & Antonio Lopolito, 2021. "Key Drivers of the Engagement of Farmers in Social Innovation for Marginalised Rural Areas," Sustainability, MDPI, vol. 13(15), pages 1-18, July.
    3. Laura C. Dawkins & Daniel B. Williamson & Stewart W. Barr & Sally R. Lampkin, 2020. "‘What drives commuter behaviour?': a Bayesian clustering approach for understanding opposing behaviours in social surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 251-280, January.
    4. Saman Nazir & Cynthia Cready, 2020. "The C-Section Epidemic in Pakistan," PIDE-Working Papers 2020:176, Pakistan Institute of Development Economics.
    5. Kai Xiong & Fanbin Kong & Ning Zhang & Ni Lei & Chuanwang Sun, 2018. "Analysis of the Factors Influencing Willingness to Pay and Payout Level for Ecological Environment Improvement of the Ganjiang River Basin," Sustainability, MDPI, vol. 10(7), pages 1-17, June.
    6. Shahriar Kabir & Bindu Prashad Kairy & Mirza Kainath Ashrafi Khusbu, 2024. "Microcredit versus Child Schooling Nexus: Exploring Child Schooling Decisions in Rural Bangladesh (Article)," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 63(2), pages 185-202.
    7. Paul S. F. Yip & Chenhong Peng & Ho Kit Wong & Bing Kwan So, 2020. "Social Welfare Transfers and Poverty Transitions in Hong Kong: Evidence from Two-Wave Panel Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(3), pages 841-864, October.
    8. Otitoju, Moradeyo Adebanjo & Fidelis, Emeka Solomon & Abah, Emmanuel Ogaje, 2022. "Factors Influencing Farmers' Willingness-to-Pay for Biofortified Maize in Federal Capital Territory, Nigeria," Review of Agricultural and Applied Economics (RAAE), Faculty of Economics and Management, Slovak Agricultural University in Nitra, vol. 25(2), December.
    9. Jaehee Hwang, 2022. "Who Becomes a Fisherman? A Two-Stage Sample Selection Analysis on Small-Scale Fishery Choice and Income in Korea," Sustainability, MDPI, vol. 14(4), pages 1-21, February.
    10. Kai Xiong & Ning Zhang & Chih-Chun Kung & Fanbin Kong, 2019. "Determinants of Residents’ Willingness to Accept and Their Levels for Ecological Conservation in Ganjiang River Basin, China: An Empirical Analysis of Survey Data for 677 Households," Sustainability, MDPI, vol. 11(21), pages 1-18, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hirschauer, Norbert & Grüner, Sven & Mußhoff, Oliver & Becker, Claudia & Jantsch, Antje, 2020. "Can p-values be meaningfully interpreted without random sampling?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 14, pages 71-91.
    2. Miguel Santolino & Magnus Söderberg, 2014. "Modelling appellate courts’ responses in motor injury disputes," European Journal of Law and Economics, Springer, vol. 38(3), pages 393-407, December.
    3. William H. Greene & David A. Hensher, 2008. "Modeling Ordered Choices: A Primer and Recent Developments," Working Papers 08-26, New York University, Leonard N. Stern School of Business, Department of Economics.
    4. Marra Giampiero & Radice Rosalba, 2017. "A joint regression modeling framework for analyzing bivariate binary data in R," Dependence Modeling, De Gruyter, vol. 5(1), pages 268-294, December.
    5. Watanabe, Hajime & Maruyama, Takuya, 2024. "A Bayesian sample selection model with a binary outcome for handling residential self-selection in individual car ownership," Journal of choice modelling, Elsevier, vol. 51(C).
    6. P.W. Miller & S. Rummery, 1989. "Gender Wage Discrimination in Australia: A reassessment," Economics Discussion / Working Papers 89-21, The University of Western Australia, Department of Economics.
    7. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    8. Takashi Yamagata & Chris Orme, 2005. "On Testing Sample Selection Bias Under the Multicollinearity Problem," Econometric Reviews, Taylor & Francis Journals, vol. 24(4), pages 467-481.
    9. Abid Hussain & Gopal Bahadur Thapa, 2016. "Fungibility of Smallholder Agricultural Credit: Empirical Evidence from Pakistan," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 28(5), pages 826-846, November.
    10. Hessami, Zohal & Resnjanskij, Sven, 2019. "Complex ballot propositions, individual voting behavior, and status quo bias," European Journal of Political Economy, Elsevier, vol. 58(C), pages 82-101.
    11. Fabrice Le Guel & Thierry Pénard & Raphaël Suire, 2005. "Adoption et usage marchand de l'Internet : une étude économétrique sur données bretonnes," Economie & Prévision, La Documentation Française, vol. 167(1), pages 67-84.
    12. Glenn W. Harrison & Morten I. Lau & Hong Il Yoo, 2020. "Risk Attitudes, Sample Selection, and Attrition in a Longitudinal Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 552-568, July.
    13. Giampiero Marra & Rosalba Radice & Silvia Missiroli, 2014. "Testing the hypothesis of absence of unobserved confounding in semiparametric bivariate probit models," Computational Statistics, Springer, vol. 29(3), pages 715-741, June.
    14. repec:prg:jnlpep:v:preprint:id:676:p:1-18 is not listed on IDEAS
    15. Miguel Santolino & Catalina Bolancé & Manuela Alcañiz, 2011. "Factors affecting hospital admission and recovery stay duration of in-patient motor victims in Spain," IREA Working Papers 201119, University of Barcelona, Research Institute of Applied Economics, revised Oct 2011.
    16. Bago, Jean-Louis & Ouédraogo, Moussa & Akakpo, Koffi & Lompo, Miaba Louise & Souratié, Wamadini M. & Ouédraogo, Ernest, 2019. "Early Childhood Education and Children Development : Evidence from Ghana," MPRA Paper 95868, University Library of Munich, Germany.
    17. Fernández-Val, Iván & Vella, Francis, 2011. "Bias corrections for two-step fixed effects panel data estimators," Journal of Econometrics, Elsevier, vol. 163(2), pages 144-162, August.
    18. Glenn W. Harrison, 2017. "Behavioral responses to surveys about nicotine dependence," Health Economics, John Wiley & Sons, Ltd., vol. 26(S3), pages 114-123, December.
    19. Cumming, Douglas & Fleming, Grant & Schwienbacher, Armin, 2006. "Legality and venture capital exits," Journal of Corporate Finance, Elsevier, vol. 12(2), pages 214-245, January.
    20. Habiba Al-Shaer & Mahbub Zaman, 2019. "CEO Compensation and Sustainability Reporting Assurance: Evidence from the UK," Journal of Business Ethics, Springer, vol. 158(1), pages 233-252, August.
    21. Coates, Dennis & Humphreys, Brad R. & Kane, John & Vachris, Michelle A., 2004. ""No significant distance" between face-to-face and online instruction: evidence from principles of economics," Economics of Education Review, Elsevier, vol. 23(5), pages 533-546, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:163:y:2016:i:c:p:45-53. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.