IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v56y2022i4d10.1007_s11135-021-01228-1.html
   My bibliography  Save this article

Using a dual-frame design to improve phone surveys on political attitudes: developing a weighting strategy for limited external information in Hong Kong

Author

Listed:
  • Kevin Tze-wai Wong

    (Hong Kong Institute of Asia-Pacific Studies, The Chinese University of Hong Kong)

  • Victor Zheng

    (Hong Kong Institute of Asia-Pacific Studies, The Chinese University of Hong Kong)

  • Po-san Wan

    (Hong Kong Institute of Asia-Pacific Studies, The Chinese University of Hong Kong)

Abstract

In recent years, rapid increases in mobile phone ownership and decreases in landline users have led to potential biases in landline phone survey estimations. Mobile-only users have been found to be over-represented in many mobile phone surveys. A dual-frame survey, namely a combination of a landline and mobile phone survey, is proposed to solve this problem. The design of such a survey requires a more complex weighting procedure and thus additional benchmark information on phone status and usages for weighting. There is no consensus on a standard weighting method, but there is a general agreement that it should include: (1) a computation of base weight and (2) a post-stratification adjustment. Various weighting methods for a dual-frame phone survey of political attitudes using empirical data from a study on political attitudes in Hong Kong were investigated in this study. We found that the average estimator and the single-frame estimator methods are the best approaches for computing the base weight for a dual-frame survey, and that they provide similar estimations on political attitudes. No significant difference in estimation on political attitudes was found between using only gender and age for the post-stratification adjustment and including gender, age, education, and working status. Cell weighting and raking provided similar estimations.

Suggested Citation

  • Kevin Tze-wai Wong & Victor Zheng & Po-san Wan, 2022. "Using a dual-frame design to improve phone surveys on political attitudes: developing a weighting strategy for limited external information in Hong Kong," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(4), pages 2387-2414, August.
    • Handle: RePEc:spr:qualqt:v:56:y:2022:i:4:d:10.1007_s11135-021-01228-1
    DOI: 10.1007/s11135-021-01228-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-021-01228-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-021-01228-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Britta Busse & Marek Fuchs, 2012. "The components of landline telephone survey coverage bias. The relative importance of no-phone and mobile-only populations," Quality & Quantity: International Journal of Methodology, Springer, vol. 46(4), pages 1209-1225, June.
    2. Kevin Tze-wai Wong & Victor Zheng & Po-san Wan, 2017. "A Dissatisfied Generation? An Age–Period–Cohort Analysis of the Political Satisfaction of Youth in Hong Kong from 1997 to 2014," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 130(1), pages 253-276, January.
    3. Lohr, Sharon & Rao, J.N.K., 2006. "Estimation in Multiple-Frame Surveys," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1019-1030, September.
    4. Pepinsky, Thomas B., 2018. "A Note on Listwise Deletion versus Multiple Imputation," Political Analysis, Cambridge University Press, vol. 26(4), pages 480-488, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antonio Arcos & María del Mar Rueda & Manuel Trujillo & David Molina, 2015. "Review of Estimation Methods for Landline and Cell Phone Surveys," Sociological Methods & Research, , vol. 44(3), pages 458-485, August.
    2. Marina Apgar & Guillaume Fournie & Barbara Haesler & Grace Lyn Higdon & Leah Kenny & Annalena Oppel & Evelyn Pauls & Matthew Smith & Mieke Snijder & Daan Vink & Mazeda Hossain, 2023. "Revealing the Relational Mechanisms of Research for Development Through Social Network Analysis," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(2), pages 323-350, April.
    3. Guillaume Chauvet, 2016. "Variance estimation for the 2006 French housing survey," Mathematical Population Studies, Taylor & Francis Journals, vol. 23(3), pages 147-163, July.
    4. Stephanie Coffey, PhD. & Jaya Damineni & John Eltinge, PhD. & Anup Mathur, PhD. & Kayla Varela & Allison Zotti, 2023. "Some Open Questions on Multiple-Source Extensions of Adaptive-Survey Design Concepts and Methods," Working Papers 23-03, Center for Economic Studies, U.S. Census Bureau.
    5. Mohorko Anja & Leeuw Edith de & Hox Joop, 2013. "Internet Coverage and Coverage Bias in Europe: Developments Across Countries and Over Time," Journal of Official Statistics, Sciendo, vol. 29(4), pages 609-622, December.
    6. Giorgos Gouzoulis, 2021. "Finance, Discipline and the Labour Share in the Long‐Run: France (1911–2010) and Sweden (1891–2000)," British Journal of Industrial Relations, London School of Economics, vol. 59(2), pages 568-594, June.
    7. James M. Lepkowski & Mahmoud A. Elkasabi & Steven G. Heeringa, 2015. "Joint Calibration Estimator for dual frame surveys," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 16(1), pages 7-36, May.
    8. Dafne Muntanyola Saura & Pedro Romero Balsas, 2014. "Interviewing and surveying over the phone: a reflexive account of a research on parenting," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(5), pages 2615-2630, September.
    9. Polina Zvavitch & Michael S. Rendall & Constanza Hurtado-Acuna & Rachel M. Shattuck, 2021. "Contraceptive Consistency and Poverty After Birth," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 40(6), pages 1277-1311, December.
    10. I. Sánchez-Borrego & A. Arcos & M. Rueda, 2019. "Kernel-based methods for combining information of several frame surveys," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 82(1), pages 71-86, January.
    11. Baffour Bernard & Haynes Michele & Western Mark & Pennay Darren & Misson Sebastian & Martinez Arturo, 2016. "Weighting Strategies for Combining Data from Dual-Frame Telephone Surveys: Emerging Evidence from Australia," Journal of Official Statistics, Sciendo, vol. 32(3), pages 549-578, September.
    12. repec:aia:aiaswp:153 is not listed on IDEAS
    13. Wilmer Prentius & Xin Zhao & Anton Grafström, 2021. "Combining Environmental Area Frame Surveys of a Finite Population," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 26(2), pages 250-266, June.
    14. Xu Xu & Peter Z. G. Qian & Qing Liu, 2016. "Samurai Sudoku-Based Space-Filling Designs for Data Pooling," The American Statistician, Taylor & Francis Journals, vol. 70(1), pages 1-8, February.
    15. Kleinert, Corinna & Ruland, Michael & Trahms, Annette, 2013. "Bias in einem komplexen Surveydesign : Ausfallprozesse und Selektivität in der IAB-Befragung ALWA," FDZ Methodenreport 201302_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    16. Hashimoto, Barry, 2020. "Autocratic Consent to International Law: The Case of the International Criminal Court's Jurisdiction, 1998–2017," International Organization, Cambridge University Press, vol. 74(2), pages 331-362, April.
    17. Elkasabi Mahmoud A. & Heeringa Steven G. & Lepkowski James M., 2015. "Joint Calibration Estimator for Dual Frame Surveys," Statistics in Transition New Series, Polish Statistical Association, vol. 16(1), pages 7-36, March.
    18. Maria Mar Rueda & Maria Giovanna Ranalli & Antonio Arcos & David Molina, 2021. "Population empirical likelihood estimation in dual frame surveys," Statistical Papers, Springer, vol. 62(5), pages 2473-2490, October.
    19. Linda J. Young & Michael Jacobsen, 2022. "Sample Design and Estimation When Using a Web-Scraped List Frame and Capture-Recapture Methods," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(2), pages 261-279, June.
    20. Mahmoud A. Elkasabi & Steven G. Heeringa & James M. Lepkowski, 2015. "Joint Calibration Estimator For Dual Frame Surveys," Statistics in Transition New Series, Polish Statistical Association, vol. 16(1), pages 7-36, March.
    21. Zachary D Rethorn & Alessandra N Garcia & Chad E Cook & Oren N Gottfried, 2020. "Quantifying the collective influence of social determinants of health using conditional and cluster modeling," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-18, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:56:y:2022:i:4:d:10.1007_s11135-021-01228-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.