IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v8y2020i3p423-d332727.html
   My bibliography  Save this article

Treating Nonresponse in Probability-Based Online Panels through Calibration: Empirical Evidence from a Survey of Political Decision-Making Procedures

Author

Listed:
  • Antonio Arcos

    (Department of Statistics and Operational Research, University of Granada, 18071 Granada, Spain)

  • Maria del Mar Rueda

    (Department of Statistics and Operational Research, University of Granada, 18071 Granada, Spain)

  • Sara Pasadas-del-Amo

    (Institute for Advanced Social Studies, 14004 Cordoba, Spain)

Abstract

The use of probability-based panels that collect data via online or mixed-mode surveys has increased in the last few years as an answer to the growing concern with the quality of the data obtained with traditional survey modes. However, in order to adequately represent the general population, these tools must address the same sources of bias that affect other survey-based designs: namely under coverage and non-response. In this work, we test several approaches to produce calibration estimators that are suitable for survey data affected by non response where auxiliary information exists at both the panel level and the population level. The first approach adjusts the results obtained in the cross-sectional survey to the population totals, while, in the second, the weights are the result of two-step process where different adjusts on the sample, panel, and population are done. A simulation on the properties of these estimators is performed. In light of theory and simulation results, we conclude that weighting by calibration is an effective technique for the treatment of non-response bias when the response mechanism is missing at random. These techniques have also been applied to real data from the survey Andalusian Citizen Preferences for Political Decision-Making Procedures.

Suggested Citation

  • Antonio Arcos & Maria del Mar Rueda & Sara Pasadas-del-Amo, 2020. "Treating Nonresponse in Probability-Based Online Panels through Calibration: Empirical Evidence from a Survey of Political Decision-Making Procedures," Mathematics, MDPI, vol. 8(3), pages 1-16, March.
  • Handle: RePEc:gam:jmathe:v:8:y:2020:i:3:p:423-:d:332727
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/8/3/423/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/8/3/423/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alfons, Andreas & Templ, Matthias & Filzmoser, Peter, 2010. "An Object-Oriented Framework for Statistical Simulation: The R Package simFrame," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 37(i03).
    2. repec:aph:ajpbhl:10.2105/ajph.2016.303512_4 is not listed on IDEAS
    3. Lilli Japec & Frauke Kreuter & Marcus Berg & Paul Biemer & Paul Decker & Cliff Lampe & Julia Lane & Cathy O’Neil & Abe Usher, "undated". "Big Data in Survey Research: AAPOR Task Force Report," Mathematica Policy Research Reports c57e7c039f6a4db982b26c6fe, Mathematica Policy Research.
    4. Joan Font & Magdalena Wojcieszak & Clemente J. Navarro, 2015. "Participation, Representation and Expertise: Citizen Preferences for Political Decision-Making Processes," Political Studies, Political Studies Association, vol. 63, pages 153-172, April.
    5. Sinnenberg, L. & Buttenheim, A.M. & Padrez, K. & Mancheno, C. & Ungar, L. & Merchant, R.M., 2017. "Twitter as a tool for health research: A systematic review," American Journal of Public Health, American Public Health Association, vol. 107(1), pages 1-8.
    6. Templ, Matthias & Meindl, Bernhard & Kowarik, Alexander & Dupriez, Olivier, 2017. "Simulation of Synthetic Complex Data: The R Package simPop," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 79(i10).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amir Haghighati & Kamran Sedig, 2020. "VARTTA: A Visual Analytics System for Making Sense of Real-Time Twitter Data," Data, MDPI, vol. 5(1), pages 1-25, February.
    2. John Mary Kanyamurwa & Joseph Okeyo Obosi, 2020. "The Influence of Citizen Competence on District Level Political Accountability in Uganda," Journal of Public Administration and Governance, Macrothink Institute, vol. 10(3), pages 443462-4434, December.
    3. Luis-Millán González & José Devís-Devís & Maite Pellicer-Chenoll & Miquel Pans & Alberto Pardo-Ibañez & Xavier García-Massó & Fernanda Peset & Fernanda Garzón-Farinós & Víctor Pérez-Samaniego, 2021. "The Impact of COVID-19 on Sport in Twitter: A Quantitative and Qualitative Content Analysis," IJERPH, MDPI, vol. 18(9), pages 1-20, April.
    4. Silvia De Nicol`o & Maria Rosaria Ferrante & Silvia Pacei, 2021. "Mind the Income Gap: Bias Correction of Inequality Estimators in Small-Sized Samples," Papers 2107.08950, arXiv.org, revised May 2023.
    5. Anni Arumsari Fitriany & Piotr J. Flatau & Khoirunurrofik Khoirunurrofik & Nelly Florida Riama, 2021. "Assessment on the Use of Meteorological and Social Media Information for Forest Fire Detection and Prediction in Riau, Indonesia," Sustainability, MDPI, vol. 13(20), pages 1-13, October.
    6. Guangyu Hu & Xueyan Han & Huixuan Zhou & Yuanli Liu, 2019. "Public Perception on Healthcare Services: Evidence from Social Media Platforms in China," IJERPH, MDPI, vol. 16(7), pages 1-10, April.
    7. Roszka Wojciech, 2019. "Spatial Microsimulation Of Personal Income In Poland At The Level Of Subregions," Statistics in Transition New Series, Statistics Poland, vol. 20(3), pages 133-153, September.
    8. Umar Ali Bukar & Fatimah Sidi & Marzanah A. Jabar & Rozi Nor Haizan Nor & Salfarina Abdullah & Iskandar Ishak & Mustafa Alabadla & Ali Alkhalifah, 2022. "How Advanced Technological Approaches Are Reshaping Sustainable Social Media Crisis Management and Communication: A Systematic Review," Sustainability, MDPI, vol. 14(10), pages 1-26, May.
    9. Martina Patone & Li‐Chun Zhang, 2021. "On Two Existing Approaches to Statistical Analysis of Social Media Data," International Statistical Review, International Statistical Institute, vol. 89(1), pages 54-71, April.
    10. Carlos Rico Motos, 2019. "‘Let the Citizens Fix This Mess!’ Podemos’ Claim for Participatory Democracy in Spain," Politics and Governance, Cogitatio Press, vol. 7(2), pages 187-197.
    11. Lutz Bornmann & Robin Haunschild & Vanash M Patel, 2020. "Are papers addressing certain diseases perceived where these diseases are prevalent? The proposal to use Twitter data as social-spatial sensors," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-22, November.
    12. Alfons, Andreas & Croux, Christophe & Gelper, Sarah, 2016. "Robust groupwise least angle regression," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 421-435.
    13. Philipp Harms & Claudia Landwehr & Maximilian Lutz & Markus Tepe, 2020. "Deciding how to decide on public goods provision: The role of instrumental vs. intrinsic motives," Working Papers 2018, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    14. Christensen, Henrik Serup, 2019. "How citizens evaluate participatory processes: A conjoint analysis," SocArXiv 5t72a, Center for Open Science.
    15. S. Rinken & S. Pasadas-del-Amo & M. Rueda & B. Cobo, 2021. "No magic bullet: estimating anti-immigrant sentiment and social desirability bias with the item-count technique," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(6), pages 2139-2159, December.
    16. Muhammad Imran & Umair Qazi & Ferda Ofli, 2022. "TBCOV: Two Billion Multilingual COVID-19 Tweets with Sentiment, Entity, Geo, and Gender Labels," Data, MDPI, vol. 7(1), pages 1-27, January.
    17. Mihaela Constantinescu & Andreea Orîndaru & Ștefan-Claudiu Căescu & Andreea Pachițanu, 2019. "Sustainable Development of Urban Green Areas for Quality of Life Improvement—Argument for Increased Citizen Participation," Sustainability, MDPI, vol. 11(18), pages 1-16, September.
    18. Isaac Chun-Hai Fung & Jingjing Yin & Keisha D. Pressley & Carmen H. Duke & Chen Mo & Hai Liang & King-Wa Fu & Zion Tsz Ho Tse & Su-I Hou, 2019. "Pedagogical Demonstration of Twitter Data Analysis: A Case Study of World AIDS Day, 2014," Data, MDPI, vol. 4(2), pages 1-12, June.
    19. Rachid Belaroussi & Younes Delhoum, 2024. "Forecasting Daily Activity Plans of a Synthetic Population in an Upcoming District," Forecasting, MDPI, vol. 6(2), pages 1-26, May.
    20. Alfons, Andreas & Templ, Matthias, 2013. "Estimation of Social Exclusion Indicators from Complex Surveys: The R Package laeken," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 54(i15).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:8:y:2020:i:3:p:423-:d:332727. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.