IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v14y2024i2p21582440241252116.html
   My bibliography  Save this article

Comparing Data Quality and Response Behavior Between Smartphone, Tablet, and Computer Devices in Responsive Design Online Surveys

Author

Listed:
  • Jean Philippe Décieux
  • Philipp E. Sischka

Abstract

Mobile device usage in online surveys has steadily increased in recent years. As mobile devices differ, for example, in their handling, from computers, device effects within online surveys are found for several data quality indicators. However, results concerning these device effects are neither comprehensive nor conclusive because existing research are often based on non-optimized designs or do not account for the type of mobile device, for example, smartphone or tablet. This study uses data from the emigrant sample of the German Emigration and Remigration Panel Study (GERPS) a probability-based online survey ( n  = 4,888)—which made use of a mobile-optimized design—to compare data quality between smartphone, tablet, and computer respondents. Propensity score weighting was employed to account for device choice selectivity effects. The data quality indicators showed mixed results and smaller data quality differences across computers, smartphones, and tablets compared to previous studies. Higher dropout rates on mobile devices and here especially on smartphones remain the major challenge for survey participation, especially on small screens. However, our results render mixed-device data collection via mobile-optimized online surveys as a promising data collection approach, especially for exploiting the large response potentially associated with smartphone and tablet respondents.

Suggested Citation

  • Jean Philippe Décieux & Philipp E. Sischka, 2024. "Comparing Data Quality and Response Behavior Between Smartphone, Tablet, and Computer Devices in Responsive Design Online Surveys," SAGE Open, , vol. 14(2), pages 21582440241, May.
    • Handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241252116
    DOI: 10.1177/21582440241252116
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/21582440241252116
    Download Restriction: no
    File URL: https://libkey.io/10.1177/21582440241252116?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    2. Suiwen (Sharon) Zou & Karen P.S. Tan & Hongbo Liu & Xiang (Robert) Li & Ye Chen, 2021. "Mobile vs. PC: the device mode effects on tourism online survey response quality," Current Issues in Tourism, Taylor & Francis Journals, vol. 24(10), pages 1345-1357, May.
    3. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    4. Liebe, Ulf & Glenk, Klaus & Oehlmann, Malte & Meyerhoff, Jürgen, 2015. "Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?," Journal of choice modelling, Elsevier, vol. 14(C), pages 17-31.
    5. King, Gary & Nielsen, Richard, 2019. "Why Propensity Scores Should Not Be Used for Matching," Political Analysis, Cambridge University Press, vol. 27(4), pages 435-454, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Riccardo Turati, 2025. "Networks abroad and culture: global individual-level evidence," Journal of Population Economics, Springer;European Society for Population Economics, vol. 38(1), pages 1-42, March.
    2. Maria Laura Victória Marques & Daniel de Abreu Pereira Uhr & Bruno Benevit & Júlia Gallego Ziero Uhr, 2024. "An analysis of the relationship between rental housing and adoption of self‐generating energy sources in Brazil using matching methodology," Journal of International Development, John Wiley & Sons, Ltd., vol. 36(2), pages 1570-1592, March.
    3. Apeti, Ablam Estel & Combes, Jean-Louis & Minea, Alexandru, 2024. "Inflation targeting and fiscal policy volatility: Evidence from developing countries," Journal of International Money and Finance, Elsevier, vol. 141(C).
    4. Seonho Shin, 2022. "Evaluating the Effect of the Matching Grant Program for Refugees: An Observational Study Using Matching, Weighting, and the Mantel-Haenszel Test," Journal of Labor Research, Springer, vol. 43(1), pages 103-133, March.
    5. Fukui Hideki, 2023. "Evaluating Different Covariate Balancing Methods: A Monte Carlo Simulation," Statistics, Politics and Policy, De Gruyter, vol. 14(2), pages 205-326, June.
    6. Bensch, Gunther & Kluve, Jochen & Stöterau, Jonathan, 2021. "The market-based dissemination of energy-access technologies as a business model for rural entrepreneurs: Evidence from Kenya," Resource and Energy Economics, Elsevier, vol. 66(C).
    7. Takahashi, Ryo, 2021. "How to stimulate environmentally friendly consumption: Evidence from a nationwide social experiment in Japan to promote eco-friendly coffee," Ecological Economics, Elsevier, vol. 186(C).
    8. Dugstad, Anders & Grimsrud, Kristine & Kipperberg, Gorm & Lindhjem, Henrik & Navrud, Ståle, 2020. "Acceptance of wind power development and exposure – Not-in-anybody's-backyard," Energy Policy, Elsevier, vol. 147(C).
    9. Camboni, Riccardo & Corsini, Alberto & Miniaci, Raffaele & Valbonesi, Paola, 2021. "Mapping fuel poverty risk at the municipal level. A small-scale analysis of Italian Energy Performance Certificate, census and survey data," Energy Policy, Elsevier, vol. 155(C).
    10. Chadi, Adrian & Hetschko, Clemens, 2025. "Income or leisure? On the hidden benefits of (un)employment," European Economic Review, Elsevier, vol. 171(C).
    11. Mazumder, Sharif & Rao, Ramesh, 2023. "Social trust and the choice between bank debt and public debt: Evidence from international data," Journal of Multinational Financial Management, Elsevier, vol. 67(C).
    12. Florian Gunsilius & Yuliang Xu, 2021. "Matching for causal effects via multimarginal unbalanced optimal transport," Papers 2112.04398, arXiv.org, revised Jul 2022.
    13. Everding, Jakob & Marcus, Jan, 2020. "The effect of unemployment on the smoking behavior of couples," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 29(2), pages 154-170.
    14. Akoh Fabien Yao & Maxime Sèbe & Laura Recuero Virto & Abdelhak Nassiri & Hervé Dumez, 2024. "The effect of LNG bunkering on port competitiveness using multilevel data analysis [L'effet du soutage par GNL sur la compétitivité des ports à l'aide de l'analyse de données à plusieurs niveaux]," Post-Print hal-04611804, HAL.
    15. Qi Guo & Lawrence Kryzanowski & Mingyang Li & Jie Zhang, 2021. "Share‐loan pledging and relaxation of share‐repurchase restrictions in China," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(5), pages 5925-5964, December.
    16. Mohamed Ali Marouani & Michelle Marshalian, 2020. "Winners and losers in industrial policy 2.0," WIDER Working Paper Series wp-2020-21, World Institute for Development Economic Research (UNU-WIDER).
    17. Do, Trung K., 2024. "Asset redeployability and green innovation," Journal of Financial Stability, Elsevier, vol. 72(C).
    18. Gudibande, Rohan Ravindra & Jacob, Arun, 2020. "Minimum wages for domestic workers: impact evaluation of the Indian experience," World Development, Elsevier, vol. 130(C).
    19. Alda, Erik, 2020. "The effects of body-worn cameras on police efficiency: A study of local police agencies in the US," MPRA Paper 103994, University Library of Munich, Germany.
    20. Florian Neumeier, 2018. "Do Businessmen Make Good Governors?," Economic Inquiry, Western Economic Association International, vol. 56(4), pages 2116-2136, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241252116. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.