IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i3p955-980.html
   My bibliography  Save this article

A new experiment on the use of images to answer web survey questions

Author

Listed:
  • Oriol J. Bosch
  • Melanie Revilla
  • Danish Daniel Qureshi
  • Jan Karem Höhne

Abstract

Images might provide richer and more objective information than text answers to open‐ended survey questions. Little is known, nonetheless, about the consequences for data quality of asking participants to answer open‐ended questions with images. Therefore, this paper addresses three research questions: (1) What is the effect of answering web survey questions with images instead of text on breakoff, noncompliance with the task, completion time and question evaluation? (2) What is the effect of including a motivational message on these four aspects? (3) Does the impact of asking to answer with images instead of text vary across device types? To answer these questions, we implemented a 2 × 3 between‐subject web survey experiment (N = 3043) in Germany. Half of the sample was required to answer using PCs and the other half with smartphones. Within each device group, respondents were randomly assigned to (1) a control group answering open‐ended questions with text; (2) a treatment group answering open‐ended questions with images; and (3) another treatment group answering open‐ended questions with images but prompted with a motivational message. Results show that asking participants to answer with images significantly increases participants' likelihood of noncompliance as well as their completion times, while worsening their overall survey experience. Including motivational messages, moreover, moderately reduces the likelihood of noncompliance. Finally, the likelihood of noncompliance is similar across devices.

Suggested Citation

  • Oriol J. Bosch & Melanie Revilla & Danish Daniel Qureshi & Jan Karem Höhne, 2022. "A new experiment on the use of images to answer web survey questions," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 955-980, July.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:955-980
    DOI: 10.1111/rssa.12856
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12856
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12856?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Oriol J. Bosch & Melanie Revilla, 2021. "Using emojis in mobile web surveys for Millennials? A study in Spain and Mexico," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(1), pages 39-61, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Almudena Barrientos-Báez & Juan Enrique Gonzálvez-Vallés & José Daniel Barquero-Cabrero & David Caldevilla-Domínguez, 2022. "Spanish Tipsters and the Millennial and Centennial Generations in the Scenario of a Pandemic," Media and Communication, Cogitatio Press, vol. 10(1), pages 286-296.
    2. Bosch Jover, Oriol & Revilla, Melanie & Qureshi, Danish Daniel & Höhne, Jan, 2022. "A new experiment on the use of images to answer web survey questions," LSE Research Online Documents on Economics 114899, London School of Economics and Political Science, LSE Library.
    3. Kathleen Mead Vandiver & Esther Erdei & Amanda G. Mayer & Catherine Ricciardi & Marcia O’Leary & Kathleen Burke & Judith T. Zelikoff, 2022. "Building Environmental Health and Genomics Literacy among Healthcare Providers Serving Vulnerable Communities: An Innovative Educational Framework," IJERPH, MDPI, vol. 19(2), pages 1-21, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:955-980. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.