IDEAS home Printed from https://ideas.repec.org/a/spr/patien/v14y2021i1d10.1007_s40271-020-00484-x.html
   My bibliography  Save this article

Mobilising the Next Generation of Stated-Preference Studies: the Association of Access Device with Choice Behaviour and Data Quality

Author

Listed:
  • Caroline M. Vass

    (RTI Health Solutions
    The University of Manchester)

  • Marco Boeri

    (RTI Health Solutions)

Abstract

Background Literature reviews show stated-preference studies, used to understand the values individuals place on health and health care, are increasingly administered online, potentially maximising respondent access and allowing for enhanced response quality. Online respondents may often choose whether to use a desktop or laptop personal computer (PC), tablet or smartphone, all with different screen sizes and modes of data entry, to complete the survey. To avoid differences in measurement errors, frequently respondents are asked to complete the surveys on a PC despite evidence that handheld devices are increasingly used for internet browsing. As yet, it is unknown if or how the device used to access the survey affects responses and/or the subsequent valuations derived. Method This study uses data from a discrete choice experiment (DCE) administered online to elicit preferences of a general population sample of females for a national breast screening programme. The analysis explores differences in key outcomes such as completion rates, engagement with the survey materials, respondent characteristics, response time, failure of an internal validity test and health care preferences for (1) handheld devices and (2) PC users. Preferences were analysed using a fully correlated random parameter logit (RPL) model to allow for unexplained scale and preference heterogeneity. Results One thousand respondents completed the survey in its entirety. The most popular access devices were PCs (n = 785), including Windows (n = 705) and Macbooks (n = 69). Two-hundred and fifteen respondents accessed the survey on a handheld device. Most outcomes related to survey behaviour, including failure of a dominance check, ‘flat lining’, self-reported attribute non-attendance (ANA) or respondent-rated task difficulty, did not differ by device type (p > 0.100). Respondents accessing the survey using a PC were generally quicker (median time to completion 14.5 min compared with 16 min for those using handheld devices) and were significantly less likely to speed through a webpage. Although there was evidence of preference intensity (taste) or variability (scale) heterogeneity across respondents in the sample, it was not driven by the access device. Conclusion Overall, we find that neither preferences nor choice behaviour is associated with the type of access device, as long as respondents are presented with question formats that are easy to use on small touchscreens. Health preference researchers should optimise preference instruments for a range of devices and encourage respondents to complete the surveys using their preferred device. However, we suggest that access device characteristics should be gathered and included when reporting results.

Suggested Citation

  • Caroline M. Vass & Marco Boeri, 2021. "Mobilising the Next Generation of Stated-Preference Studies: the Association of Access Device with Choice Behaviour and Data Quality," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 14(1), pages 55-63, January.
    • Handle: RePEc:spr:patien:v:14:y:2021:i:1:d:10.1007_s40271-020-00484-x
    DOI: 10.1007/s40271-020-00484-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40271-020-00484-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40271-020-00484-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stephanie L. Lim & Jui-Chen Yang & Jessie Ehrisman & Laura J. Havrilesky & Shelby D. Reed, 2020. "Are Videos or Text Better for Describing Attributes in Stated-Preference Surveys?," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 13(4), pages 401-408, August.
    2. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, January.
    3. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521747387, January.
    4. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    5. Michael Clark & Domino Determann & Stavros Petrou & Domenico Moro & Esther Bekker-Grob, 2014. "Discrete Choice Experiments in Health Economics: A Review of the Literature," PharmacoEconomics, Springer, vol. 32(9), pages 883-902, September.
    6. Caroline Vass & Dan Rigby & Katherine Payne, 2019. "“I Was Trying to Do the Maths”: Exploring the Impact of Risk Communication in Discrete Choice Experiments," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 12(1), pages 113-123, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vass, Caroline M. & Boeri, Marco & Poulos, Christine & Turner, Alex J., 2022. "Matching and weighting in stated preferences for health care," Journal of choice modelling, Elsevier, vol. 44(C).
    2. Benjamin Matthew Craig & Kim Rand & John D. Hartman, 2022. "Preference Paths and Their Kaizen Tasks for Small Samples," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 15(2), pages 187-196, March.
    3. Thao Thai & Michiel Bliemer & Gang Chen & Jean Spinks & Sonja de New & Emily Lancsar, 2023. "Comparison of a full and partial choice set design in a labeled discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 32(6), pages 1284-1304, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    2. Mesfin G. Genie & Nicolas Krucien & Mandy Ryan, 2021. "Weighting or aggregating? Investigating information processing in multi‐attribute choices," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1291-1305, June.
    3. Ting Li & Robert J. Kauffman & Eric van Heck & Peter Vervest & Benedict G. C. Dellaert, 2014. "Consumer Informedness and Firm Information Strategy," Information Systems Research, INFORMS, vol. 25(2), pages 345-363, June.
    4. Basu, Debasis & Hunt, John Douglas, 2012. "Valuing of attributes influencing the attractiveness of suburban train service in Mumbai city: A stated preference approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 46(9), pages 1465-1476.
    5. Robert Turner, 2013. "Using contingent choice surveys to inform national park management," Journal of Environmental Studies and Sciences, Springer;Association of Environmental Studies and Sciences, vol. 3(2), pages 120-138, June.
    6. Alfnes, Frode & Steine, Gro, 2005. "None-of-These Bias in Stated Choice Experiments," 2005 International Congress, August 23-27, 2005, Copenhagen, Denmark 24761, European Association of Agricultural Economists.
    7. De Valck, Jeremy & Vlaeminck, Pieter & Liekens, Inge & Aertsens, Joris & Chen, Wendy & Vranken, Liesbet, 2012. "The sources of preference heterogeneity for nature restoration scenarios," Working Papers 146522, Katholieke Universiteit Leuven, Centre for Agricultural and Food Economics.
    8. Anastassiadis, Friederike & Liebe, Ulf & Musshoff, Oliver, 2012. "Finanzielle Flexibilität In Landwirtschaftlichen Investitionsentscheidungen: Ein Discrete Choice Experiment," 52nd Annual Conference, Stuttgart, Germany, September 26-28, 2012 137142, German Association of Agricultural Economists (GEWISOLA).
    9. Nguyen, Ly & Gao, Zhifeng & Anderson, James L., 2022. "Regulating menu information: What do consumers care and not care about at casual and fine dining restaurants for seafood consumption?," Food Policy, Elsevier, vol. 110(C).
    10. Bechtold, Kai-Brit & Abdulai, Awudu, 2012. "Using Choice Experiments to Measure Consumers’ Preferences for Functional Dairy Products in Germany: Are Willingness-To-Pay Estimates Affected by Starting Point Bias?," 86th Annual Conference, April 16-18, 2012, Warwick University, Coventry, UK 135073, Agricultural Economics Society.
    11. Sriwastava, Ambuj & Reichert, Peter, 2023. "Reducing sample size requirements by extending discrete choice experiments to indifference elicitation," Journal of choice modelling, Elsevier, vol. 48(C).
    12. Raux, Charles & Chevalier, Amandine & Bougna, Emmanuel & Hilton, Denis, 2021. "Mobility choices and climate change: Assessing the effects of social norms, emissions information and economic incentives," Research in Transportation Economics, Elsevier, vol. 90(C).
    13. Gorm Kipperberg & Douglas Larson, 2012. "Heterogeneous Preferences for Community Recycling Programs," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 53(4), pages 577-604, December.
    14. Van Loo, Ellen J. & Caputo, Vincenzina & Lusk, Jayson L., 2020. "Consumer preferences for farm-raised meat, lab-grown meat, and plant-based meat alternatives: Does information or brand matter?," Food Policy, Elsevier, vol. 95(C).
    15. Nguyen, Ly & Gao, Zhifeng & Anderson, James L. & House, Lisa A., 2022. "The Impacts of Covid-19 on Consumers’ Willingness to Pay for Information Transparency at Casual and Fine Dining Restaurants," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322463, Agricultural and Applied Economics Association.
    16. Espino, Raquel & de Dios Ortúzar, Juan & Román, Concepción, 2007. "Understanding suburban travel demand: Flexible modelling with revealed and stated choice data," Transportation Research Part A: Policy and Practice, Elsevier, vol. 41(10), pages 899-912, December.
    17. De Ayala Bilbao, Amaya & Hoyos Ramos, David & Mariel Chladkova, Petr, 2012. "Landscape valuation through discrete choice experiments: Current practice and future research reflections," BILTOKI 1134-8984, Universidad del País Vasco - Departamento de Economía Aplicada III (Econometría y Estadística).
    18. Lizin, Sebastien & Van Passel, Steven & Schreurs, Eloi, 2015. "Farmres' Perceived Cost of Land Use restrictions: A Simulated Purchasing Decision Using Dscrete Choice Experiments," 2015 Conference, August 9-14, 2015, Milan, Italy 212054, International Association of Agricultural Economists.
    19. Elisabetta Strazzera & Elisabetta Cherchi & Silvia Ferrini, 2010. "Assessment of Regeneration Projects in Urban Areas of Environmental Interest: A Stated Choice Approach to Estimate Use and Quasi-Option Values," Environment and Planning A, , vol. 42(2), pages 452-468, February.
    20. Uggeldahl, Kennet & Jacobsen, Catrine & Lundhede, Thomas Hedemark & Olsen, Søren Bøye, 2016. "Choice certainty in Discrete Choice Experiments: Will eye tracking provide useful measures?," Journal of choice modelling, Elsevier, vol. 20(C), pages 35-48.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:patien:v:14:y:2021:i:1:d:10.1007_s40271-020-00484-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.