IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v37y2017i3p298-313.html
   My bibliography  Save this article

The Role of Qualitative Research Methods in Discrete Choice Experiments

Author

Listed:
  • Caroline Vass
  • Dan Rigby
  • Katherine Payne

Abstract

Background . The use of qualitative research (QR) methods is recommended as good practice in discrete choice experiments (DCEs). This study investigated the use and reporting of QR to inform the design and/or interpretation of healthcare-related DCEs and explored the perceived usefulness of such methods. Methods . DCEs were identified from a systematic search of the MEDLINE database. Studies were classified by the quantity of QR reported (none, basic, or extensive). Authors ( n = 91) of papers reporting the use of QR were invited to complete an online survey eliciting their views about using the methods. Results . A total of 254 healthcare DCEs were included in the review; of these, 111 (44%) did not report using any qualitative methods; 114 (45%) reported “basic†information; and 29 (11%) reported or cited “extensive†use of qualitative methods. Studies reporting the use of qualitative methods used them to select attributes and/or levels ( n = 95; 66%) and/or pilot the DCE survey ( n = 26; 18%). Popular qualitative methods included focus groups ( n = 63; 44%) and interviews ( n = 109; 76%). Forty-four studies (31%) reported the analytical approach, with content ( n = 10; 7%) and framework analysis ( n = 5; 4%) most commonly reported. The survey identified that all responding authors ( n = 50; 100%) found that qualitative methods added value to their DCE study, but many ( n = 22; 44%) reported that journals were uninterested in the reporting of QR results. Conclusions . Despite recommendations that QR methods be used alongside DCEs, the use of QR methods is not consistently reported. The lack of reporting risks the inference that QR methods are of little use in DCE research, contradicting practitioners’ assessments. Explicit guidelines would enable more clarity and consistency in reporting, and journals should facilitate such reporting via online supplementary materials.

Suggested Citation

  • Caroline Vass & Dan Rigby & Katherine Payne, 2017. "The Role of Qualitative Research Methods in Discrete Choice Experiments," Medical Decision Making, , vol. 37(3), pages 298-313, April.
    • Handle: RePEc:sae:medema:v:37:y:2017:i:3:p:298-313
    DOI: 10.1177/0272989X16683934
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X16683934
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0272989X16683934?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Flynn, Terry N. & Louviere, Jordan J. & Peters, Tim J. & Coast, Joanna, 2007. "Best-worst scaling: What it can do for health care research and how to do it," Journal of Health Economics, Elsevier, vol. 26(1), pages 171-189, January.
    2. Chilton, S. M. & Hutchinson, W. G., 2003. "A qualitative examination of how respondents in a contingent valuation study rationalise their WTP responses to an increase in the quantity of the environmental good," Journal of Economic Psychology, Elsevier, vol. 24(1), pages 65-75, February.
    3. Joanna Coast, 1999. "The appropriate uses of qualitative methods in health economics," Health Economics, John Wiley & Sons, Ltd., vol. 8(4), pages 345-353, June.
    4. Vujicic, Marko & Shengelia, Bakhuti & Alfano, Marco & Thu, Ha Bui, 2011. "Physician shortages in rural Vietnam: Using a labor market approach to inform policy," Social Science & Medicine, Elsevier, vol. 73(7), pages 970-977.
    5. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    6. Joanna Coast & Hareth Al‐Janabi & Eileen J. Sutton & Susan A. Horrocks & A. Jane Vosper & Dawn R. Swancutt & Terry N. Flynn, 2012. "Using qualitative methods for attribute development for discrete choice experiments: issues and recommendations," Health Economics, John Wiley & Sons, Ltd., vol. 21(6), pages 730-741, June.
    7. Poulos, Christine & Yang, Jui-Chen & Levin, Carol & Van Minh, Hoang & Giang, Kim Bao & Nguyen, Diep, 2011. "Mothers' preferences and willingness to pay for HPV vaccines in Vinh Long Province, Vietnam," Social Science & Medicine, Elsevier, vol. 73(2), pages 226-234, July.
    8. Potoglou, Dimitris & Burge, Peter & Flynn, Terry & Netten, Ann & Malley, Juliette & Forder, Julien & Brazier, John E., 2011. "Best-worst scaling vs. discrete choice experiments: An empirical comparison using social care data," Social Science & Medicine, Elsevier, vol. 72(10), pages 1717-1727, May.
    9. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74(2), pages 132-132.
    10. Odejar, Maria & Baker, Rachel & Ryan, Mandy & Donalson, Cam & Bateman, Ian J. & Jones-Lee, M & Lancsar, Emily & Mason, Helen & Pinto Paredes, JL & Robinson, A & Shackley, P & Smith, R & Sugdem, R & Wi, 2010. "Weighting and valuing quality-adjusted life-years using stated preference methods: preliminary results from the Social Value of a QALY Project," MPRA Paper 108869, University Library of Munich, Germany.
    11. Hall, Jane & Fiebig, Denzil G. & King, Madeleine T. & Hossain, Ishrat & Louviere, Jordan J., 2006. "What influences participation in genetic carrier testing?: Results from a discrete choice experiment," Journal of Health Economics, Elsevier, vol. 25(3), pages 520-537, May.
    12. Hensher, David A. & Stopher, Peter R. & Louviere, Jordan J., 2001. "An exploratory analysis of the effect of numbers of choice sets in designed choice experiments: an airline choice application," Journal of Air Transport Management, Elsevier, vol. 7(6), pages 373-379.
    13. Marion Haas & Jane Hall & Richard De Abreu Lourenco, 2001. "It's what's expected: genetic testing for inherited conditions, CHERE Discussion Paper No 46," Discussion Papers 46, CHERE, University of Technology, Sydney.
    14. Lim, Jennifer N.W. & Edlin, Richard, 2009. "Preferences of older patients and choice of treatment location in the UK: A binary choice experiment," Health Policy, Elsevier, vol. 91(3), pages 252-257, August.
    15. Kjaer, Trine & Gyrd-Hansen, Dorte, 2008. "Preference heterogeneity and choice of cardiac rehabilitation program: Results from a discrete choice experiment," Health Policy, Elsevier, vol. 85(1), pages 124-132, January.
    16. Hall, Jane & Viney, Rosalie & Haas, Marion & Louviere, Jordan, 2004. "Using stated preference discrete choice modeling to evaluate health care programs," Journal of Business Research, Elsevier, vol. 57(9), pages 1026-1032, September.
    17. Kara Hanson & Barbara McPake & Pamela Nakamba & Luke Archard, 2005. "Preferences for hospital quality in Zambia: results from a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 14(7), pages 687-701, July.
    18. Bech, Mickael, 2003. "Politicians' and hospital managers' trade-offs in the choice of reimbursement scheme: a discrete choice experiment," Health Policy, Elsevier, vol. 66(3), pages 261-275, December.
    19. Ryan, Mandy & Netten, Ann & Skatun, Diane & Smith, Paul, 2006. "Using discrete choice experiments to estimate a preference-based measure of outcome--An application to social care for older people," Journal of Health Economics, Elsevier, vol. 25(5), pages 927-944, September.
    20. Stirling Bryan & Iestyn Williams & Shirley McIver, 2007. "Seeing the NICE side of cost‐effectiveness analysis: a qualitative investigation of the use of CEA in NICE technology appraisals," Health Economics, John Wiley & Sons, Ltd., vol. 16(2), pages 179-193, February.
    21. Baker, Rachel & Robinson, Angela & Smith, Richard, 2008. "How do respondents explain WTP responses? A review of the qualitative evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(4), pages 1427-1442, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rod Mccoll & Yann Truong & Antonella La Rocca, 2019. "Service guarantees as a base for positioning in B2B," Post-Print hal-02326105, HAL.
    2. Magda Aguiar & Mark Harrison & Sarah Munro & Tiasha Burch & K. Julia Kaal & Marie Hudson & Nick Bansback & Tracey-Lea Laba, 2021. "Designing Discrete Choice Experiments Using a Patient-Oriented Approach," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 14(4), pages 389-397, July.
    3. Sanjeewa Kularatna & Michelle Allen & Ruvini M. Hettiarachchi & Fiona Crawford-Williams & Sameera Senanayake & David Brain & Nicolas H. Hart & Bogda Koczwara & Carolyn Ee & Raymond J. Chan, 2023. "Cancer Survivor Preferences for Models of Breast Cancer Follow-Up Care: Selecting Attributes for Inclusion in a Discrete Choice Experiment," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 16(4), pages 371-383, July.
    4. David J. Mott & Laura Ternent & Luke Vale, 2023. "Do preferences differ based on respondent experience of a health issue and its treatment? A case study using a public health intervention," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(3), pages 413-423, April.
    5. Kim Edmunds & Laura Wall & Scott Brown & Andrew Searles & Anthony P. Shakeshaft & Christopher M. Doran, 2021. "Exploring Community-Based Options for Reducing Youth Crime," IJERPH, MDPI, vol. 18(10), pages 1-12, May.
    6. Gregory Merlo & Mieke Driel & Lisa Hall, 2020. "Systematic review and validity assessment of methods used in discrete choice experiments of primary healthcare professionals," Health Economics Review, Springer, vol. 10(1), pages 1-9, December.
    7. Cleland, Jennifer & Porteous, Terry & Ejebu, Ourega-Zoé & Ryan, Mandy & Skåtun, Diane, 2022. "Won't you stay just a little bit longer? A discrete choice experiment of UK doctors’ preferences for delaying retirement," Health Policy, Elsevier, vol. 126(1), pages 60-68.
    8. Marco Boeri & Alan J. McMichael & Joseph P. M. Kane & Francis A. O’Neill & Frank Kee, 2018. "Physician-Specific Maximum Acceptable Risk in Personalized Medicine: Implications for Medical Decision Making," Medical Decision Making, , vol. 38(5), pages 593-600, July.
    9. Elizabeth Clearfield & Ellen Tambor & Ellen M. Janssen & Donna A. Messner, 2021. "Increasing the Patient-Centeredness of Health Economics and Outcomes Research Through Patient Engagement in Core Outcome Set Development," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 14(4), pages 413-420, July.
    10. Martin Emmert & Stefan Rohrbacher & Florian Meier & Laura Heppe & Cordula Drach & Anja Schindler & Uwe Sander & Christiane Patzelt & Cornelia Frömke & Oliver Schöffski & Michael Lauerer, 2024. "The elicitation of patient and physician preferences for calculating consumer-based composite measures on hospital report cards: results of two discrete choice experiments," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 25(6), pages 1071-1085, August.
    11. Simon Deeming & Kim Edmunds & Alice Knight & Andrew Searles & Anthony P. Shakeshaft & Christopher M. Doran, 2022. "A Benefit-Cost Analysis of BackTrack, a Multi-Component, Community-Based Intervention for High-Risk Young People in a Rural Australian Setting," IJERPH, MDPI, vol. 19(16), pages 1-12, August.
    12. Ruixuan Jiang & Eleanor Pullenayegum & James W. Shaw & Axel Mühlbacher & Todd A. Lee & Surrey Walton & Thomas Kohlmann & Richard Norman & A. Simon Pickard, 2023. "Comparison of Preferences and Data Quality between Discrete Choice Experiments Conducted in Online and Face-to-Face Respondents," Medical Decision Making, , vol. 43(6), pages 667-679, August.
    13. Galárraga, Omar & Kuo, Caroline & Mtukushe, Bulelwa & Maughan-Brown, Brendan & Harrison, Abigail & Hoare, Jackie, 2020. "iSAY (incentives for South African youth): Stated preferences of young people living with HIV," Social Science & Medicine, Elsevier, vol. 265(C).
    14. Merle Gijsbers & Iris Elise Keizer & Stephanie Else Schouten & Janneke Louise Trompert & Catharina G. M. Groothuis-Oudshoorn & Janine Astrid Til, 2021. "Public Preferences in Priority Setting when Admitting Patients to the ICU During the COVID-19 Crisis: A Pilot Study," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 14(3), pages 331-338, May.
    15. Damon Willems & Eva-Lotta Hinzpeter & Hessel H. Zee & Christopher J. Sayed & John R. Ingram & Charlotte Beaudart & Silvia M. A. A. Evers & Mickael Hiligsmann, 2023. "Patient Preferences in the Management of Hidradenitis Suppurativa: Results of a Multinational Discrete Choice Experiment in Europe," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 16(2), pages 153-164, March.
    16. Jackson, Louise & Al-Janabi, Hareth & Roberts, Tracy & Ross, Jonthan, 2021. "Exploring young people's preferences for STI screening in the UK: A qualitative study and discrete choice experiment," Social Science & Medicine, Elsevier, vol. 279(C).
    17. Osborne, Matthew & Lambe, Fiona & Ran, Ylva & Dehmel, Naira & Tabacco, Giovanni Alberto & Balungira, Joshua & Pérez-Viana, Borja & Widmark, Erik & Holmlid, Stefan & Verschoor, Arjan, 2022. "Designing development interventions: The application of service design and discrete choice experiments in complex settings," World Development, Elsevier, vol. 158(C).
    18. Adewole, Ayooluwa & Shipworth, Michelle & Lemaire, Xavier & Sanderson, Danielle, 2023. "Peer-to-Peer energy trading, independence aspirations and financial benefits among Nigerian households," Energy Policy, Elsevier, vol. 174(C).
    19. Colene Bentley & Sara Izadi-Najafabadi & Adam Raymakers & Helen McTaggart-Cowan, 2022. "Qualitative Research Informing a Preference Study on Selecting Cannabis for Cancer Survivor Symptom Management: Design of a Discrete Choice Experiment," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 15(4), pages 497-507, July.
    20. Sarah Costa & Dean A. Regier & Adam J. N. Raymakers & Samantha Pollard, 2021. "Genomic Testing for Relapsed and Refractory Lymphoid Cancers: Understanding Patient Values," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 14(2), pages 187-196, March.
    21. Lina Isacs & Cecilia Håkansson & Therese Lindahl & Ulrika Gunnarsson-Östling & Pernilla Andersson, 2024. "‘I didn’t count “willingness to pay†as part of the value’: Monetary valuation through respondents’ perspectives," Environmental Values, , vol. 33(2), pages 163-188, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    2. Emily Lancsar & Peter Burge, 2014. "Choice modelling research in health economics," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 28, pages 675-687, Edward Elgar Publishing.
    3. Nicolas Krucien & Verity Watson & Mandy Ryan, 2017. "Is Best–Worst Scaling Suitable for Health State Valuation? A Comparison with Discrete Choice Experiments," Health Economics, John Wiley & Sons, Ltd., vol. 26(12), pages 1-16, December.
    4. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    5. Denise Doiron & Hong Il Yoo, 2020. "Stated preferences over job characteristics: A panel study," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(1), pages 43-82, February.
    6. Jennifer A Whitty & Ruth Walker & Xanthe Golenko & Julie Ratcliffe, 2014. "A Think Aloud Study Comparing the Validity and Acceptability of Discrete Choice and Best Worst Scaling Methods," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-9, April.
    7. Mamine, Fateh & Fares, M'hand & Minviel, Jean Joseph, 2020. "Contract Design for Adoption of Agrienvironmental Practices: A Meta-analysis of Discrete Choice Experiments," Ecological Economics, Elsevier, vol. 176(C).
    8. Lancsar, Emily & Louviere, Jordan & Donaldson, Cam & Currie, Gillian & Burgess, Leonie, 2013. "Best worst discrete choice experiments in health: Methods and an application," Social Science & Medicine, Elsevier, vol. 76(C), pages 74-82.
    9. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    10. Bart Neuts & Peter Nijkamp & Eveline Van Leeuwen, 2012. "Crowding Externalities from Tourist Use of Urban Space," Tourism Economics, , vol. 18(3), pages 649-670, June.
    11. Hunt, Priscillia E & Smart, Rosanna, 2020. "Investigation of Employers' Preferences for the Design of Staffing Agency Incentives to Hire Ex-Felons," IZA Discussion Papers 13520, Institute of Labor Economics (IZA).
    12. Mehdi Ammi & Christine Peyron, 2016. "Heterogeneity in general practitioners’ preferences for quality improvement programs: a choice experiment and policy simulation in France," Health Economics Review, Springer, vol. 6(1), pages 1-11, December.
    13. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    14. Peyron, Christine & Pélissier, Aurore & Béjean, Sophie, 2018. "Preference heterogeneity with respect to whole genome sequencing. A discrete choice experiment among parents of children with rare genetic diseases," Social Science & Medicine, Elsevier, vol. 214(C), pages 125-132.
    15. Osborne, Matthew & Lambe, Fiona & Ran, Ylva & Dehmel, Naira & Tabacco, Giovanni Alberto & Balungira, Joshua & Pérez-Viana, Borja & Widmark, Erik & Holmlid, Stefan & Verschoor, Arjan, 2022. "Designing development interventions: The application of service design and discrete choice experiments in complex settings," World Development, Elsevier, vol. 158(C).
    16. Julie Ratcliffe & Terry Flynn & Frances Terlich & Katherine Stevens & John Brazier & Michael Sawyer, 2012. "Developing Adolescent-Specific Health State Values for Economic Evaluation," PharmacoEconomics, Springer, vol. 30(8), pages 713-727, August.
    17. Pierre-Alexandre Mahieu & Henrik Andersson & Olivier Beaumais & Romain Crastes & François-Charles Wolff, 2014. "Is Choice Experiment Becoming more Popular than Contingent Valuation? A Systematic Review in Agriculture, Environment and Health," Working Papers 2014.12, FAERE - French Association of Environmental and Resource Economists.
    18. Yoo, Hong Il & Doiron, Denise, 2013. "The use of alternative preference elicitation methods in complex discrete choice experiments," Journal of Health Economics, Elsevier, vol. 32(6), pages 1166-1179.
    19. Aleksandra Torbica & Carla Rognoni & Rosanna Tarricone, 2021. "Investigating Patients’ Preferences to Inform Drug Development Decisions: Novel Insights from a Discrete Choice Experiment in Migraine," IJERPH, MDPI, vol. 18(9), pages 1-18, May.
    20. Paul Scuffham & Jennifer Whitty & Matthew Taylor & Ruth Saxby, 2010. "Health system choice," Applied Health Economics and Health Policy, Springer, vol. 8(2), pages 89-97, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:37:y:2017:i:3:p:298-313. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.