IDEAS home Printed from https://ideas.repec.org/a/spr/pharme/v32y2014i10p951-965.html
   My bibliography  Save this article

Reconceptualising the External Validity of Discrete Choice Experiments

Author

Listed:
  • Emily Lancsar
  • Joffre Swait

Abstract

External validity is a crucial but under-researched topic when considering using discrete choice experiment (DCE) results to inform decision making in clinical, commercial or policy contexts. We present the theory and tests traditionally used to explore external validity that focus on a comparison of final outcomes and review how this traditional definition has been empirically tested in health economics and other sectors (such as transport, environment and marketing) in which DCE methods are applied. While an important component, we argue that the investigation of external validity should be much broader than a comparison of final outcomes. In doing so, we introduce a new and more comprehensive conceptualisation of external validity, closely linked to process validity, that moves us from the simple characterisation of a model as being or not being externally valid on the basis of predictive performance, to the concept that external validity should be an objective pursued from the initial conceptualisation and design of any DCE. We discuss how such a broader definition of external validity can be fruitfully used and suggest innovative ways in which it can be explored in practice. Copyright Springer International Publishing Switzerland 2014

Suggested Citation

  • Emily Lancsar & Joffre Swait, 2014. "Reconceptualising the External Validity of Discrete Choice Experiments," PharmacoEconomics, Springer, vol. 32(10), pages 951-965, October.
    • Handle: RePEc:spr:pharme:v:32:y:2014:i:10:p:951-965
    DOI: 10.1007/s40273-014-0181-7
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s40273-014-0181-7
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s40273-014-0181-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sivey, Peter & Scott, Anthony & Witt, Julia & Joyce, Catherine & Humphreys, John, 2012. "Junior doctors’ preferences for specialty choice," Journal of Health Economics, Elsevier, vol. 31(6), pages 813-823.
    2. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    3. Mandy Ryan & Verity Watson, 2009. "Comparing welfare estimates from payment card contingent valuation and discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 18(4), pages 389-401, April.
    4. Fernando San Miguel & Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Irrational’ stated preferences: a quantitative and qualitative investigation," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 307-322, March.
    5. Brunner, Karl & Meltzer, Allan H., 1976. "The Phillips curve," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 1-18, January.
    6. Fiebig, Denzil G. & Haas, Marion & Hossain, Ishrat & Street, Deborah J. & Viney, Rosalie, 2009. "Decisions about Pap tests: What influences women and providers?," Social Science & Medicine, Elsevier, vol. 68(10), pages 1766-1774, May.
    7. Emily Lancsar & Jordan Louviere, 2006. "Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 797-811, August.
    8. Madeleine T. King & Jane Hall & Emily Lancsar & Denzil Fiebig & Ishrat Hossain & Jordan Louviere & Helen K. Reddel & Christine R. Jenkins, 2007. "Patient preferences for managing asthma: results from a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 16(7), pages 703-717, July.
    9. Kesternich, Iris & Heiss, Florian & McFadden, Daniel & Winter, Joachim, 2013. "Suit the action to the word, the word to the action: Hypothetical choices and real decisions in Medicare Part D," Journal of Health Economics, Elsevier, vol. 32(6), pages 1313-1324.
    10. Ian J. Bateman & Richard T. Carson & Brett Day & Michael Hanemann & Nick Hanley & Tannis Hett & Michael Jones-Lee & Graham Loomes, 2002. "Economic Valuation with Stated Preference Techniques," Books, Edward Elgar Publishing, number 2639.
    11. Julie Ratcliffe & John Brazier & Aki Tsuchiya & Tara Symonds & Martin Brown, 2009. "Using DCE and ranking data to estimate cardinal values for health states for deriving a preference‐based single index from the sexual quality of life questionnaire," Health Economics, John Wiley & Sons, Ltd., vol. 18(11), pages 1261-1276, November.
    12. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, January.
    13. Mandy Ryan & Verity Watson & Vikki Entwistle, 2009. "Rationalising the ‘irrational’: a think aloud study of discrete choice experiment responses," Health Economics, John Wiley & Sons, Ltd., vol. 18(3), pages 321-336, March.
    14. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    15. Jane Hall & Patricia Kenny & Madeleine King & Jordan Louviere & Rosalie Viney & Angela Yeoh, 2002. "Using stated preference discrete choice modelling to evaluate the introduction of varicella vaccination," Health Economics, John Wiley & Sons, Ltd., vol. 11(5), pages 457-465, July.
    16. Rosalie Viney & Elizabeth Savage & Jordan Louviere, 2005. "Empirical investigation of experimental design properties of discrete choice experiments in health care," Health Economics, John Wiley & Sons, Ltd., vol. 14(4), pages 349-362, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emily Lancsar & Peter Burge, 2014. "Choice modelling research in health economics," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 28, pages 675-687, Edward Elgar Publishing.
    2. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    3. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    4. Waleska Sigüernza & Petr Mariel, 2013. "Valoración económica de los servicios sanitarios en la Comunidad Autónoma del País Vasco," Hacienda Pública Española / Review of Public Economics, IEF, vol. 207(4), pages 71-99, December.
    5. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    6. Mandy Ryan & Karen Gerard & Gillian Currie, 2012. "Using Discrete Choice Experiments in Health Economics," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 41, Edward Elgar Publishing.
    7. Jesús Clemente López & Pedro García Castrillo & María A. González Alvarez & Marcos Sanso Frago, 2014. "Una evaluación de la efectividad de la formación ocupacional para desempleados antes y después de la crisis económica: el caso de Aragón," Hacienda Pública Española / Review of Public Economics, IEF, vol. 208(1), pages 77-106, March.
    8. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    9. Michael Clark & Domino Determann & Stavros Petrou & Domenico Moro & Esther Bekker-Grob, 2014. "Discrete Choice Experiments in Health Economics: A Review of the Literature," PharmacoEconomics, Springer, vol. 32(9), pages 883-902, September.
    10. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    11. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    12. Jeanloz, Sarah & Lizin, Sebastien & Beenaerts, Natalie & Brouwer, Roy & Van Passel, Steven & Witters, Nele, 2016. "Towards a more structured selection process for attributes and levels in choice experiments: A study in a Belgian protected area," Ecosystem Services, Elsevier, vol. 18(C), pages 45-57.
    13. Jorien Veldwijk & Mattijs S Lambooij & Esther W de Bekker-Grob & Henriëtte A Smit & G Ardine de Wit, 2014. "The Effect of Including an Opt-Out Option in Discrete Choice Experiments," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-9, November.
    14. Mahieu, Pierre-Alexandre & Andersson, Henrik & Beaumais, Olivier & Crastes dit Sourd, Romain & Hess, François-Charles & Wolff, François-Charles, 2017. "Stated preferences: a unique database composed of 1657 recent published articles in journals related to agriculture, environment, or health," Review of Agricultural, Food and Environmental Studies, Institut National de la Recherche Agronomique (INRA), vol. 98(3), November.
    15. Joachim Marti, 2012. "Assessing preferences for improved smoking cessation medications: a discrete choice experiment," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 13(5), pages 533-548, October.
    16. Jia Wang & Jiaoju Ge & Zhifeng Gao, 2018. "Consumers’ Preferences and Derived Willingness-to-Pay for Water Supply Safety Improvement: The Analysis of Pricing and Incentive Strategies," Sustainability, MDPI, vol. 10(6), pages 1-16, May.
    17. Mehdi Ammi & Christine Peyron, 2016. "Heterogeneity in general practitioners’ preferences for quality improvement programs: a choice experiment and policy simulation in France," Health Economics Review, Springer, vol. 6(1), pages 1-11, December.
    18. Chiara Seghieri & Alessandro Mengoni & Sabina Nuti, 2014. "Applying discrete choice modelling in a priority setting: an investigation of public preferences for primary care models," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 15(7), pages 773-785, September.
    19. Mandeville, Kate L. & Ulaya, Godwin & Lagarde, Mylène & Muula, Adamson S. & Dzowela, Titha & Hanson, Kara, 2016. "The use of specialty training to retain doctors in Malawi: A discrete choice experiment," Social Science & Medicine, Elsevier, vol. 169(C), pages 109-118.
    20. Buckell, John & Hess, Stephane, 2019. "Stubbing out hypothetical bias: improving tobacco market predictions by combining stated and revealed preference data," Journal of Health Economics, Elsevier, vol. 65(C), pages 93-102.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:pharme:v:32:y:2014:i:10:p:951-965. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.