IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v124y2014i1p9-13.html
   My bibliography  Save this article

Are choice experiments reliable? Evidence from the lab

Author

Listed:
  • Luchini, S.
  • Watson, V.

Abstract

This study investigates whether a popular stated preference method, the choice experiment (CE), reliably measures individuals’ values for a good. We address this question using an induced value experiment. Our results indicate that CEs fail to elicit payoff maximizing choices. We find little evidence that increasing the salience of the choices or adding monetary incentives increase the proportion of payoff maximizing choices. This questions the increasing use of CE to value non-market goods for policy making.

Suggested Citation

  • Luchini, S. & Watson, V., 2014. "Are choice experiments reliable? Evidence from the lab," Economics Letters, Elsevier, vol. 124(1), pages 9-13.
    • Handle: RePEc:eee:ecolet:v:124:y:2014:i:1:p:9-13
    DOI: 10.1016/j.econlet.2014.04.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176514001335
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econlet.2014.04.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Carlsson, Fredrik & Frykblom, Peter & Johan Lagerkvist, Carl, 2005. "Using cheap talk as a test of validity in choice experiments," Economics Letters, Elsevier, vol. 89(2), pages 147-152, November.
    2. Hole, Arne Risa, 2011. "A discrete choice model with endogenous attribute attendance," Economics Letters, Elsevier, vol. 110(3), pages 203-205, March.
    3. Taylor, Laura O. & McKee, Michael & Laury, Susan K. & Cummings, Ronald G., 2001. "Induced-value tests of the referendum voting mechanism," Economics Letters, Elsevier, vol. 71(1), pages 61-65, April.
    4. Mandy Ryan & Karen Gerard & Gillian Currie, 2012. "Using Discrete Choice Experiments in Health Economics," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 41, Edward Elgar Publishing.
    5. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    6. Johansson-Stenman Olof & Svedsäter Henrik, 2008. "Measuring Hypothetical Bias in Choice Experiments: The Importance of Cognitive Consistency," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 8(1), pages 1-10, September.
    7. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    8. Smith, Vernon L, 1976. "Experimental Economics: Induced Value Theory," American Economic Review, American Economic Association, vol. 66(2), pages 274-279, May.
    9. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    10. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74(2), pages 132-132.
    11. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Claudia Bazzani & Marco A. Palma & Rodolfo M. Nayga, 2018. "On the use of flexible mixing distributions in WTP space: an induced value choice experiment," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 62(2), pages 185-198, April.
    2. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    3. Chavez, Daniel E. & Palma, Marco A. & Nayga Jr., Rodolfo M., 2017. "When does real become consequential in non-hypothetical choice experiments?," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266327, Southern Agricultural Economics Association.
    4. Nicolas Jacquemet & Stéphane Luchini & Jason F. Shogren & Verity Watson, 2019. "Discrete Choice under Oaths," Documents de travail du Centre d'Economie de la Sorbonne 19007, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    5. Patrick Lloyd-Smith & Ewa Zawojska & Wiktor Adamowicz, 2020. "Moving beyond the Contingent Valuation versus Choice Experiment Debate: Presentation Effects in Stated Preference," Land Economics, University of Wisconsin Press, vol. 96(1), pages 1-24.
    6. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    7. Nicolas Jacquemet & Stephane Luchini & Jason Shogren & Verity Watson, 2019. "Discrete Choice under Oaths," Working Papers halshs-02136103, HAL.
    8. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    9. Cerroni, S. & Watson, V. & Macdiarmid, J., 2018. "Preferences for healthy and environmentally sustainable food: Combining induced-value and home-grown experiments," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 277155, International Association of Agricultural Economists.
    10. Werbeck, Anna, 2024. "Stated preferences and actual choices in german health insurance," Ruhr Economic Papers 1091, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    11. Bazzani, Claudia & Nayga, Rodolfo M. Jr. & Caputo, Vincenzina & Canavari, Maurizio & Danforth, Diana M., 2016. "On the Use of the BDM Mechanism in Non-Hypothetical Choice Experiments," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235904, Agricultural and Applied Economics Association.
    12. Toma, Mattie & Bell, Elizabeth, 2024. "Understanding and increasing policymakers’ sensitivity to program impact," Journal of Public Economics, Elsevier, vol. 234(C).
    13. Xuan Wei & Hayk Khachatryan & Alicia Rihn, 2021. "Estimating willingness-to-pay for neonicotinoid-free plants: Incorporating pro-environmental behavior in hypothetical and non-hypothetical experiments," PLOS ONE, Public Library of Science, vol. 16(5), pages 1-20, May.
    14. Regier, Dean A. & Sicsic, Jonathan & Watson, Verity, 2019. "Choice certainty and deliberative thinking in discrete choice experiments. A theoretical and empirical investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 164(C), pages 235-255.
    15. Botero, Hernan & Barnes, Andrew P. & Perez, Lisset & Rios, David & Ramirez-Villegas, Julian, 2021. "The determinants of common bean variety selection and diversification in Colombia," Ecological Economics, Elsevier, vol. 190(C).
    16. Keith Finlay & Charles Stoecker & Scott Cunningham, 2015. "Willingness-To-Accept Pharmaceutical Retail Inconvenience: Evidence from a Contingent Choice Experiment," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-10, May.
    17. Meginnis, Keila & Burton, Michael & Chan, Ron & Rigby, Dan, 2021. "Strategic bias in discrete choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    18. Pierre-Alexandre Mahieu & Henrik Andersson & Olivier Beaumais & Romain Crastes & François-Charles Wolff, 2014. "Is Choice Experiment Becoming more Popular than Contingent Valuation? A Systematic Review in Agriculture, Environment and Health," Working Papers 2014.12, FAERE - French Association of Environmental and Resource Economists.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chavez, Daniel E. & Palma, Marco A. & Nayga, Rodolfo M. & Mjelde, James W., 2020. "Product availability in discrete choice experiments with private goods," Journal of choice modelling, Elsevier, vol. 36(C).
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    3. Chavez, Daniel E. & Palma, Marco A. & Nayga Jr., Rodolfo M., 2017. "When does real become consequential in non-hypothetical choice experiments?," 2018 Annual Meeting, February 2-6, 2018, Jacksonville, Florida 266327, Southern Agricultural Economics Association.
    4. Bazzani, Claudia & Nayga, Rodolfo M. Jr. & Caputo, Vincenzina & Canavari, Maurizio & Danforth, Diana M., 2016. "On the Use of the BDM Mechanism in Non-Hypothetical Choice Experiments," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235904, Agricultural and Applied Economics Association.
    5. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    6. Krucien, Nicolas & Ryan, Mandy & Hermens, Frouke, 2017. "Visual attention in multi-attributes choices: What can eye-tracking tell us?," Journal of Economic Behavior & Organization, Elsevier, vol. 135(C), pages 251-267.
    7. Mandy Ryan & Nicolas Krucien & Frouke Hermens, 2018. "The eyes have it: Using eye tracking to inform information processing strategies in multi‐attributes choices," Health Economics, John Wiley & Sons, Ltd., vol. 27(4), pages 709-721, April.
    8. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    9. Araña, Jorge E. & León, Carmelo J., 2013. "Dynamic hypothetical bias in discrete choice experiments: Evidence from measuring the impact of corporate social responsibility on consumers demand," Ecological Economics, Elsevier, vol. 87(C), pages 53-61.
    10. Yangui, A. & Akaichi, F. & Gil, J.M., 2018. "Investigating attribute non-attendance effects in conjoint analysis methods performance: Choice experiment, ranking conjoint analysis and best worst scaling," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 275989, International Association of Agricultural Economists.
    11. M. Lefebvre & C. Biguzzi & E. Ginon & S. Gomez-y-Paloma & S. R. H. Langrell & S. Marette & G. Mateu & A. Sutan, 2017. "Mandatory integrated pest management in the European Union: experimental insights on consumers’ reactions," Review of Agricultural, Food and Environmental Studies, Springer, vol. 98(1), pages 25-54, July.
    12. Maria Eduarda Fernandes & Marieta Valente, 2018. "When Is Green Too Rosy? Evidence from a Laboratory Market Experiment on Green Goods and Externalities," Games, MDPI, vol. 9(3), pages 1-18, September.
    13. Swait, J. & de Bekker-Grob, E.W., 2022. "A discrete choice model implementing gist-based categorization of alternatives, with applications to patient preferences for cancer screening and treatment," Journal of Health Economics, Elsevier, vol. 85(C).
    14. Genie, Mesfin G. & Nicoló, Antonio & Pasini, Giacomo, 2020. "The role of heterogeneity of patients’ preferences in kidney transplantation," Journal of Health Economics, Elsevier, vol. 72(C).
    15. Craig D. Broadbent, 2014. "Evaluating mitigation and calibration techniques for hypothetical bias in choice experiments," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 57(12), pages 1831-1848, December.
    16. Mørkbak, Morten Raun & Olsen, Søren Bøye & Campbell, Danny, 2014. "Behavioral implications of providing real incentives in stated choice experiments," Journal of Economic Psychology, Elsevier, vol. 45(C), pages 102-116.
    17. Chandoevwit, Worawan & Wasi, Nada, 2020. "Incorporating discrete choice experiments into policy decisions: Case of designing public long-term care insurance," Social Science & Medicine, Elsevier, vol. 258(C).
    18. Allen, S. & Goddard, E., 2018. "The Effectiveness of High Sugar Warning Labels on Breakfast Cereals," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 275885, International Association of Agricultural Economists.
    19. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "A fair share: Burden-sharing preferences in the United States and China," Resource and Energy Economics, Elsevier, vol. 35(1), pages 1-17.
    20. Samare P. I. Huls & Emily Lancsar & Bas Donkers & Jemimah Ride, 2022. "Two for the price of one: If moving beyond traditional single‐best discrete choice experiments, should we use best‐worst, best‐best or ranking for preference elicitation?," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2630-2647, December.

    More about this item

    Keywords

    Experimental economics; Choice experiment; Demand revelation;
    All these keywords.

    JEL classification:

    • D1 - Microeconomics - - Household Behavior
    • D6 - Microeconomics - - Welfare Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:124:y:2014:i:1:p:9-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.