IDEAS home Printed from https://ideas.repec.org/a/kap/enreec/v68y2017i3d10.1007_s10640-016-0045-z.html
   My bibliography  Save this article

Choice Consistency and Preference Stability in Test-Retests of Discrete Choice Experiment and Open-Ended Willingness to Pay Elicitation Formats

Author

Listed:
  • Roy Brouwer

    (University of Waterloo
    Swiss Federal Institute of Aquatic Science and Technology (Eawag))

  • Ivana Logar

    (Swiss Federal Institute of Aquatic Science and Technology (Eawag))

  • Oleg Sheremet

    (University of St Andrews)

Abstract

This study tests the temporal stability of preferences, choices and willingness to pay (WTP) values using both discrete choice experiment (DCE) and open-ended (OE) WTP elicitation formats. The same sample is surveyed three times over the course of two years using each time the same choice sets. Choice consistency is positively correlated with choice certainty and choice complexity. The impact of choice complexity fades away in time, most likely as a result of learning and preference refinement. Although the OE WTP values remain stable over a time period of 2 years as in previous stated preference studies, DCE based WTP measures differ significantly, suggesting their use in benefits transfer may be limited.

Suggested Citation

  • Roy Brouwer & Ivana Logar & Oleg Sheremet, 2017. "Choice Consistency and Preference Stability in Test-Retests of Discrete Choice Experiment and Open-Ended Willingness to Pay Elicitation Formats," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 729-751, November.
    • Handle: RePEc:kap:enreec:v:68:y:2017:i:3:d:10.1007_s10640-016-0045-z
    DOI: 10.1007/s10640-016-0045-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10640-016-0045-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10640-016-0045-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John C. Whitehead & Thomas J. Hoban, 1999. "Testing for Temporal Reliability in Contingent Valuation with Time for Changes in Factors Affecting Demand," Land Economics, University of Wisconsin Press, vol. 75(3), pages 453-465.
    2. Green, Donald & Jacowitz, Karen E. & Kahneman, Daniel & McFadden, Daniel, 1998. "Referendum contingent valuation, anchoring, and willingness to pay for public goods," Resource and Energy Economics, Elsevier, vol. 20(2), pages 85-116, June.
    3. K. McConnell* & I. Strand & Sebastián Valdés, 1998. "Testing Temporal Reliability and Carry-over Effect: The Role of Correlated Responses in Test-retest Reliability Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 12(3), pages 357-374, October.
    4. Dekker, Thijs & Hess, Stephane & Brouwer, Roy & Hofkes, Marjan, 2016. "Decision uncertainty in multi-attribute stated preference studies," Resource and Energy Economics, Elsevier, vol. 43(C), pages 57-73.
    5. Schaafsma, Marije & Brouwer, Roy & Liekens, Inge & De Nocker, Leo, 2014. "Temporal stability of preferences and willingness to pay for natural areas in choice experiments: A test–retest," Resource and Energy Economics, Elsevier, vol. 38(C), pages 243-260.
    6. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    7. Nick Hanley & Susana Mourato & Robert E. Wright, 2001. "Choice Modelling Approaches: A Superior Alternative for Environmental Valuatioin?," Journal of Economic Surveys, Wiley Blackwell, vol. 15(3), pages 435-462, July.
    8. Swait, Joffre & Adamowicz, Wiktor, 2001. "The Influence of Task Complexity on Consumer Choice: A Latent Class Model of Decision Strategy Switching," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 135-148, June.
    9. repec:bla:jecsur:v:15:y:2001:i:3:p:435-62 is not listed on IDEAS
    10. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304.
    11. Ulf Liebe & Jürgen Meyerhoff & Volkmar Hartje, 2012. "Test–Retest Reliability of Choice Experiments in Environmental Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 53(3), pages 389-407, November.
    12. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 41-71.
    13. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    14. Thomas P. Holmes & Kevin J. Boyle, 2005. "Dynamic Learning and Context-Dependence in Sequential, Attribute-Based, Stated-Preference Valuation Questions," Land Economics, University of Wisconsin Press, vol. 81(1).
    15. Brouwer, Roy, 2006. "Do stated preference methods stand the test of time? A test of the stability of contingent values and models for health risks when facing an extreme event," Ecological Economics, Elsevier, vol. 60(2), pages 399-406, December.
    16. Mogas, Joan & Riera, Pere & Bennett, Jeff, 2006. "A comparison of contingent valuation and choice modelling with second-order interactions," Journal of Forest Economics, Elsevier, vol. 12(1), pages 5-30, March.
    17. Brown, Thomas C. & Kingsley, David & Peterson, George L. & Flores, Nicholas E. & Clarke, Andrea & Birjulin, Andrej, 2008. "Reliability of individual valuations of public and private goods: Choice consistency, response time, and preference refinement," Journal of Public Economics, Elsevier, vol. 92(7), pages 1595-1606, July.
    18. Bhat, Chandra R., 2001. "Quasi-random maximum simulated likelihood estimation of the mixed multinomial logit model," Transportation Research Part B: Methodological, Elsevier, vol. 35(7), pages 677-693, August.
    19. Roy Brouwer & Thijs Dekker & John Rolfe & Jill Windle, 2010. "Choice Certainty and Consistency in Repeated Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 46(1), pages 93-109, May.
    20. Vivien Foster & Susana Mourato, 2003. "Elicitation Format and Sensitivity to Scope," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 24(2), pages 141-160, February.
    21. Langford, Ian H. & Bateman, Ian J., 1996. "Elicitation and truncation effects in contingent valuation studies," Ecological Economics, Elsevier, vol. 19(3), pages 265-267, December.
    22. Andrew Daly & Stephane Hess & Kenneth Train, 2012. "Assuring finite moments for willingness to pay in random coefficient models," Transportation, Springer, vol. 39(1), pages 19-31, January.
    23. Mark L. Messonnier & John C. Bergstrom & Christopher M. Cornwell & R. Jeff Teasley & H. Ken Cordell, 2000. "Survey Response-Related Biases in Contingent Valuation: Concepts, Remedies, and Empirical Application to Valuing Aquatic Plant Management," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 82(2), pages 438-450.
    24. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    25. Gebeyehu Fetene & Søren Olsen & Ole Bonnichsen, 2014. "Disentangling the Pure Time Effect From Site and Preference Heterogeneity Effects in Benefit Transfer: An Empirical Investigation of Transferability," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(4), pages 583-611, December.
    26. Roy Brouwer & Fumbi Job & Bianca Kroon & Richard Johnston, 2015. "Comparing Willingness to Pay for Improved Drinking-Water Quality Using Stated Preference Methods in Rural and Urban Kenya," Applied Health Economics and Health Policy, Springer, vol. 13(1), pages 81-94, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Boxebeld, Sander, 2024. "Ordering effects in discrete choice experiments: A systematic literature review across domains," Journal of choice modelling, Elsevier, vol. 51(C).
    2. Roy Brouwer & Solomon Tarfasa, 2020. "Testing hypothetical bias in a framed field experiment," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 68(3), pages 343-357, September.
    3. Faccioli, Michela & Czajkowski, Mikołaj & Glenk, Klaus & Martin-Ortega, Julia, 2020. "Environmental attitudes and place identity as determinants of preferences for ecosystem services," Ecological Economics, Elsevier, vol. 174(C).
    4. Talpur, Musharaf & Brouwer, Roy & Koetse, Mark, 2019. "Opt-Out Forced Choice Effect in Combined Revealed and Stated Preference Discrete Choice Models: A Gender Perspective," MPRA Paper 99631, University Library of Munich, Germany.
    5. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    6. Michela Faccioli & Mikołaj Czajkowski & Klaus Glenk & Julia Martin-Ortega, 2018. "Environmental attitudes and place identity as simultaneous determinants of preferences for environmental goods," Working Papers 2018-08, Faculty of Economic Sciences, University of Warsaw.
    7. Casati, Mirta & Soregaroli, Claudio & Rommel, Jens & Luzzani, Gloria & Stranieri, Stefanella, 2023. "Please keep ordering! A natural field experiment assessing a carbon label introduction," Food Policy, Elsevier, vol. 120(C).
    8. Matthew Collins & Seraphim Dempsey & John Curtis, 2018. "Householder Preferences for the Design of an Energy Efficiency Retrofit Subsidy in Ireland," The Economic and Social Review, Economic and Social Studies, vol. 49(2), pages 145-172.
    9. Ladenburg, Jacob & Skotte, Maria, 2022. "Heterogeneity in willingness to pay for the location of offshore wind power development: An application of the willingness to pay space model," Energy, Elsevier, vol. 241(C).
    10. Rolfe, John & Dyack, Brenda, 2019. "Testing Temporal Stability of Recreation Values," Ecological Economics, Elsevier, vol. 159(C), pages 75-83.
    11. Galina Williams, 2022. "Temporal stability of WTP estimates in labeled and unlabeled choice experiment for emissions reduction options, Queensland, Australia," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 24(4), pages 533-550, October.
    12. Hynes, Stephen & Armstrong, Claire W. & Xuan, Bui Bich & Ankamah-Yeboah, Isaac & Simpson, Katherine & Tinch, Robert & Ressurreição, Adriana, 2021. "Have environmental preferences and willingness to pay remained stable before and during the global Covid-19 shock?," Ecological Economics, Elsevier, vol. 189(C).
    13. Logar, Ivana & Brouwer, Roy & Campbell, Danny, 2020. "Does attribute order influence attribute-information processing in discrete choice experiments?," Resource and Energy Economics, Elsevier, vol. 60(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    2. Schaafsma, Marije & Brouwer, Roy & Liekens, Inge & De Nocker, Leo, 2014. "Temporal stability of preferences and willingness to pay for natural areas in choice experiments: A test–retest," Resource and Energy Economics, Elsevier, vol. 38(C), pages 243-260.
    3. J. Price & D. Dupont & W. Adamowicz, 2017. "As Time Goes By: Examination of Temporal Stability Across Stated Preference Question Formats," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(3), pages 643-662, November.
    4. Lew, Daniel K. & Wallmo, Kristy, 2017. "Temporal stability of stated preferences for endangered species protection from choice experiments," Ecological Economics, Elsevier, vol. 131(C), pages 87-97.
    5. Hynes, Stephen & Armstrong, Claire W. & Xuan, Bui Bich & Ankamah-Yeboah, Isaac & Simpson, Katherine & Tinch, Robert & Ressurreição, Adriana, 2021. "Have environmental preferences and willingness to pay remained stable before and during the global Covid-19 shock?," Ecological Economics, Elsevier, vol. 189(C).
    6. del Saz Salazar, Salvador & Hernandez Sancho, Francesc & Sala Garrido, Ramon, 2009. "Estimación del valor económico de la calidad del agua de un río mediante una doble aproximación: una aplicación de los principios económicos de la Directiva Marco del Agua," Economia Agraria y Recursos Naturales, Spanish Association of Agricultural Economists, vol. 9(01), pages 1-27.
    7. Hoyos, David, 2010. "The state of the art of environmental valuation with discrete choice experiments," Ecological Economics, Elsevier, vol. 69(8), pages 1595-1603, June.
    8. Hoyos Ramos, David, 2010. "Using discrete choice experiments for environmental valuation," BILTOKI 1134-8984, Universidad del País Vasco - Departamento de Economía Aplicada III (Econometría y Estadística).
    9. Solomon Tarfasa & Roy Brouwer, 2013. "Estimation of the public benefits of urban water supply improvements in Ethiopia: a choice experiment," Applied Economics, Taylor & Francis Journals, vol. 45(9), pages 1099-1108, March.
    10. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    11. Rolfe, John & Dyack, Brenda, 2019. "Testing Temporal Stability of Recreation Values," Ecological Economics, Elsevier, vol. 159(C), pages 75-83.
    12. Kingsley, David C. & Brown, Thomas C., 2013. "Value learning and the willingness to accept–willingness to pay disparity," Economics Letters, Elsevier, vol. 120(3), pages 473-476.
    13. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    14. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    15. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    16. Kuller, M. & Beutler, P. & Lienert, J., 2023. "Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1268-1285.
    17. Marta Meleddu, 2016. "Repeating discrete choice experiments to estimate public preferences in a case of costal land use policy," ECONOMICS AND POLICY OF ENERGY AND THE ENVIRONMENT, FrancoAngeli Editore, vol. 2016(1), pages 47-72.
    18. Weng, Weizhe & Morrison, Mark & Boyle, Kevin & Boxall, Peter, 2017. "The effect of the number of alternatives in a choice experiment with an application to the Macquarie Marshes, AU," 2017 Annual Meeting, February 4-7, 2017, Mobile, Alabama 252836, Southern Agricultural Economics Association.
    19. Matthews, Yvonne & Scarpa, Riccardo & Marsh, Dan, 2017. "Stability of Willingness-to-Pay for Coastal Management: A Choice Experiment Across Three Time Periods," Ecological Economics, Elsevier, vol. 138(C), pages 64-73.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:enreec:v:68:y:2017:i:3:d:10.1007_s10640-016-0045-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.