IDEAS home Printed from https://ideas.repec.org/p/ags/misswp/212479.html
   My bibliography  Save this paper

Single-Choice, Repeated-Choice, and Best-Worst Elicitation Formats: Do Results Differ and by How Much?

Author

Listed:
  • Petrolia, Daniel
  • Interis, Matthew
  • Hwang, Joonghyun

Abstract

This paper presents what we believe to be the most comprehensive suite of comparison criteria regarding multinomial discrete-choice experiment elicitation formats to date. We administer a choice experiment focused on ecosystem-service valuation to three independent samples: single-choice, repeated-choice, and best-worst elicitation. We test whether results differ by parameter estimates, scale factors, preference heterogeneity, status-quo/action bias, attribute non-attendance, and magnitude and precision of welfare measures. Overall, we find very limited evidence of differences in attribute parameter estimates, scale factors, and attribute increment values across elicitation treatments. However, we find significant differences in status-quo/action bias across elicitation treatments, with repeated-choice resulting in greater proportions of “Yes” votes, and consequently, higher program-level welfare estimates. Also, we find that single-choice yields drastically less-precise welfare estimates. Finally, we find significant differences in attribute non-attendance behavior across elicitation formats, although there appears to be little consistency in class shares even within a given elicitation treatment.

Suggested Citation

  • Petrolia, Daniel & Interis, Matthew & Hwang, Joonghyun, 2015. "Single-Choice, Repeated-Choice, and Best-Worst Elicitation Formats: Do Results Differ and by How Much?," Working Papers 212479, Mississippi State University, Department of Agricultural Economics.
    • Handle: RePEc:ags:misswp:212479
    DOI: 10.22004/ag.econ.212479
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/212479/files/Qform_WP_Nov2015.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.212479?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Carson, Richard T. & Czajkowski, Mikołaj, 2019. "A new baseline model for estimating willingness to pay from discrete choice models," Journal of Environmental Economics and Management, Elsevier, vol. 95(C), pages 57-61.
    2. Joseph C. Cooper & Michael Hanemann & Giovanni Signorello, 2002. "One-and-One-Half-Bound Dichotomous Choice Contingent Valuation," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 742-750, November.
    3. Hanemann, W. Michael, . "Some Issues In Continuous - And Discrete - Response Contingent Valuation Studies," Northeastern Journal of Agricultural and Resource Economics, Northeastern Agricultural and Resource Economics Association, vol. 14(1), pages 1-9.
    4. Ladenburg, Jacob & Olsen, Søren Bøye, 2008. "Gender-specific starting point bias in choice experiments: Evidence from an empirical study," Journal of Environmental Economics and Management, Elsevier, vol. 56(3), pages 275-285, November.
    5. David Hensher & John Rose & William Greene, 2012. "Inferring attribute non-attendance from stated choice data: implications for willingness to pay estimates and a warning for stated choice experiment design," Transportation, Springer, vol. 39(2), pages 235-245, March.
    6. List John A. & Sinha Paramita & Taylor Michael H., 2006. "Using Choice Experiments to Value Non-Market Goods and Services: Evidence from Field Experiments," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-39, January.
    7. Danny Campbell & David A. Hensher & Riccardo Scarpa, 2011. "Non-attendance to attributes in environmental choice analysis: a latent class specification," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 54(8), pages 1061-1076, December.
    8. Donald M. McLeod & Olvar Bergland, 1999. "Willingness-to-Pay Estimates Using the Double-Bounded Dichotomous-Choice Contingent Valuation Format: A Test for Validity and Precision in a Bayesian Framework," Land Economics, University of Wisconsin Press, vol. 75(1), pages 115-125.
    9. Laura Taylor & Mark Morrison & Kevin Boyle, 2010. "Exchange Rules and the Incentive Compatibility of Choice Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 47(2), pages 197-220, October.
    10. Bateman, Ian J. & Cole, Matthew & Cooper, Philip & Georgiou, Stavros & Hadley, David & Poe, Gregory L., 2004. "On visible choice sets and scope sensitivity," Journal of Environmental Economics and Management, Elsevier, vol. 47(1), pages 71-93, January.
    11. Ben McNair & David Hensher & Jeff Bennett, 2012. "Modelling Heterogeneity in Response Behaviour Towards a Sequence of Discrete Choice Questions: A Probabilistic Decision Process Model," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 599-616, April.
    12. Day, Brett & Pinto Prades, Jose-Luis, 2010. "Ordering anomalies in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 59(3), pages 271-285, May.
    13. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    14. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555, September.
    15. Daniel R. Petrolia & Matthew G. Interis & Joonghyun Hwang, 2014. "America's Wetland? A National Survey of Willingness to Pay for Restoration of Louisiana's Coastal Wetlands," Marine Resource Economics, University of Chicago Press, vol. 29(1), pages 17-37.
    16. Jeff Bennett (ed.), 2011. "The International Handbook on Non-Market Environmental Valuation," Books, Edward Elgar Publishing, number 13490.
    17. Newell, Laurie W. & Swallow, Stephen K., 2013. "Real-payment choice experiments: Valuing forested wetlands and spatial attributes within a landscape context," Ecological Economics, Elsevier, vol. 92(C), pages 37-47.
    18. Timothy C. Haab & Kenneth E. McConnell, 2002. "Valuing Environmental and Natural Resources," Books, Edward Elgar Publishing, number 2427.
    19. Flynn, Terry N. & Louviere, Jordan J. & Peters, Tim J. & Coast, Joanna, 2007. "Best-worst scaling: What it can do for health care research and how to do it," Journal of Health Economics, Elsevier, vol. 26(1), pages 171-189, January.
    20. Carson, R.T. & Mitchell, R.C. & Hanemann, W.M. & Kopp, R.J. & Presser, S. & Ruud, P.A., 1992. "A Contingent Valuation Study of Lost Passive Use Values Resulting From the Exxon Valdez Oil Spill," MPRA Paper 6984, University Library of Munich, Germany.
    21. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    22. Watson, Verity & Ryan, Mandy, 2007. "Exploring preference anomalies in double bounded contingent valuation," Journal of Health Economics, Elsevier, vol. 26(3), pages 463-482, May.
    23. Herriges, Joseph A. & Shogren, Jason F., 1996. "Starting Point Bias in Dichotomous Choice Valuation with Follow-Up Questioning," Journal of Environmental Economics and Management, Elsevier, vol. 30(1), pages 112-131, January.
    24. Bateman, Ian J. & Langford, Ian H. & Jones, Andrew P. & Kerr, Geoffrey N., 2001. "Bound and path effects in double and triple bounded dichotomous choice contingent valuation," Resource and Energy Economics, Elsevier, vol. 23(3), pages 191-213, July.
    25. Thomas P. Holmes & Kevin J. Boyle, 2005. "Dynamic Learning and Context-Dependence in Sequential, Attribute-Based, Stated-Preference Valuation Questions," Land Economics, University of Wisconsin Press, vol. 81(1).
    26. Joseph C. Cooper & Michael Hanemann & Giovanni Signorello, 2002. "One-and-One-Half-Bound Dichotomous Choice Contingent Valuation," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 742-750, November.
    27. Matthew G. Interis & Daniel R. Petrolia, 2016. "Location, Location, Habitat: How the Value of Ecosystem Services Varies across Location and by Habitat," Land Economics, University of Wisconsin Press, vol. 92(2), pages 292-307.
    28. Office of Health Economics, 2007. "The Economics of Health Care," For School 001490, Office of Health Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert Huber & Robert Finger, 2020. "A Meta‐analysis of the Willingness to Pay for Cultural Services from Grasslands in Europe," Journal of Agricultural Economics, Wiley Blackwell, vol. 71(2), pages 357-383, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel R. Petrolia & Matthew G. Interis & Joonghyun Hwang, 2018. "Single-Choice, Repeated-Choice, and Best-Worst Scaling Elicitation Formats: Do Results Differ and by How Much?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 69(2), pages 365-393, February.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Daniel R. Petrolia & Matthew G. Interis & Joonghyun Hwang, 2014. "America's Wetland? A National Survey of Willingness to Pay for Restoration of Louisiana's Coastal Wetlands," Marine Resource Economics, University of Chicago Press, vol. 29(1), pages 17-37.
    4. Nguyen, Thanh Cong & Le, Hoa Thu & Nguyen, Hang Dieu & Ngo, Mai Thanh & Nguyen, Hong Quang, 2021. "Examining ordering effects and strategic behaviour in a discrete choice experiment," Economic Analysis and Policy, Elsevier, vol. 70(C), pages 394-413.
    5. Logar, Ivana & Brouwer, Roy & Campbell, Danny, 2020. "Does attribute order influence attribute-information processing in discrete choice experiments?," Resource and Energy Economics, Elsevier, vol. 60(C).
    6. Kim, GwanSeon & Petrolia, Daniel R. & Interis, Matthew G., 2012. "A Method for Improving Welfare Estimates from Multiple-Referendum Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 37(2), pages 1-12, August.
    7. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    8. Meyerhoff, Jürgen & Glenk, Klaus, 2015. "Learning how to choose—effects of instructional choice sets in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 41(C), pages 122-142.
    9. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    10. Tenaw G. Abate & Morten R. Mørkbak & Søren B. Olsen, 2018. "Inducing value and institutional learning effects in stated choice experiments using advanced disclosure and instructional choice set treatments," Agricultural Economics, International Association of Agricultural Economists, vol. 49(3), pages 339-351, May.
    11. Glenk, Klaus & Meyerhoff, Jürgen & Akaichi, Faical & Martin-Ortega, Julia, 2019. "Revisiting cost vector effects in discrete choice experiments," Resource and Energy Economics, Elsevier, vol. 57(C), pages 135-155.
    12. Schwarzinger, Michaël & Carrat, Fabrice & Luchini, Stéphane, 2009. ""If you have the flu symptoms, your asymptomatic spouse may better answer the willingness-to-pay question": Evidence from a double-bounded dichotomous choice model with heterogeneous anchori," Journal of Health Economics, Elsevier, vol. 28(4), pages 873-884, July.
    13. Thijs Dekker & Paul Koster & Roy Brouwer, 2014. "Changing with the Tide: Semiparametric Estimation of Preference Dynamics," Land Economics, University of Wisconsin Press, vol. 90(4), pages 717-745.
    14. Rocamora, Beatriz & Colombo, Sergio & Glenk, Klaus, 2014. "El impacto de las respuestas inconsistentes en las medidas de bienestar estimadas con el método del experimento de elección," Economia Agraria y Recursos Naturales, Spanish Association of Agricultural Economists, vol. 14(02), pages 1-22, December.
    15. Day, Brett & Pinto Prades, Jose-Luis, 2010. "Ordering anomalies in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 59(3), pages 271-285, May.
    16. Gelo, Dambala & Koch, Steven F., 2015. "Contingent valuation of community forestry programs in Ethiopia: Controlling for preference anomalies in double-bounded CVM," Ecological Economics, Elsevier, vol. 114(C), pages 79-89.
    17. Frédéric Salladarré & Dorothée Brécard & Sterenn Lucas & Pierrick Ollivier, 2016. "Are French consumers ready to pay a premium for eco-labeled seafood products? A contingent valuation estimation with heterogeneous anchoring," Agricultural Economics, International Association of Agricultural Economists, vol. 47(2), pages 247-258, March.
    18. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    19. Campbell, Danny & Boeri, Marco & Doherty, Edel & George Hutchinson, W., 2015. "Learning, fatigue and preference formation in discrete choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 345-363.
    20. Aravena, Claudia & Hutchinson, W. George & Carlsson, Fredrik & Matthews, David I, 2015. "Testing preference formation in learning design contingent valuation (LDCV) using advanced information and repetitivetreatments," Working Papers in Economics 619, University of Gothenburg, Department of Economics.

    More about this item

    Keywords

    Environmental Economics and Policy;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:misswp:212479. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/damssus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.