IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v59y2010i3p271-285.html
   My bibliography  Save this article

Ordering anomalies in choice experiments

Author

Listed:
  • Day, Brett
  • Pinto Prades, Jose-Luis

Abstract

This paper investigates whether responses to choice experiments (CEs) are subject to ordering anomalies. While previous research has focussed on the possibility that such anomalies relate to position in the sequence of choice tasks, our research reveals that the particular order of tasks matters. Using a novel experimental design that allows us to test our hypotheses using simple nonparametric statistics, we observe ordering anomalies in CE data similar to those recorded in the dichotomous choice contingent valuation literature. Those ordering effects operate in both price and commodity dimensions and are observed to compound over a series of choice tasks. Our findings cast serious doubt on the current practice of asking each respondent to undertake several choice tasks in a CE while treating each response as an independent observation on that individual's preferences.

Suggested Citation

  • Day, Brett & Pinto Prades, Jose-Luis, 2010. "Ordering anomalies in choice experiments," Journal of Environmental Economics and Management, Elsevier, vol. 59(3), pages 271-285, May.
  • Handle: RePEc:eee:jeeman:v:59:y:2010:i:3:p:271-285
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095-0696(10)00023-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Clark, Jeremy & Friesen, Lana, 2008. "The causes of order effects in contingent valuation surveys: An experimental investigation," Journal of Environmental Economics and Management, Elsevier, vol. 56(2), pages 195-206, September.
    2. Brooks, Richard AU -, 1996. "EuroQol: the current state of play," Health Policy, Elsevier, vol. 37(1), pages 53-72, July.
    3. DeShazo, J. R., 2002. "Designing Transactions without Framing Effects in Iterative Question Formats," Journal of Environmental Economics and Management, Elsevier, vol. 43(3), pages 360-385, May.
    4. Flachaire, Emmanuel & Hollard, Guillaume, 2007. "Starting point bias and respondent uncertainty in dichotomous choice contingent valuation surveys," Resource and Energy Economics, Elsevier, vol. 29(3), pages 183-194, September.
    5. David Aadland & Arthur Caplan & Owen Phillips, 2007. "A Bayesian examination of information and uncertainty in contingent valuation," Journal of Risk and Uncertainty, Springer, vol. 35(2), pages 149-178, October.
    6. Swait, Joffre & Adamowicz, Wiktor, 2001. "The Influence of Task Complexity on Consumer Choice: A Latent Class Model of Decision Strategy Switching," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 135-148, June.
    7. Amos Tversky & Daniel Kahneman, 1991. "Loss Aversion in Riskless Choice: A Reference-Dependent Model," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 1039-1061.
    8. Herriges, Joseph A. & Shogren, Jason F., 1996. "Starting Point Bias in Dichotomous Choice Valuation with Follow-Up Questioning," Journal of Environmental Economics and Management, Elsevier, vol. 30(1), pages 112-131, January.
    9. Bateman, Ian J. & Langford, Ian H. & Jones, Andrew P. & Kerr, Geoffrey N., 2001. "Bound and path effects in double and triple bounded dichotomous choice contingent valuation," Resource and Energy Economics, Elsevier, vol. 23(3), pages 191-213, July.
    10. Ready Richard C. & Whitehead John C. & Blomquist Glenn C., 1995. "Contingent Valuation When Respondents Are Ambivalent," Journal of Environmental Economics and Management, Elsevier, vol. 29(2), pages 181-196, September.
    11. Kevin J. Boyle & Richard C. Bishop & Michael P. Welsh, 1985. "Starting Point Bias in Contingent Valuation Bidding Games," Land Economics, University of Wisconsin Press, vol. 62(2), pages 188-194.
    12. John C. Whitehead, 2002. "Incentive Incompatibility and Starting-Point Bias in Iterative Valuation Questions," Land Economics, University of Wisconsin Press, vol. 78(2), pages 285-297.
    13. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    14. Thomas P. Holmes & Kevin J. Boyle, 2005. "Dynamic Learning and Context-Dependence in Sequential, Attribute-Based, Stated-Preference Valuation Questions," Land Economics, University of Wisconsin Press, vol. 81(1).
    15. Flores, Nicholas E. & Strong, Aaron, 2007. "Cost credibility and the stated preference analysis of public goods," Resource and Energy Economics, Elsevier, vol. 29(3), pages 195-205, September.
    16. Cameron Trudy Ann & Quiggin John, 1994. "Estimation Using Contingent Valuation Data from a Dichotomous Choice with Follow-Up Questionnaire," Journal of Environmental Economics and Management, Elsevier, vol. 27(3), pages 218-234, November.
    17. Bateman, Ian J. & Cole, Matthew & Cooper, Philip & Georgiou, Stavros & Hadley, David & Poe, Gregory L., 2004. "On visible choice sets and scope sensitivity," Journal of Environmental Economics and Management, Elsevier, vol. 47(1), pages 71-93, January.
    18. Adamowicz, Wiktor L., 2004. "What's it worth? An examination of historical trends and future directions in environmental valuation," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 48(3), pages 1-25.
    19. Bishop, Richard C. & Heberlein, Thomas A., 1979. "Measuring Values Of Extramarket Goods: Are Indirect Measures Biased?," 1979 Annual Meeting, July 29-August 1, Pullman, Washington 277818, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    20. Daniel McFadden, 1994. "Contingent Valuation and Social Choice," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 76(4), pages 689-708.
    21. G. Cornelis van Kooten & Emina Krcmar & Erwin H. Bulte, 2001. "Preference Uncertainty in Non-Market Valuation: A Fuzzy Approach," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(3), pages 487-500.
    22. Michael Hanemann & John Loomis & Barbara Kanninen, 1991. "Statistical Efficiency of Double-Bounded Dichotomous Choice Contingent Valuation," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 73(4), pages 1255-1263.
    23. Donald M. McLeod & Olvar Bergland, 1999. "Willingness-to-Pay Estimates Using the Double-Bounded Dichotomous-Choice Contingent Valuation Format: A Test for Validity and Precision in a Bayesian Framework," Land Economics, University of Wisconsin Press, vol. 75(1), pages 115-125.
    24. Powe, N. A. & Bateman, I. J., 2003. "Ordering effects in nested 'top-down' and 'bottom-up' contingent valuation designs," Ecological Economics, Elsevier, vol. 45(2), pages 255-270, June.
    25. Bateman, Ian J. & Brouwer, Roy, 2006. "Consistency and construction in stated WTP for health risk reductions: A novel scope-sensitivity test," Resource and Energy Economics, Elsevier, vol. 28(3), pages 199-214, August.
    26. Richard C. Bishop & Thomas A. Heberlein, 1979. "Measuring Values of Extramarket Goods: Are Indirect Measures Biased?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 61(5), pages 926-930.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Day, Brett & Bateman, Ian J. & Carson, Richard T. & Dupont, Diane & Louviere, Jordan J. & Morimoto, Sanae & Scarpa, Riccardo & Wang, Paul, 2012. "Ordering effects and choice set awareness in repeat-response stated preference studies," Journal of Environmental Economics and Management, Elsevier, vol. 63(1), pages 73-91.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Brett Day & Jose Luis Pinto Prades, 2008. "Sequencing Anomalies in Choice Experiments," Working Papers 08.10, Universidad Pablo de Olavide, Department of Economics.
    4. Schwarzinger, Michaël & Carrat, Fabrice & Luchini, Stéphane, 2009. ""If you have the flu symptoms, your asymptomatic spouse may better answer the willingness-to-pay question": Evidence from a double-bounded dichotomous choice model with heterogeneous anchori," Journal of Health Economics, Elsevier, vol. 28(4), pages 873-884, July.
    5. Michaël Schwarzinger & Fabrice Carrat & Stéphane Luchini, 2009. ""If you have the flu symptoms, your asymptomatic spouse may better answer the willingness-to-pay question". Evidence from a double-bounded dichotomous choice model with heterogeneous anchori," Post-Print inserm-00636179, HAL.
    6. Hermann Donfouet & P. Jeanty & P.-A. Mahieu, 2014. "Dealing with internal inconsistency in double-bounded dichotomous choice: an application to community-based health insurance," Empirical Economics, Springer, vol. 46(1), pages 317-328, February.
    7. McNair, Ben J. & Bennett, Jeff & Hensher, David A., 2011. "A comparison of responses to single and repeated discrete choice questions," Resource and Energy Economics, Elsevier, vol. 33(3), pages 554-571, September.
    8. Watson, Verity & Ryan, Mandy, 2007. "Exploring preference anomalies in double bounded contingent valuation," Journal of Health Economics, Elsevier, vol. 26(3), pages 463-482, May.
    9. Genius, Margarita & Strazzera, Elisabetta, 2011. "Can unbiased be tighter? Assessment of methods to reduce the bias-variance trade-off in WTP estimation," Resource and Energy Economics, Elsevier, vol. 33(1), pages 293-314, January.
    10. Kim, GwanSeon & Petrolia, Daniel R. & Interis, Matthew G., 2012. "A Method for Improving Welfare Estimates from Multiple-Referendum Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 37(2), pages 1-12, August.
    11. Deutschmann, Joshua W. & Postepska, Agnieszka & Sarr, Leopold, 2021. "Measuring willingness to pay for reliable electricity: Evidence from Senegal," World Development, Elsevier, vol. 138(C).
    12. Gelo, Dambala & Koch, Steven F., 2015. "Contingent valuation of community forestry programs in Ethiopia: Controlling for preference anomalies in double-bounded CVM," Ecological Economics, Elsevier, vol. 114(C), pages 79-89.
    13. Jacopo Bonan & Philippe LeMay-Boucher & Michel Tenikue, 2014. "Households' Willingness to Pay for Health Microinsurance and its Impact on Actual Take-up: Results from a Field Experiment in Senegal," Journal of Development Studies, Taylor & Francis Journals, vol. 50(10), pages 1445-1462, November.
    14. Ben McNair & David Hensher & Jeff Bennett, 2012. "Modelling Heterogeneity in Response Behaviour Towards a Sequence of Discrete Choice Questions: A Probabilistic Decision Process Model," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 599-616, April.
    15. Giffoni, Francesco & Florio, Massimo, 2023. "Public support of science: A contingent valuation study of citizens' attitudes about CERN with and without information about implicit taxes," Research Policy, Elsevier, vol. 52(1).
    16. Bateman, Ian J. & Burgess, Diane & Hutchinson, W. George & Matthews, David I., 2008. "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness," Journal of Environmental Economics and Management, Elsevier, vol. 55(2), pages 127-141, March.
    17. DeShazo, J. R., 2002. "Designing Transactions without Framing Effects in Iterative Question Formats," Journal of Environmental Economics and Management, Elsevier, vol. 43(3), pages 360-385, May.
    18. Kang, Heechan & Haab, Timothy C. & Interis, Matthew G., 2013. "Identifying inconsistent responses in dichotomous choice contingent valuation with follow-up questions," Resource and Energy Economics, Elsevier, vol. 35(3), pages 396-411.
    19. Flachaire, Emmanuel & Hollard, Guillaume, 2007. "Starting point bias and respondent uncertainty in dichotomous choice contingent valuation surveys," Resource and Energy Economics, Elsevier, vol. 29(3), pages 183-194, September.
    20. McNair, Ben J. & Hensher, David A. & Bennett, Jeff, 2010. "Modelling heterogeneity in response behaviour towards a sequence of discrete choice questions: a latent class approach," MPRA Paper 23427, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:59:y:2010:i:3:p:271-285. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.