IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v28y2018icp153-166.html
   My bibliography  Save this article

Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement

Author

Listed:
  • Crastes dit Sourd, Romain
  • Zawojska, Ewa
  • Mahieu, Pierre-Alexandre
  • Louviere, Jordan

Abstract

Open-ended questions are used in stated preference surveys to elicit values that individuals assign to goods and services. In some settings, the open-ended format can incite respondents to strategically misrepresent these values and, hence, it may lead to biased welfare measures. Literature has developed several methods, such as an oath or a cheap talk, to encourage truthful disclosure of preferences. These methods rely primarily on positive reinforcement by invoking positive associations of trust, honour and honesty, among others. In this paper, we propose a new approach that seeks to mitigate strategic misrepresentation of preferences by means of negative reinforcement, which arouses negative associations of, for example, mistrust and insincerity. The proposed negative reinforcement approach involves punishment for dishonesty in the form of unfavourable recoding of stated values if those are suspected of being untruthful. The approach is examined in a field survey concerning valuation of an entertainment event in the Plant Garden in Nantes, France. The survey makes value overstatement potentially attractive to respondents. We find that respondents who are aware of subsequent unfavourable recoding of insincere (i.e., overstated) values to zeros state significantly lower willingness-to-pay values than respondents who are not faced with the possible recoding of their answers. The effectiveness of the proposed negative reinforcement approach in reducing value overstatement is assessed against an existing positive reinforcement approach, namely against using the oath. Both approaches are observed to generate statistically equivalent value estimates, pointing to their similar effectiveness in mitigating incentives to overstate values.

Suggested Citation

  • Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
  • Handle: RePEc:eee:eejocm:v:28:y:2018:i:c:p:153-166
    DOI: 10.1016/j.jocm.2018.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534517300891
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jocm.2018.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    2. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    3. Ewa Zawojska & Mikołaj Czajkowski, 2017. "Re-examining empirical evidence on stated preferences: importance of incentive compatibility," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(4), pages 374-403, October.
    4. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    5. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    6. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    7. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    8. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    9. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    10. Edward Balistreri & Gary McClelland & Gregory Poe & William Schulze, 2001. "Can Hypothetical Questions Reveal True Values? A Laboratory Comparison of Dichotomous Choice and Open-Ended Contingent Values with Auction Values," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 18(3), pages 275-292, March.
    11. Herriges, Joseph & Kling, Catherine & Liu, Chih-Chen & Tobias, Justin, 2010. "What are the consequences of consequentiality?," Journal of Environmental Economics and Management, Elsevier, vol. 59(1), pages 67-81, January.
    12. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    13. Mary Jo Kealy & Robert W. Turner, 1993. "A Test of the Equality of Closed-Ended and Open-Ended Contingent Valuations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 75(2), pages 321-331.
    14. Rebecca Moore & Richard C. Bishop & Bill Provencher & Patricia A. Champ, 2010. "Accounting for Respondent Uncertainty to Improve Willingness‐to‐Pay Estimates," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 58(3), pages 381-401, September.
    15. Carlsson, Fredrik & Martinsson, Peter & Akay, Alpaslan, 2011. "The effect of power outages and cheap talk on willingness to pay to reduce outages," Energy Economics, Elsevier, vol. 33(5), pages 790-798, September.
    16. Jayson L. Lusk & F. Bailey Norwood, 2009. "An Inferred Valuation Method," Land Economics, University of Wisconsin Press, vol. 85(3), pages 500-514.
    17. Silva, Andres & Nayga, Rodolfo M., Jr. & Campbell, Benjamin L. & Park, John L., 2011. "Revisiting Cheap Talk with New Evidence from a Field Experiment," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 36(2), pages 1-12, August.
    18. Mahieu, Pierre-Alexandre & Andersson, Henrik & Beaumais, Olivier & Crastes dit Sourd, Romain & Hess, François-Charles & Wolff, François-Charles, 2017. "Stated preferences: a unique database composed of 1657 recent published articles in journals related to agriculture, environment, or health," Review of Agricultural, Food and Environmental Studies, Institut National de la Recherche Agronomique (INRA), vol. 98(3), November.
    19. Yohei Mitani & Nicholas Flores, 2014. "Hypothetical Bias Reconsidered: Payment and Provision Uncertainties in a Threshold Provision Mechanism," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 433-454, November.
    20. Laughland, Andrew S. & Musser, Wesley N. & Musser, Lynn M., 1994. "An Experiment in Contingent Valuation and Social Desirability," Agricultural and Resource Economics Review, Cambridge University Press, vol. 23(1), pages 29-36, April.
    21. Davies, Stephen & Loomis, John, 2010. "An Improved Method for Calibrating Purchase Intentions in Stated Preference Demand Models," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 42(4), pages 679-693, November.
    22. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    23. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    24. Welsh, Michael P. & Poe, Gregory L., 1998. "Elicitation Effects in Contingent Valuation: Comparisons to a Multiple Bounded Discrete Choice Approach," Journal of Environmental Economics and Management, Elsevier, vol. 36(2), pages 170-185, September.
    25. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    26. Vossler, Christian A. & Watson, Sharon B., 2013. "Understanding the consequences of consequentiality: Testing the validity of stated preferences in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 137-147.
    27. Helen R. Neill & Ronald G. Cummings & Philip T. Ganderton & Glenn W. Harrison & Thomas McGuckin, 1994. "Hypothetical Surveys and Real Economic Commitments," Land Economics, University of Wisconsin Press, vol. 70(2), pages 145-154.
    28. Christian Vossler & J. Scott Holladay, 2016. "Alternative Value Elicitation Formats in Contingent Valuation: A New Hope," Working Papers 2016-02, University of Tennessee, Department of Economics.
    29. Czajkowski, Mikołaj & Vossler, Christian A. & Budziński, Wiktor & Wiśniewska, Aleksandra & Zawojska, Ewa, 2017. "Addressing empirical challenges related to the incentive compatibility of stated preferences methods," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 47-63.
    30. de-Magistris, Tiziana & Pascucci, Stefano, 2014. "The effect of the solemn oath script in hypothetical choice experiment survey: A pilot study," Economics Letters, Elsevier, vol. 123(2), pages 252-255.
    31. Cooper, David J., 2014. "A Note on Deception in Economic Experiments," Journal of Wine Economics, Cambridge University Press, vol. 9(02), pages 111-114, August.
    32. William J. Burke, 2009. "Fitting and interpreting Cragg's tobit alternative using Stata," Stata Journal, StataCorp LP, vol. 9(4), pages 584-592, December.
    33. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 105-121.
    34. Malte Oehlmann & Jürgen Meyerhoff, 2017. "Stated preferences towards renewable energy alternatives in Germany – do the consequentiality of the survey and trust in institutions matter?," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 1-16, January.
    35. Tiziana de-Magistris & Azucena Gracia & Rodolfo M. Nayga, 2013. "On the Use of Honesty Priming Tasks to Mitigate Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(5), pages 1136-1154.
    36. McKinley Blackburn & Glenn W. Harrison & E. Elisabet Rutström, 1994. "Statistical Bias Functions and Informative Hypothetical Surveys," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 76(5), pages 1084-1088.
    37. Cragg, John G, 1971. "Some Statistical Models for Limited Dependent Variables with Application to the Demand for Durable Goods," Econometrica, Econometric Society, vol. 39(5), pages 829-844, September.
    38. Richard Bishop & Kevin Boyle & Richard Carson & David Chapman & Matthew DeBell & Colleen Donovan & W. Michael Hanemann & Barbara Kanninen & Matthew Konopka & Raymond Kopp & Jon Krosnick & John List & , 2017. "Putting a value on injuries to natural assets: The BP Oil Spill," Natural Field Experiments 00610, The Field Experiments Website.
    39. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    40. Glenn Harrison, 2006. "Experimental Evidence on Alternative Environmental Valuation Methods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 125-162, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rodrigo J. Tapia & Gerard Jong & Ana M. Larranaga & Helena B. Bettella Cybis, 2021. "Exploring Multiple‐discreteness in Freight Transport. A Multiple Discrete Extreme Value Model Application for Grain Consolidators in Argentina," Networks and Spatial Economics, Springer, vol. 21(3), pages 581-608, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    3. Ewa Zawojska & Pierre-Alexandre Mahieu & Romain Crastes & Jordan Louviere, 2016. "On a way to overcome strategic overbidding in open-ended stated preference surveys: A recoding approach," Working Papers 2016-34, Faculty of Economic Sciences, University of Warsaw.
    4. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    5. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2020. "Ex-ante and ex-post measures to mitigate hypothetical bias. Are they alternative or complementary tools to increase the reliability and validity of DCE estimates?," Working Papers 2020-20, Faculty of Economic Sciences, University of Warsaw.
    6. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    7. Mark A. Andor & Manuel Frondel & Marco Horvath, 2021. "Consequentiality, Elicitation Formats, and the Willingness to Pay for Green Electricity: Evidence from Germany," Land Economics, University of Wisconsin Press, vol. 97(3), pages 626-640.
    8. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    9. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    10. Liebe, Ulf & Glenk, Klaus & von Meyer-Höfer, Marie & Spiller, Achim, 2019. "A web survey application of real choice experiments," Journal of choice modelling, Elsevier, vol. 33(C).
    11. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    12. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    13. Atozou, Baoubadi & Tamini, Lota D. & Bergeronm, Stephane & Doyon, Maurice, 2020. "Factors Explaining the Hypothetical Bias: How to Improve Models for Meta-Analyses," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 45(2), March.
    14. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    15. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 75-83, March.
    16. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    17. Andersson, Henrik & Ouvrard, Benjamin, 2023. "Priming and the value of a statistical life: A cross country comparison," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 104(C).
    18. Tobias Börger & Tenaw G. Abate & Margrethe Aanesen & Ewa Zawojska, 2021. "Payment and Policy Consequentiality in Dichotomous Choice Contingent Valuation: Experimental Design Effects on Self-Reported Perceptions," Land Economics, University of Wisconsin Press, vol. 97(2), pages 407-424.
    19. Jiang, Qi & Penn, Jerrod & Hu, Wuyang, 2022. "Real payment priming to reduce potential hypothetical bias," Journal of choice modelling, Elsevier, vol. 45(C).
    20. Andersson, Henrik & Ouvrard, Benjamin, 2023. "Priming and the Value of a Statistical Life: A Cross Country Comparison," TSE Working Papers 23-1439, Toulouse School of Economics (TSE).

    More about this item

    Keywords

    Stated preferences; Open-ended value elicitation; Strategic overstatement; Negative reinforcement; Recoding of insincere responses;
    All these keywords.

    JEL classification:

    • D61 - Microeconomics - - Welfare Economics - - - Allocative Efficiency; Cost-Benefit Analysis
    • H40 - Public Economics - - Publicly Provided Goods - - - General
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:28:y:2018:i:c:p:153-166. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.