IDEAS home Printed from https://ideas.repec.org/a/eee/eejocm/v28y2018icp153-166.html
   My bibliography  Save this article

Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement

Author

Listed:
  • Crastes dit Sourd, Romain
  • Zawojska, Ewa
  • Mahieu, Pierre-Alexandre
  • Louviere, Jordan

Abstract

Open-ended questions are used in stated preference surveys to elicit values that individuals assign to goods and services. In some settings, the open-ended format can incite respondents to strategically misrepresent these values and, hence, it may lead to biased welfare measures. Literature has developed several methods, such as an oath or a cheap talk, to encourage truthful disclosure of preferences. These methods rely primarily on positive reinforcement by invoking positive associations of trust, honour and honesty, among others. In this paper, we propose a new approach that seeks to mitigate strategic misrepresentation of preferences by means of negative reinforcement, which arouses negative associations of, for example, mistrust and insincerity. The proposed negative reinforcement approach involves punishment for dishonesty in the form of unfavourable recoding of stated values if those are suspected of being untruthful. The approach is examined in a field survey concerning valuation of an entertainment event in the Plant Garden in Nantes, France. The survey makes value overstatement potentially attractive to respondents. We find that respondents who are aware of subsequent unfavourable recoding of insincere (i.e., overstated) values to zeros state significantly lower willingness-to-pay values than respondents who are not faced with the possible recoding of their answers. The effectiveness of the proposed negative reinforcement approach in reducing value overstatement is assessed against an existing positive reinforcement approach, namely against using the oath. Both approaches are observed to generate statistically equivalent value estimates, pointing to their similar effectiveness in mitigating incentives to overstate values.

Suggested Citation

  • Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
  • Handle: RePEc:eee:eejocm:v:28:y:2018:i:c:p:153-166
    DOI: 10.1016/j.jocm.2018.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1755534517300891
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jocm.2018.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    2. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    3. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    4. Edward Balistreri & Gary McClelland & Gregory Poe & William Schulze, 2001. "Can Hypothetical Questions Reveal True Values? A Laboratory Comparison of Dichotomous Choice and Open-Ended Contingent Values with Auction Values," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 18(3), pages 275-292, March.
    5. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    6. Yohei Mitani & Nicholas Flores, 2014. "Hypothetical Bias Reconsidered: Payment and Provision Uncertainties in a Threshold Provision Mechanism," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 59(3), pages 433-454, November.
    7. Helen R. Neill & Ronald G. Cummings & Philip T. Ganderton & Glenn W. Harrison & Thomas McGuckin, 1994. "Hypothetical Surveys and Real Economic Commitments," Land Economics, University of Wisconsin Press, vol. 70(2), pages 145-154.
    8. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 105-121.
    9. repec:hal:pseose:halshs-00731244 is not listed on IDEAS
    10. Glenn Harrison, 2006. "Experimental Evidence on Alternative Environmental Valuation Methods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 125-162, May.
    11. Rebecca Moore & Richard C. Bishop & Bill Provencher & Patricia A. Champ, 2010. "Accounting for Respondent Uncertainty to Improve Willingness‐to‐Pay Estimates," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 58(3), pages 381-401, September.
    12. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    13. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    14. de-Magistris, Tiziana & Pascucci, Stefano, 2014. "The effect of the solemn oath script in hypothetical choice experiment survey: A pilot study," Economics Letters, Elsevier, vol. 123(2), pages 252-255.
    15. Cooper, David J., 2014. "A Note on Deception in Economic Experiments," Journal of Wine Economics, Cambridge University Press, vol. 9(02), pages 111-114, August.
    16. Ewa Zawojska & Mikołaj Czajkowski, 2017. "Re-examining empirical evidence on stated preferences: importance of incentive compatibility," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(4), pages 374-403, October.
    17. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    18. Jayson L. Lusk & F. Bailey Norwood, 2009. "An Inferred Valuation Method," Land Economics, University of Wisconsin Press, vol. 85(3), pages 500-514.
    19. Davies, Stephen P. & Loomis, John B., 2010. "An Improved Method for Calibrating Purchase Intentions in Stated Preference Demand Models," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 42(4), pages 1-15, November.
    20. Laughland, Andrew S. & Musser, Wesley N. & Musser, Lynn M., 1994. "An Experiment In Contingent Valuation And Social Desirability," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 23(1), pages 1-8, April.
    21. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    22. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    23. Carlsson, Fredrik & Martinsson, Peter & Akay, Alpaslan, 2011. "The effect of power outages and cheap talk on willingness to pay to reduce outages," Energy Economics, Elsevier, vol. 33(5), pages 790-798, September.
    24. Silva, Andres & Nayga, Rodolfo M., Jr. & Campbell, Benjamin L. & Park, John L., 2011. "Revisiting Cheap Talk with New Evidence from a Field Experiment," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 36(2), pages 1-12, August.
    25. Herriges, Joseph & Kling, Catherine & Liu, Chih-Chen & Tobias, Justin, 2010. "What are the consequences of consequentiality?," Journal of Environmental Economics and Management, Elsevier, vol. 59(1), pages 67-81, January.
    26. Pierre-Alexandre Mahieu & Henrik Andersson & Olivier Beaumais & Romain Crastes dit Sourd & Stephane Hess & François-Charles Wolff, 2017. "Stated preferences: a unique database composed of 1657 recent published articles in journals related to agriculture, environment, or health," Review of Agricultural, Food and Environmental Studies, Springer, vol. 98(3), pages 201-220, December.
    27. Christian Vossler & J. Scott Holladay, 2016. "Alternative Value Elicitation Formats in Contingent Valuation: A New Hope," Working Papers 2016-02, University of Tennessee, Department of Economics.
    28. Czajkowski, Mikołaj & Vossler, Christian A. & Budziński, Wiktor & Wiśniewska, Aleksandra & Zawojska, Ewa, 2017. "Addressing empirical challenges related to the incentive compatibility of stated preferences methods," Journal of Economic Behavior & Organization, Elsevier, vol. 142(C), pages 47-63.
    29. Malte Oehlmann & Jürgen Meyerhoff, 2017. "Stated preferences towards renewable energy alternatives in Germany – do the consequentiality of the survey and trust in institutions matter?," Journal of Environmental Economics and Policy, Taylor & Francis Journals, vol. 6(1), pages 1-16, January.
    30. Tiziana de-Magistris & Azucena Gracia & Rodolfo M. Nayga, 2013. "On the Use of Honesty Priming Tasks to Mitigate Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(5), pages 1136-1154.
    31. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    32. Cragg, John G, 1971. "Some Statistical Models for Limited Dependent Variables with Application to the Demand for Durable Goods," Econometrica, Econometric Society, vol. 39(5), pages 829-844, September.
    33. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    34. Welsh, Michael P. & Poe, Gregory L., 1998. "Elicitation Effects in Contingent Valuation: Comparisons to a Multiple Bounded Discrete Choice Approach," Journal of Environmental Economics and Management, Elsevier, vol. 36(2), pages 170-185, September.
    35. McKinley Blackburn & Glenn W. Harrison & E. Elisabet Rutström, 1994. "Statistical Bias Functions and Informative Hypothetical Surveys," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 76(5), pages 1084-1088.
    36. Richard Bishop & Kevin Boyle & Richard Carson & David Chapman & Matthew DeBell & Colleen Donovan & W. Michael Hanemann & Barbara Kanninen & Matthew Konopka & Raymond Kopp & Jon Krosnick & John List & , 2017. "Putting a value on injuries to natural assets: The BP Oil Spill," Natural Field Experiments 00610, The Field Experiments Website.
    37. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    38. Mary Jo Kealy & Robert W. Turner, 1993. "A Test of the Equality of Closed-Ended and Open-Ended Contingent Valuations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 75(2), pages 321-331.
    39. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    40. Vossler, Christian A. & Watson, Sharon B., 2013. "Understanding the consequences of consequentiality: Testing the validity of stated preferences in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 137-147.
    41. William J. Burke, 2009. "Fitting and interpreting Cragg's tobit alternative using Stata," Stata Journal, StataCorp LP, vol. 9(4), pages 584-592, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rodrigo J. Tapia & Gerard Jong & Ana M. Larranaga & Helena B. Bettella Cybis, 2021. "Exploring Multiple‐discreteness in Freight Transport. A Multiple Discrete Extreme Value Model Application for Grain Consolidators in Argentina," Networks and Spatial Economics, Springer, vol. 21(3), pages 581-608, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    3. Ewa Zawojska & Pierre-Alexandre Mahieu & Romain Crastes & Jordan Louviere, 2016. "On a way to overcome strategic overbidding in open-ended stated preference surveys: A recoding approach," Working Papers 2016-34, Faculty of Economic Sciences, University of Warsaw.
    4. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    5. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2020. "Ex-ante and ex-post measures to mitigate hypothetical bias. Are they alternative or complementary tools to increase the reliability and validity of DCE estimates?," Working Papers 2020-20, Faculty of Economic Sciences, University of Warsaw.
    6. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    7. Mark A. Andor & Manuel Frondel & Marco Horvath, 2021. "Consequentiality, Elicitation Formats, and the Willingness to Pay for Green Electricity: Evidence from Germany," Land Economics, University of Wisconsin Press, vol. 97(3), pages 626-640.
    8. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    9. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    10. Liebe, Ulf & Glenk, Klaus & von Meyer-Höfer, Marie & Spiller, Achim, 2019. "A web survey application of real choice experiments," Journal of choice modelling, Elsevier, vol. 33(C).
    11. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    12. Atozou, Baoubadi & Tamini, Lota D. & Bergeronm, Stephane & Doyon, Maurice, 2020. "Factors Explaining the Hypothetical Bias: How to Improve Models for Meta-Analyses," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 45(2), March.
    13. Zawojska, Ewa & Bartczak, Anna & Czajkowski, Mikołaj, 2019. "Disentangling the effects of policy and payment consequentiality and risk attitudes on stated preferences," Journal of Environmental Economics and Management, Elsevier, vol. 93(C), pages 63-84.
    14. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    15. Penn, Jerrod & Hu, Wuyang & Ye, Tao, 2024. "Efficacy of hypothetical bias mitigation techniques: A cross-country comparison," Journal of Environmental Economics and Management, Elsevier, vol. 125(C).
    16. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    17. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 75-83, March.
    18. Qin, Botao, 2020. "Does a promise script work to reduce the hypothetical bias? Evidence from an induced value experiment," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 14, pages 1-15.
    19. Malte Welling & Ewa Zawojska & Julian Sagebiel, 2022. "Information, Consequentiality and Credibility in Stated Preference Surveys: A Choice Experiment on Climate Adaptation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 82(1), pages 257-283, May.
    20. Daniel A. Brent & Lata Gangadharan & Anke D. Leroux & Paul A. Raschky, 2022. "Reducing bias in preference elicitation for environmental public goods," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(2), pages 280-308, April.

    More about this item

    Keywords

    Stated preferences; Open-ended value elicitation; Strategic overstatement; Negative reinforcement; Recoding of insincere responses;
    All these keywords.

    JEL classification:

    • D61 - Microeconomics - - Welfare Economics - - - Allocative Efficiency; Cost-Benefit Analysis
    • H40 - Public Economics - - Publicly Provided Goods - - - General
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eejocm:v:28:y:2018:i:c:p:153-166. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/journal-of-choice-modelling .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.