IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v90y2018icp294-302.html
   My bibliography  Save this article

Demand effects in stated preference surveys

Author

Listed:
  • Carlsson, Fredrik
  • Kataria, Mitesh
  • Lampi, Elina

Abstract

We argue that demand effects in stated preference studies are understudied. By demand effects, we mean anything in the survey that unintentionally influences respondents' beliefs about appropriate behavior, which in turn might affect their responses in the survey. We implement two methods for measuring and implicitly reducing the influence of demand effects. The first approach—random selection of good to be valued—does not have any effect on respondent behavior. The second approach—a demand script and a control question with feedback—has a sizable and statistically significant effect on respondent behavior. In particular, estimated marginal willingness to pay for improvements in water quality are substantially (around 50 percent) lower than a control treatment; we attribute this decrease to a reduced demand effect. Our results suggest that stated preference methods tend to lead to biased willingness-to-pay estimates due to demand effects, but that the bias can be reduced using simple measures.

Suggested Citation

  • Carlsson, Fredrik & Kataria, Mitesh & Lampi, Elina, 2018. "Demand effects in stated preference surveys," Journal of Environmental Economics and Management, Elsevier, vol. 90(C), pages 294-302.
    • Handle: RePEc:eee:jeeman:v:90:y:2018:i:c:p:294-302
    DOI: 10.1016/j.jeem.2018.06.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069617306113
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jeem.2018.06.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    2. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    3. Carlsson, Fredrik & Martinsson, Peter, 2001. "Do Hypothetical and Actual Marginal Willingness to Pay Differ in Choice Experiments?: Application to the Valuation of the Environment," Journal of Environmental Economics and Management, Elsevier, vol. 41(2), pages 179-192, March.
    4. George A. Akerlof & Rachel E. Kranton, 2000. "Economics and Identity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 715-753.
    5. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 105-121.
    6. repec:hal:pseose:halshs-00731244 is not listed on IDEAS
    7. Arne Risa Hole, 2007. "A comparison of approaches to estimating confidence intervals for willingness to pay measures," Health Economics, John Wiley & Sons, Ltd., vol. 16(8), pages 827-840, August.
    8. Bateman, Ian J. & Mawby, James, 2004. "First impressions count: interviewer appearance and information effects in stated preference studies," Ecological Economics, Elsevier, vol. 49(1), pages 47-55, May.
    9. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    10. Peter Boxall & Wiktor Adamowicz, 2002. "Understanding Heterogeneous Preferences in Random Utility Models: A Latent Class Approach," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(4), pages 421-446, December.
    11. W. Michael Hanemann, 1994. "Valuing the Environment through Contingent Valuation," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 19-43, Fall.
    12. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    13. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shr, Yau-Huo (Jimmy) & Zhang, Wendong, 2024. "Omitted downstream attributes and the benefits of nutrient reductions: Implications for choice experiments," Ecological Economics, Elsevier, vol. 222(C).
    2. Carlsson, Fredrik & Kataria, Mitesh & Lampi, Elina, 2022. "How much does it take? Willingness to switch to meat substitutes," Ecological Economics, Elsevier, vol. 193(C).
    3. Endre Kildal Iversen & Kristine Grimsrud & Yohei Mitani & Henrik Lindhjem, 2022. "Altruist Talk May (also) Be Cheap: Revealed Versus Stated Altruism as a Predictor in Stated Preference Studies," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 83(3), pages 681-708, November.
    4. Yau-Huo Shr & Wendong Zhang, 2021. "Does Omitting Downstream Water Quality Change the Economic Benefits of Nutrient Reduction? Evidence from a Discrete Choice Experiment," Center for Agricultural and Rural Development (CARD) Publications 21-wp620, Center for Agricultural and Rural Development (CARD) at Iowa State University.
    5. Lin, Wen & Nayga, Rodolfo M., 2022. "Green identity labeling, environmental information, and pro-environmental food choices," Food Policy, Elsevier, vol. 106(C).
    6. Carlsson, Fredrik & Kataria, Mitesh & Lampi, Elina, 2021. "Sustainable food: can food labels make consumers switch to meat substitutes?," Working Papers in Economics 816, University of Gothenburg, Department of Economics.
    7. Carlsson, Fredrik & Kataria, Mitesh & Lampi, Elina, 2022. "Sustainable food: Can information from food labels make consumers switch to meat substitutes?," Ecological Economics, Elsevier, vol. 201(C).
    8. Shr, Yau-Huo Jimmy & Zhang, Wendong, 2021. "Does Omitting Downstream Water Quality Change the Economic Benefits of Nutrient Reduction Programs: Evidence from a Discrete Choice Experiment," 2021 Annual Meeting, August 1-3, Austin, Texas 313927, Agricultural and Applied Economics Association.
    9. Alicia Entem & Patrick Lloyd‐Smith & Wiktor ( Vic) L. Adamowicz & Peter C. Boxall, 2022. "Using inferred valuation to quantify survey and social desirability bias in stated preference research," American Journal of Agricultural Economics, John Wiley & Sons, vol. 104(4), pages 1224-1242, August.
    10. Lin, Wen & Ma, Baojie & Liang, Jiangyuan & Jin, Shaosheng, 2024. "Price response to government disclosure of food safety information in developing markets," Food Policy, Elsevier, vol. 123(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel A. Brent & Lata Gangadharan & Anke D. Leroux & Paul A. Raschky, 2022. "Reducing bias in preference elicitation for environmental public goods," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(2), pages 280-308, April.
    2. Di Fang & Rodolfo M. Nayga & Grant H. West & Claudia Bazzani & Wei Yang & Benjamin C. Lok & Charles E. Levy & Heather A. Snell, 2021. "On the Use of Virtual Reality in Mitigating Hypothetical Bias in Choice Experiments," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 142-161, January.
    3. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    4. Pascal Achard & Sigrid Suetens, 2023. "The causal effect of ethnic diversity on support for redistribution and the role of discrimination," Journal of Economic Surveys, Wiley Blackwell, vol. 37(5), pages 1678-1696, December.
    5. Carnegie, Rachel & Wang, Holly & Widmar, Nicole & Ortega, David, 2014. "Consumer Preferences for Quality and Safety Attributes of Duck in Restaurant Entrees: Is China A Viable Market for The U.S. Duck Industry?," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170717, Agricultural and Applied Economics Association.
    6. Gary Charness & David Masclet & Marie Claire Villeval, 2014. "The Dark Side of Competition for Status," Management Science, INFORMS, vol. 60(1), pages 38-55, January.
    7. Sääksvuori, Lauri & Ramalingam, Abhijit, 2015. "Bargaining under surveillance: Evidence from a three-person ultimatum game," Journal of Economic Psychology, Elsevier, vol. 51(C), pages 66-78.
    8. Nicolas Jacquemet & Alexander James & Stéphane Luchini & Jason F. Shogren, 2017. "Referenda Under Oath," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 67(3), pages 479-504, July.
    9. Fredrik Carlsson, 2010. "Design of Stated Preference Surveys: Is There More to Learn from Behavioral Economics?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 46(2), pages 167-177, June.
    10. Sagamba, MoÏse & Shchetinin, Oleg & Yusupov, Nurmukhammad, 2013. "Do Microloan Officers Want to Lend to the Less Advantaged? Evidence from a Choice Experiment," World Development, Elsevier, vol. 42(C), pages 182-198.
    11. Francisco Alpizar & Fredrik Carlsson & Olof Johansson-Stenman, 2008. "Does context matter more for hypothetical than for actual contributions? Evidence from a natural field experiment," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 299-314, September.
    12. Ladenburg, Jacob & Olsen, Søren Bøye, 2008. "Gender-specific starting point bias in choice experiments: Evidence from an empirical study," Journal of Environmental Economics and Management, Elsevier, vol. 56(3), pages 275-285, November.
    13. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    14. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    15. Chmura, Thorsten & Goerg, Sebastian J. & Weiss, Pia, 2016. "Natural groups and economic characteristics as driving forces of wage discrimination," European Economic Review, Elsevier, vol. 90(C), pages 178-200.
    16. Timothy C. Haab & Matthew G. Interis & Daniel R. Petrolia & John C. Whitehead, 2013. "From Hopeless to Curious? Thoughts on Hausman's "Dubious to Hopeless" Critique of Contingent Valuation," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 35(4), pages 593-612.
    17. Daniel A. Brent & Lata Gangadharan & Anke Leroux & Paul A. Raschky, 2014. "Putting One's Money Where One's Mouth is: Increasing Saliency in the Field," Monash Economics Working Papers 43-14, Monash University, Department of Economics.
    18. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    19. Ortega, David L. & Wang, H. Holly & Wu, Laping & Olynk, Nicole J., 2011. "Modeling heterogeneity in consumer preferences for select food safety attributes in China," Food Policy, Elsevier, vol. 36(2), pages 318-324, April.
    20. Ravetti, Chiara & Sarr, Mare & Munene, Daniel & Swanson, Tim, 2019. "Discrimination and favouritism among South African workers: Ethnic identity and union membership," World Development, Elsevier, vol. 123(C), pages 1-1.

    More about this item

    Keywords

    Demand effect; Stated preferences;

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:90:y:2018:i:c:p:294-302. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.