IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19269.html
   My bibliography  Save this paper

Non-Choice Evaluations Predict Behavioral Responses to Changes in Economic Conditions

Author

Listed:
  • B. Douglas Bernheim
  • Daniel Bjorkegren
  • Jeffrey Naecker
  • Antonio Rangel

Abstract

A central task in microeconomics is to predict choices in as-yet-unobserved situations (e.g., after some policy intervention). Standard approaches can prove problematic when sufficiently similar changes have not been observed or do not have observable exogenous causes. We explore an alternative approach that generates predictions based on relationships across decision problems between actual choice frequencies and non-choice subjective evaluations of the available options. In a laboratory experiment, we find that this method yields accurate estimates of price sensitivities for a collection of products under conditions that render standard methods either inapplicable or highly inaccurate.

Suggested Citation

  • B. Douglas Bernheim & Daniel Bjorkegren & Jeffrey Naecker & Antonio Rangel, 2013. "Non-Choice Evaluations Predict Behavioral Responses to Changes in Economic Conditions," NBER Working Papers 19269, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:19269
    Note: PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19269.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bertrand, Marianne & Karlan, Dean S. & Mullainathan, Sendhil & Shafir, Eldar & Zinman, Jonathan, 2005. "What's Psychology Worth? A Field Experiment in the Consumer Credit Market," Center Discussion Papers 28441, Yale University, Economic Growth Center.
    2. Johansson-Stenman , Olof & Svedsäter, Henrik, 2003. "Self Image And Choice Experiments: Hypothetical And Actual Willingness To Pay," Working Papers in Economics 94, University of Gothenburg, Department of Economics.
    3. repec:ebl:ecbull:v:3:y:2004:i:6:p:1-13 is not listed on IDEAS
    4. repec:hal:pseose:halshs-00731244 is not listed on IDEAS
    5. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    6. Brownstone, David & Bunch, David S. & Train, Kenneth, 2000. "Joint mixed logit models of stated and revealed preferences for alternative-fuel vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 34(5), pages 315-338, June.
    7. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    8. R. K. Blamey & J. W. Bennett & M. D. Morrison, 1999. "Yea-Saying in Contingent Valuation Surveys," Land Economics, University of Wisconsin Press, vol. 75(1), pages 126-141.
    9. Marianne Bertrand & Dean Karlan & Sendhil Mullainathan & Eldar Shafir & Jonathan Zinman, 2010. "What's Advertising Content Worth? Evidence from a Consumer Credit Marketing Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 263-306.
    10. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    11. repec:pri:cepsud:217krueger is not listed on IDEAS
    12. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    13. Krueger, Alan B. & Kuziemko, Ilyana, 2013. "The demand for health insurance among uninsured Americans: Results of a survey experiment and implications for policy," Journal of Health Economics, Elsevier, vol. 32(5), pages 780-793.
    14. F Alpizar & F Carlsson & P Martinsson, 2003. "Using Choice Experiments for Non-Market Valuation," Economic Issues Journal Articles, Economic Issues, vol. 8(1), pages 83-110, March.
    15. Jordi Brandts & Gary Charness, 2011. "The strategy versus the direct-response method: a first survey of experimental comparisons," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 375-398, September.
    16. List, John A. & Shogren, Jason F., 1998. "Calibration of the difference between actual and hypothetical valuations in a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 37(2), pages 193-205, October.
    17. Kurz, Mordecai, 1974. "Experimental approach to the determination of the demand for public goods : A reply," Journal of Public Economics, Elsevier, vol. 3(4), pages 431-432, November.
    18. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, September.
    19. Richard T. Carson, 2012. "Contingent Valuation: A Practical Alternative When Prices Aren't Available," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 27-42, Fall.
    20. William J. Infosino, 1986. "Forecasting New Product Sales from Likelihood of Purchase Ratings," Marketing Science, INFORMS, vol. 5(4), pages 372-384.
    21. Morwitz, Vicki G. & Steckel, Joel H. & Gupta, Alok, 2007. "When do purchase intentions predict sales?," International Journal of Forecasting, Elsevier, vol. 23(3), pages 347-364.
    22. repec:pri:indrel:dsp01bc386j227 is not listed on IDEAS
    23. McKinley Blackburn & Glenn W. Harrison & E. Elisabet Rutström, 1994. "Statistical Bias Functions and Informative Hypothetical Surveys," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 76(5), pages 1084-1088.
    24. Shogren, Jason F., 1993. "Experimental Markets and Environmental Policy," Agricultural and Resource Economics Review, Cambridge University Press, vol. 22(2), pages 117-129, October.
    25. Emmanuel Saez, 2009. "Details Matter: The Impact of Presentation and Information on the Take-Up of Financial Incentives for Retirement Saving," American Economic Journal: Economic Policy, American Economic Association, vol. 1(1), pages 204-228, February.
    26. Jason Shogren, 2006. "Valuation in the Lab," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 34(1), pages 163-172, May.
    27. Gruber, Jonathan & Washington, Ebonya, 2005. "Subsidies to employee health insurance premiums and the health insurance market," Journal of Health Economics, Elsevier, vol. 24(2), pages 253-276, March.
    28. Jonathan N. Katz & Gabriel Katz, 2010. "Correcting for Survey Misreports Using Auxiliary Information with an Application to Estimating Turnout," American Journal of Political Science, John Wiley & Sons, vol. 54(3), pages 815-835, July.
    29. Krueger, Alan B. & Kuziemko, Ilyana, 2013. "The demand for health insurance among uninsured Americans: Results of a survey experiment and implications for policy," Journal of Health Economics, Elsevier, vol. 32(5), pages 780-793.
    30. White, Halbert, 1980. "Using Least Squares to Approximate Unknown Regression Functions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 21(1), pages 149-170, February.
    31. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    32. Joseph Little & Robert Berrens, 2004. "Explaining Disparities between Actual and Hypothetical Stated Values: Further Investigation Using Meta-Analysis," Economics Bulletin, AccessEcon, vol. 3(6), pages 1-13.
    33. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    34. List, John A. & Shogren, Jason F., 2002. "Calibration of Willingness-to-Accept," Journal of Environmental Economics and Management, Elsevier, vol. 43(2), pages 219-233, March.
    35. Kurz, Mordecai, 1974. "Experimental approach to the determination of the demand for public goods," Journal of Public Economics, Elsevier, vol. 3(4), pages 329-348, November.
    36. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    37. Daniel J. Benjamin & Ori Heffetz & Miles S. Kimball & Alex Rees-Jones, 2010. "Do People Seek to Maximize Happiness? Evidence from New Surveys," NBER Working Papers 16489, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Raj Chetty, 2015. "Behavioral Economics and Public Policy: A Pragmatic Perspective," American Economic Review, American Economic Association, vol. 105(5), pages 1-33, May.
    2. Diane Coyle & Leonard I. Nakamura, 2019. "Toward a Framework for Time Use, Welfare, and Household Centric Economic Measurement," Working Papers 19-11, Federal Reserve Bank of Philadelphia.
    3. Bart Los & Marcel P. Timmer, 2020. "Measuring Bilateral Exports of Value Added: A Unified Framework," NBER Chapters, in: Challenges of Globalization in the Measurement of National Accounts, pages 389-421, National Bureau of Economic Research, Inc.
    4. Krecik, Markus, 2024. "A needs-based framework for approximating decisions and well-being," Discussion Papers 2024/2, Free University Berlin, School of Business & Economics.
    5. John A. Clithero & Jae Joon Lee & Joshua Tasoff, 2019. "Supervised Machine Learning for Eliciting Individual Demand," Papers 1904.13329, arXiv.org, revised Feb 2021.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alec Smith & B. Douglas Bernheim & Colin F. Camerer & Antonio Rangel, 2014. "Neural Activity Reveals Preferences without Choices," American Economic Journal: Microeconomics, American Economic Association, vol. 6(2), pages 1-36, May.
    2. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    3. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    4. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    5. John C. Whitehead & Subhrendu K. Pattanayak & George L. Van Houtven & Brett R. Gelso, 2008. "Combining Revealed And Stated Preference Data To Estimate The Nonmarket Value Of Ecological Services: An Assessment Of The State Of The Science," Journal of Economic Surveys, Wiley Blackwell, vol. 22(5), pages 872-908, December.
    6. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Cambridge University Press, vol. 33(2), pages 182-192, October.
    7. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    8. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    9. Eva Camacho-Cuena & Aurora García-Gallego & Nikolaos Georgantzís & Gerardo Sabater-Grande, 2004. "An Experimental Validation of Hypothetical WTP for a Recyclable Product," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 27(3), pages 313-335, March.
    10. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    11. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    12. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    13. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    14. Liljas, Bengt & Blumenschein, Karen, 2000. "On hypothetical bias and calibration in cost-benefit studies," Health Policy, Elsevier, vol. 52(1), pages 53-70, May.
    15. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    16. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    17. Araña, Jorge E. & León, Carmelo J., 2013. "Dynamic hypothetical bias in discrete choice experiments: Evidence from measuring the impact of corporate social responsibility on consumers demand," Ecological Economics, Elsevier, vol. 87(C), pages 53-61.
    18. Helga Fehr-Duda & Robin Schimmelpfennig, 2018. "Wider die Zahlengläubigkeit: Sind Befragungsergebnisse eine gute Grundlage für wirtschaftspolitische Entscheidungen?," ECON - Working Papers 297, Department of Economics - University of Zurich, revised Dec 2018.
    19. Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
    20. Shogren, Jason F., 2006. "Experimental Methods and Valuation," Handbook of Environmental Economics, in: K. G. Mäler & J. R. Vincent (ed.), Handbook of Environmental Economics, edition 1, volume 2, chapter 19, pages 969-1027, Elsevier.

    More about this item

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • H31 - Public Economics - - Fiscal Policies and Behavior of Economic Agents - - - Household
    • Q51 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Valuation of Environmental Effects

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19269. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.