IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/33013.html
   My bibliography  Save this paper

Dynamically Optimized Sequential Experimentation (DOSE) for Estimating Economic Preference Parameters

Author

Listed:
  • Jonathan Chapman
  • Erik Snowberg
  • Stephanie W. Wang
  • Colin Camerer

Abstract

We introduce DOSE—Dynamically Optimized Sequential Experimentation—to elicit preference parameters. DOSE starts with a model of preferences and a prior over the parameters of that model, then dynamically chooses a customized question sequence for each participant according to an experimenter-selected information criterion. After each question, the prior is updated, and the posterior is used to select the next, informationally-optimal, question. Simulations show that DOSE produces parameter estimates that are approximately twice as accurate as those from established elicitation methods. DOSE estimates of individual-level risk and time preferences are also more accurate, more stable over time, and faster to administer in a large representative, incentivized survey of the U.S. population (N = 2,000). By reducing measurement error, DOSE identifies a stronger relationship between risk aversion and cognitive ability than other elicitation techniques. DOSE thus provides a flexible procedure that facilitates the collection of incentivized preference measures in the field.

Suggested Citation

  • Jonathan Chapman & Erik Snowberg & Stephanie W. Wang & Colin Camerer, 2024. "Dynamically Optimized Sequential Experimentation (DOSE) for Estimating Economic Preference Parameters," NBER Working Papers 33013, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:33013
    Note: DEV POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w33013.pdf
    Download Restriction: Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html. Free access is also available to older working papers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    2. Chuang, Yating & Schechter, Laura, 2015. "Stability of experimental and survey measures of risk, time, and social preferences: A review and some new results," Journal of Development Economics, Elsevier, vol. 117(C), pages 151-170.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yohei Mitani & Nobuyuki Hanaki, 2025. "Pay a lot to a few instead of a bit to all! Evidence from online donation experiments," ISER Discussion Paper 1273, Institute of Social and Economic Research, The University of Osaka.
    2. Thomas Henning & Siddhartha M. Ojha & Ross Spoon & Jiatong Han & Colin F. Camerer, 2025. "LLM Trading: Analysis of LLM Agent Behavior in Experimental Asset Markets," Papers 2502.15800, arXiv.org, revised Apr 2025.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Delphine Boutin & Laurène Petifour & Haris Megzari, 2022. "Instability of preferences due to Covid-19 Crisis and emotions: a natural experiment from urban Burkina Faso," Working Papers hal-03623601, HAL.
    2. Jetter, Michael & Magnusson, Leandro M. & Roth, Sebastian, 2020. "Becoming sensitive: Males’ risk and time preferences after the 2008 financial crisis," European Economic Review, Elsevier, vol. 128(C).
    3. Beine, Michel & Charness, Gary & Dupuy, Arnaud & Joxhe, Majlinda, 2020. "Shaking Things Up: On the Stability of Risk and Time Preferences," IZA Discussion Papers 13084, Institute of Labor Economics (IZA).
    4. Jansen, Anika & Pfeifer, Harald & Raecke, Julia, 2017. "Only the brave? Risk and time preferences of decision makers and firms’ investment in worker training," Research Memorandum 004, Maastricht University, Graduate School of Business and Economics (GSBE).
    5. Zexuan Wang & Ismaël Rafaï & Marc Willinger, 2023. "Does age affect the relation between risk and time preferences? Evidence from a representative sample," Southern Economic Journal, John Wiley & Sons, vol. 90(2), pages 341-368, October.
    6. Kahsay, Haftom Bayray & Piras, Simone & Kuhfuss, Laure & Setti, Marco & Marini Govigli, Valentino, 2024. "Understanding inconsistencies in risk attitude elicitation games: Evidence from smallholder farmers in five African countries," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 113(C).
    7. Luc Meunier & Sima Ohadi, 2021. "The Impact of the COVID-19 Crisis on Individuals' Risk and Time Preferences," Economics Bulletin, AccessEcon, vol. 41(3), pages 1050-1069.
    8. Lönnqvist, Jan-Erik & Verkasalo, Markku & Walkowitz, Gari & Wichardt, Philipp C., 2015. "Measuring individual risk attitudes in the lab: Task or ask? An empirical comparison," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 254-266.
    9. Kureishi, Wataru & Paule-Paludkiewicz, Hannah & Tsujiyama, Hitoshi & Wakabayashi, Midori, 2021. "Time preferences over the life cycle and household saving puzzles," Journal of Monetary Economics, Elsevier, vol. 124(C), pages 123-139.
    10. Ubfal, Diego, 2016. "How general are time preferences? Eliciting good-specific discount rates," Journal of Development Economics, Elsevier, vol. 118(C), pages 150-170.
    11. Kuroishi, Yusuke & Sawada, Yasuyuki, 2024. "On the stability of preferences: Experimental evidence from two disasters," European Economic Review, Elsevier, vol. 161(C).
    12. Pushkar Maitra & Ananta Neelim, 2021. "Behavioural characteristics, stability of preferences and entrepreneurial success," Chapters, in: Ananish Chaudhuri (ed.), A Research Agenda for Experimental Economics, chapter 5, pages 93-118, Edward Elgar Publishing.
    13. Kucuk, Merve & Ulubasoglu, Mehmet & Vu, Ha, 2024. "Stormy Futures? The Impact of Climatic Shocks on Retirement Savings," MPRA Paper 121241, University Library of Munich, Germany.
    14. Holden , Stein T. & Tilahun , Mesfin, 2019. "The Devil is in the Details: Risk Preferences, Choice List Design, and Measurement Error," CLTS Working Papers 3/19, Norwegian University of Life Sciences, Centre for Land Tenure Studies, revised 16 Oct 2019.
    15. Boutin, Delphine & Petifour, Laurene & Megzari, Haris, 2023. "Permanent Instability of Preferences after COVID-19 Crisis: A Natural Experiment from Urban Burkina Faso," IZA Discussion Papers 16075, Institute of Labor Economics (IZA).
    16. Dietmar Fehr & Yannick Reichlin, 2021. "Status, Control Beliefs, and Risk-Taking," CESifo Working Paper Series 9253, CESifo.
    17. Andreas C. Drichoutis & Rodolfo M. Nayga, 2022. "On the stability of risk and time preferences amid the COVID-19 pandemic," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 759-794, June.
    18. Glenn W. Harrison & Morten I. Lau & Hong Il Yoo, 2025. "Constant Discounting, Temporal Instability, And Dynamic Inconsistency In Denmark: A Longitudinal Field Experiment," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 66(1), pages 363-392, February.
    19. Castro, M.F.; & Guccio, C.; & Romeo, D.;, 2022. "An assessment of physicians’ risk attitudes using laboratory and field data," Health, Econometrics and Data Group (HEDG) Working Papers 22/26, HEDG, c/o Department of Economics, University of York.
    20. Dorian Jullien, 2016. "Under Uncertainty, Over Time and Regarding Other People: Rationality in 3D," GREDEG Working Papers 2016-20, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.

    More about this item

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • D03 - Microeconomics - - General - - - Behavioral Microeconomics: Underlying Principles
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D9 - Microeconomics - - Micro-Based Behavioral Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:33013. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.