IDEAS home Printed from https://ideas.repec.org/a/tpr/restat/v103y2021i1p136-150.html
   My bibliography  Save this article

Multiple Switching and Data Quality in the Multiple Price List

Author

Listed:
  • Chi Wai Yu

    (Hong Kong University of Science and Technology)

  • Y. Jane Zhang

    (University of New South Wales)

  • Sharon Xuejing Zuo

    (School of Economics, Fudan University, and Shanghai Institute of International Finance and Economics)

Abstract

A substantial proportion of individuals who complete the widely used multiple price list (MPL) instrument switch back and forth between the safe and the risky choice columns, behavior that is believed to indicate low-quality decision making. We develop a conceptual framework to formally define decision-making quality, test explanations for the nature of low-quality decision making, and introduce a novel “nudge†treatment that reduced multiple switching behavior and increased decision-making quality. We find evidence in support of task-specific miscomprehension of the MPL and that non-multiple switchers and relatively high-cognitive-ability individuals are not immune to low-quality decision making.

Suggested Citation

  • Chi Wai Yu & Y. Jane Zhang & Sharon Xuejing Zuo, 2021. "Multiple Switching and Data Quality in the Multiple Price List," The Review of Economics and Statistics, MIT Press, vol. 103(1), pages 136-150, March.
    • Handle: RePEc:tpr:restat:v:103:y:2021:i:1:p:136-150
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/rest_a_00895
    Download Restriction: Access to PDF is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David Bruner, 2011. "Multiple switching behaviour in multiple price lists," Applied Economics Letters, Taylor & Francis Journals, vol. 18(5), pages 417-420.
    2. Meier, Stephan & Sprenger, Charles D., 2013. "Discounting financial literacy: Time preferences and participation in financial education programs," Journal of Economic Behavior & Organization, Elsevier, vol. 95(C), pages 159-174.
    3. Catherine C. Eckel & Philip J. Grossman, 2002. "Sex Differences and Statistical Stereotyping in Attitudes Toward Financial Risk," Monash Economics Working Papers archive-03, Monash University, Department of Economics.
    4. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    5. Abigail Barr & Garance Genicot, 2008. "Risk Sharing, Commitment, and Information: An Experimental Analysis," Journal of the European Economic Association, MIT Press, vol. 6(6), pages 1151-1185, December.
    6. Matthias Sutter & Martin G. Kocher & Daniela Glätzle-Rützler & Stefan T. Trautmann, 2013. "Impatience and Uncertainty: Experimental Decisions Predict Adolescents' Field Behavior," American Economic Review, American Economic Association, vol. 103(1), pages 510-531, February.
    7. Hans P. Binswanger, 1980. "Attitudes Toward Risk: Experimental Measurement in Rural India," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 395-407.
    8. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    9. Quang Nguyen & Colin Camerer & Tomomi Tanaka, 2010. "Risk and Time Preferences Linking Experimental and Household Data from Vietnam," Post-Print halshs-00547090, HAL.
    10. Charness, Gary & Viceisza, Angelino, 2016. "Three Risk-elicitation Methods in the Field - Evidence from Rural Senegal," Review of Behavioral Economics, now publishers, vol. 3(2), pages 145-171, July.
    11. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    12. Gary Charness & Catherine Eckel & Uri Gneezy & Agne Kajackaite, 2018. "Complexity in risk elicitation may affect the conclusions: A demonstration using gender differences," Journal of Risk and Uncertainty, Springer, vol. 56(1), pages 1-17, February.
    13. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    14. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard H, 1990. "Experimental Tests of the Endowment Effect and the Coase Theorem," Journal of Political Economy, University of Chicago Press, vol. 98(6), pages 1325-1348, December.
    15. Deck, Cary & Lee, Jungmin & Reyes, Javier A. & Rosen, Christopher C., 2013. "A failed attempt to explain within subject variation in risk taking behavior using domain specific risk attitudes," Journal of Economic Behavior & Organization, Elsevier, vol. 87(C), pages 1-24.
    16. Arnaud Reynaud & Stéphane Couture, 2012. "Stability of risk preference measures: results from a field experiment on French farmers," Theory and Decision, Springer, vol. 73(2), pages 203-221, August.
    17. David Bruner & Michael McKee & Rudy Santore, 2008. "Hand in the Cookie Jar: An Experimental Investigation of Equity-Based Compensation and Managerial Fraud," Southern Economic Journal, John Wiley & Sons, vol. 75(1), pages 261-278, July.
    18. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    19. Marina Agranov & Pietro Ortoleva, 2017. "Stochastic Choice and Preferences for Randomization," Journal of Political Economy, University of Chicago Press, vol. 125(1), pages 40-68.
    20. James Andreoni & Charles Sprenger, 2011. "Uncertainty Equivalents: Testing the Limits of the Independence Axiom," NBER Working Papers 17342, National Bureau of Economic Research, Inc.
    21. Bauermeister, Golo-Friedrich & Mußhoff, Oliver, 2016. "Risk Attitude And Inconsistencies - Does The Choice Of Display Format And Risk Elicitation Method Influence The Outcomes?," 56th Annual Conference, Bonn, Germany, September 28-30, 2016 244764, German Association of Agricultural Economists (GEWISOLA).
    22. David Burner & Michael McKee & Rudy Santore, 2008. "Hand in the Cookie Jar: An Experimental Investigation of Equity‐Based Compensation and Managerial Fraud," Southern Economic Journal, John Wiley & Sons, vol. 75(1), pages 261-278, July.
    23. Sule Alan & Seda Ertac, 2018. "Fostering Patience in the Classroom: Results from Randomized Educational Intervention," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 1865-1911.
    24. Steffen Andersen & Glenn Harrison & Morten Lau & E. Rutström, 2009. "Elicitation using multiple price list formats," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 365-366, September.
    25. Tomomi Tanaka & Colin F. Camerer & Quang Nguyen, 2010. "Risk and Time Preferences: Linking Experimental and Household Survey Data from Vietnam," American Economic Review, American Economic Association, vol. 100(1), pages 557-571, March.
    26. Kerri Brick & Martine Visser & Justine Burns, 2012. "Risk Aversion: Experimental Evidence from South African Fishing Communities," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(1), pages 133-152.
    27. Bauermeister, Golo & Musshoff, Oliver, 2016. "Risk Aversion and Inconsistencies - Does the Choice of Risk Elicitation Method and Display Format Influence the Outcomes?," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235348, Agricultural and Applied Economics Association.
    28. Castillo, Marco & Ferraro, Paul J. & Jordan, Jeffrey L. & Petrie, Ragan, 2011. "The today and tomorrow of kids: Time preferences and educational outcomes of children," Journal of Public Economics, Elsevier, vol. 95(11), pages 1377-1385.
    29. Charness, Gary & Gneezy, Uri & Imas, Alex, 2013. "Experimental methods: Eliciting risk preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 87(C), pages 43-51.
    30. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    31. Chetan Dave & Catherine Eckel & Cathleen Johnson & Christian Rojas, 2010. "Eliciting risk preferences: When is simple better?," Journal of Risk and Uncertainty, Springer, vol. 41(3), pages 219-243, December.
    32. Charness, Gary & Gneezy, Uri, 2012. "Strong Evidence for Gender Differences in Risk Taking," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 50-58.
    33. Sarah Jacobson & Ragan Petrie, 2009. "Learning from mistakes: What do inconsistent choices over risk tell us?," Journal of Risk and Uncertainty, Springer, vol. 38(2), pages 143-158, April.
    34. Catherine Eckel & Philip Grossman & Cathleen Johnson & Angela Oliveira & Christian Rojas & Rick Wilson, 2012. "School environment and risk preferences: Experimental evidence," Journal of Risk and Uncertainty, Springer, vol. 45(3), pages 265-292, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Caliari, Daniele, 2023. "Rationality is not consistency," Discussion Papers, Research Unit: Economics of Change SP II 2023-304, WZB Berlin Social Science Center.
    2. Marco Santorsola & Rocco Caferra & Andrea Morone, 2023. "The salience of informed risk: an experimental analysis," Journal of Economic Studies, Emerald Group Publishing Limited, vol. 51(9), pages 21-35, June.
    3. Ilke Aydogan & Loïc Berger & Valentina Bosetti, 2023. "Unraveling Ambiguity Aversion," Post-Print hal-04370668, HAL.
    4. Jack, B. Kelsey & McDermott, Kathryn & Sautmann, Anja, 2022. "Multiple price lists for willingness to pay elicitation," Journal of Development Economics, Elsevier, vol. 159(C).
    5. Wooyoung Lim & Sujata Visaria, 2020. "The Borrowing Puzzle: Why Do Filipino Domestic Workers in Hong Kong, China Borrow Rather than Dissave?," Asian Development Review, MIT Press, vol. 37(2), pages 77-99, September.
    6. Felix Chan & Laszlo Matyas & Agoston Reguly, 2024. "Modelling with Discretized Variables," Papers 2403.15220, arXiv.org.
    7. Xiu Chen & Xiaojian Zhao, 2021. "How time flies!," Monash Economics Working Papers 2021-09, Monash University, Department of Economics.
    8. Chew, Soo Hong & Miao, Bin & Shen, Qiang & Zhong, Songfa, 2022. "Multiple-switching behavior in choice-list elicitation of risk preference," Journal of Economic Theory, Elsevier, vol. 204(C).
    9. Rosato, Antonio & Tymula, Agnieszka A., 2024. "A novel experimental test of truthful bidding in second-price auctions with real objects," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 111(C).
    10. Bokern, Paul & Linde, Jona & Riedl, Arno & Werner, Peter, 2023. "The robustness of preferences during a crisis: The case of COVID-19," Research Memorandum 012, Maastricht University, Graduate School of Business and Economics (GSBE).
    11. Zachary Breig & Paul Feldman, 2024. "Revealing risky mistakes through revisions," Journal of Risk and Uncertainty, Springer, vol. 68(3), pages 227-254, June.
    12. Changkuk Im, 2023. "Accurate Quality Elicitation in a Multi-Attribute Choice Setting," Papers 2309.00114, arXiv.org, revised Dec 2023.
    13. Anwesha Bandyopadhyay & Lutfunnahar Begum & Philip J. Grossman, 2021. "Gender differences in the stability of risk attitudes," Journal of Risk and Uncertainty, Springer, vol. 63(2), pages 169-201, October.
    14. Daniel J. Benjamin & Mark Alan Fontana & Miles Kimball, 2020. "Reconsidering Risk Aversion," GRU Working Paper Series GRU_2020_026, City University of Hong Kong, Department of Economics and Finance, Global Research Unit.
    15. Boto-García, David & Bucciol, Alessandro, 2023. "Couple and individual willingness to take risks," Journal of Economic Psychology, Elsevier, vol. 99(C).
    16. repec:hal:wpaper:hal-04071242 is not listed on IDEAS
    17. Chen, Xiu & Zhao, Xiaojian, 2024. "How time flies: Time perception and intertemporal choice," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 109(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    2. Anwesha Bandyopadhyay & Lutfunnahar Begum & Philip J. Grossman, 2021. "Gender differences in the stability of risk attitudes," Journal of Risk and Uncertainty, Springer, vol. 63(2), pages 169-201, October.
    3. Holzmeister, Felix & Stefan, Matthias, 2019. "The Risk Elicitation Puzzle Revisited: Across-Methods (In)consistency?," OSF Preprints pj9u2, Center for Open Science.
    4. Felix Holzmeister & Matthias Stefan, 2019. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Working Papers 2019-19, Faculty of Economics and Statistics, Universität Innsbruck.
    5. Ihli, Hanna Julia & Chiputwa, Brian & Musshoff, Oliver, 2016. "Do Changing Probabilities or Payoffs in Lottery-Choice Experiments Affect Risk Preference Outcomes? Evidence from Rural Uganda," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 41(2), May.
    6. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    7. Felix Holzmeister & Matthias Stefan, 2021. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 593-616, June.
    8. Ranganathan, Kavitha & Lejarraga, Tomás, 2021. "Elicitation of risk preferences through satisficing," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    9. Bauermeister, Golo & Musshoff, Oliver, 2016. "Risk Aversion and Inconsistencies - Does the Choice of Risk Elicitation Method and Display Format Influence the Outcomes?," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235348, Agricultural and Applied Economics Association.
    10. Utteeyo Dasgupta & Subha Mani & Smriti Sharma & Saurabh Singhal, 2016. "Eliciting risk preferences: Firefighting in the field," WIDER Working Paper Series wp-2016-47, World Institute for Development Economic Research (UNU-WIDER).
    11. Menkhoff, Lukas & Sakha, Sahra, 2017. "Estimating risky behavior with multiple-item risk measures," Journal of Economic Psychology, Elsevier, vol. 59(C), pages 59-86.
    12. Charness, Gary & Gneezy, Uri & Imas, Alex, 2013. "Experimental methods: Eliciting risk preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 87(C), pages 43-51.
    13. Bauermeister, Golo-Friedrich & Mußhoff, Oliver, 2016. "Risk Attitude And Inconsistencies - Does The Choice Of Display Format And Risk Elicitation Method Influence The Outcomes?," 56th Annual Conference, Bonn, Germany, September 28-30, 2016 244764, German Association of Agricultural Economists (GEWISOLA).
    14. Dasgupta, Utteeyo & Mani, Subha & Sharma, Smriti & Singhal, Saurabh, 2016. "Eliciting Risk Preferences: Firefighting in the Field," IZA Discussion Papers 9765, Institute of Labor Economics (IZA).
    15. Lönnqvist, Jan-Erik & Verkasalo, Markku & Walkowitz, Gari & Wichardt, Philipp C., 2015. "Measuring individual risk attitudes in the lab: Task or ask? An empirical comparison," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 254-266.
    16. Gary Charness & Thomas Garcia & Theo Offerman & Marie Claire Villeval, 2020. "Do measures of risk attitude in the laboratory predict behavior under risk in and outside of the laboratory?," Journal of Risk and Uncertainty, Springer, vol. 60(2), pages 99-123, April.
    17. Paolo Crosetto & Antonio Filippin, 2016. "A theoretical and experimental appraisal of four risk elicitation methods," Experimental Economics, Springer;Economic Science Association, vol. 19(3), pages 613-641, September.
    18. Boggio, Cecilia & Coda Moscarola, Flavia & Gallice, Andrea, 2020. "What is good for the goose is good for the gander?," Economics of Education Review, Elsevier, vol. 75(C).
    19. Menkhoff, Lukas & Sakha, Sahra, 2014. "Multiple-item risk measures," Kiel Working Papers 1980, Kiel Institute for the World Economy (IfW Kiel).
    20. Bruns, Selina JK & Hermann, Daniel & Musshoff, Oliver, 2022. "Is gamification a curse or blessing for the design of risk elicitation methods in the field? Experimental evidence from Cambodian smallholder farmers," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322263, Agricultural and Applied Economics Association.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:restat:v:103:y:2021:i:1:p:136-150. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.