IDEAS home Printed from https://ideas.repec.org/a/eee/joepsy/v75y2019ipas016748701830309x.html
   My bibliography  Save this article

An exercise in self-replication: Replicating Shah, Mullainathan, and Shafir (2012)

Author

Listed:
  • Shah, Anuj K.
  • Mullainathan, Sendhil
  • Shafir, Eldar

Abstract

Shah et al. (2012) examined how different forms of scarcity affect attention and borrowing behavior. Results from a series of lab experiments suggested that (1) various forms of scarcity have similar effects on cognition and behavior, (2) scarcity leads to attentional shifts and greater focus (3) scarcity can lead people to over-borrow, and (4) scarcity can lead to cognitive fatigue. Camerer (2018) recently conducted replications of studies from a set of social science papers, and failed to replicate the result on cognitive fatigue from Shah et al. (2012). In this paper, we present high-powered replications of all studies from Shah et al. (2012). We describe which results appear more robust and which results appear to be less robust. We conclude with some thoughts on the value of self-replications.

Suggested Citation

  • Shah, Anuj K. & Mullainathan, Sendhil & Shafir, Eldar, 2019. "An exercise in self-replication: Replicating Shah, Mullainathan, and Shafir (2012)," Journal of Economic Psychology, Elsevier, vol. 75(PA).
    • Handle: RePEc:eee:joepsy:v:75:y:2019:i:pa:s016748701830309x
    DOI: 10.1016/j.joep.2018.12.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016748701830309X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joep.2018.12.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Leandro S. Carvalho & Stephan Meier & Stephanie W. Wang, 2016. "Poverty and Economic Decision-Making: Evidence from Changes in Financial Resources at Payday," American Economic Review, American Economic Association, vol. 106(2), pages 260-284, February.
    2. Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
    3. Eesha Sharma & Adam L. Alter, 2012. "Financial Deprivation Prompts Consumers to Seek Scarce Goods," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 39(3), pages 545-560.
    4. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    5. Stephen A. Spiller, 2011. "Opportunity Cost Consideration," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 38(4), pages 595-610.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kai Ruggeri & Amma Panin & Milica Vdovic & Bojana Većkalov & Nazeer Abdul-Salaam & Jascha Achterberg & Carla Akil & Jolly Amatya & Kanchan Amatya & Thomas Lind Andersen & Sibele D. Aquino & Arjoon Aru, 2022. "The globalizability of temporal discounting," Nature Human Behaviour, Nature, vol. 6(10), pages 1386-1397, October.
    2. Hilbert, Leon P. & Noordewier, Marret K. & van Dijk, Wilco W., 2022. "Financial scarcity increases discounting of gains and losses: Experimental evidence from a household task," Journal of Economic Psychology, Elsevier, vol. 92(C).
    3. Schmitt, Stefanie Yvonne & Schlatterer, Markus G., 2020. "Poverty and limited attention," BERG Working Paper Series 159, Bamberg University, Bamberg Economic Research Group.
    4. van Dijk, Wilco W. & van der Werf, Minou M.B. & van Dillen, Lotte F., 2022. "The Psychological Inventory of Financial Scarcity (PIFS): A psychometric evaluation," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    5. Ariel Kalil & Susan Mayer & Rohen Shah, 2023. "Scarcity and Inattention," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 7(1), pages 35-42, November.
    6. Guilherme Lichand & Anandi Mani, 2020. "Cognitive Droughts," CSAE Working Paper Series 2020-02, Centre for the Study of African Economies, University of Oxford.
    7. Isler, Ozan & Yilmaz, Onurcan & Dulleck, Uwe, 2023. "Scarcity improves economic valuations when cognitively salient," Journal of Economic Behavior & Organization, Elsevier, vol. 209(C), pages 362-371.
    8. Dominguez-Viera, Marcos E. & van den Berg, Marrit & Handgraaf, Michel & Donovan, Jason, 2023. "Influence of poverty concerns on demand for healthier processed foods: A field experiment in Mexico City," Economics & Human Biology, Elsevier, vol. 49(C).
    9. Felipe González-Arango & Javier Corredor & María Angélica López-Ardila & María Camila Contreras-González & Juan Herrera-Santofimio & Jhonathan Jared González, 2022. "The duality of poverty: a replication of Mani et al. (2013) in Colombia," Theory and Decision, Springer, vol. 92(1), pages 39-73, February.
    10. Kai Ruggeri & Amma Panin & Milica Vdovic & Bojana Većkalov & Nazeer Abdul-Salaam & Jascha Achterberg & Carla Akil & Jolly Amatya & Kanchan Amatya & Thomas Lind Andersen & Sibele D. Aquino & Arjoon Aru, 2022. "The globalizability of temporal discounting," Nature Human Behaviour, Nature, vol. 6(10), pages 1386-1397, October.
      • Kai Ruggeri & Amma Panin & Milica Vdovic & Bojana Većkalov & Nazeer Abdul-Salaam & Jascha Achterberg & Carla Akil & Jolly Amatya & Kanchan Amatya & Thomas Lind Andersen & Sibele D Aquino & Arjoon Arun, 2022. "The globalizability of temporal discounting," Post-Print halshs-03903193, HAL.
    11. Guilherme Lichand & Anandi Mani, 2020. "Cognitive droughts," ECON - Working Papers 341, Department of Economics - University of Zurich.
    12. Schmitt, Stefanie Y. & Schlatterer, Markus G., 2021. "Poverty and limited attention," Economics & Human Biology, Elsevier, vol. 41(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Malika Malika & Durairaj Maheswaran & Shailendra Pratap Jain, 2022. "Perceived financial constraints and normative influence: discretionary purchase decisions across cultures," Journal of the Academy of Marketing Science, Springer, vol. 50(2), pages 252-271, March.
    2. Kai Ruggeri & Amma Panin & Milica Vdovic & Bojana Većkalov & Nazeer Abdul-Salaam & Jascha Achterberg & Carla Akil & Jolly Amatya & Kanchan Amatya & Thomas Lind Andersen & Sibele D. Aquino & Arjoon Aru, 2022. "The globalizability of temporal discounting," Nature Human Behaviour, Nature, vol. 6(10), pages 1386-1397, October.
    3. Brice Corgnet & Cary Deck & Mark DeSantis & Kyle Hampton & Erik O. Kimbrough, 2023. "When Do Security Markets Aggregate Dispersed Information?," Management Science, INFORMS, vol. 69(6), pages 3697-3729, June.
    4. Bergemann, Dirk & Ottaviani, Marco, 2021. "Information Markets and Nonmarkets," CEPR Discussion Papers 16459, C.E.P.R. Discussion Papers.
    5. Albert J. Menkveld & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neusüß & Michael Razen & Utz Weitzel & David Abad‐Díaz & Menachem (Meni) Abudy , 2024. "Nonstandard Errors," Journal of Finance, American Finance Association, vol. 79(3), pages 2339-2390, June.
      • Albert J. Menkveld & Anna Dreber & Félix Holzmeister & Juergen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neusüss & Michael Razen & Utz Weitzel & Gunther Capelle-Blancard, 2021. "Non-Standard Errors," Documents de travail du Centre d'Economie de la Sorbonne 21033, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
      • Menkveld, Albert J. & Dreber, Anna & Holzmeister, Felix & Huber, Juergen & Johannesson, Magnus & Kirchler, Michael & Neusüss, Sebastian & Razen, Michael & Weitzel, Utz & Abad-Díaz, David & Abudy, Mena, 2021. "Non-Standard Errors," Working Papers 2021:17, Lund University, Department of Economics.
      • Albert J. Menkveld & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neussüs & Michael Razen & Utz Weitzel & Christian Brownlees & Javier Gil-Bazo, 2021. "Non-Standard Errors," Working Papers 1303, Barcelona School of Economics.
      • Menkveld, Albert J. & Dreber, Anna & Holzmeister, Felix & Huber, Jürgen & Johannesson, Magnus & Kirchler, Michael & Neusüss, Sebastian & Razen, Michael & Weitzel, Utz, 2021. "Non-standard errors," IWH Discussion Papers 11/2021, Halle Institute for Economic Research (IWH).
      • Albert J. Menkveld & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neussüs & Michael Razen & Utz Weitzel & Christian T. Brownlees & Javier Gil-Baz, 2021. "Non-standard errors," Economics Working Papers 1807, Department of Economics and Business, Universitat Pompeu Fabra.
      • Albert J. et al. Menkveld, 2021. "Non-Standard Errors," CESifo Working Paper Series 9453, CESifo.
      • Albert J Menkveld & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neusüss & Michael Razen & Utz Weitzel & Gunther Capelle-Blancard & David Abad-Dí, 2021. "Non-Standard Errors," Post-Print halshs-03500882, HAL.
      • Francesco Franzoni & Roxana Mihet & Markus Leippold & Per Ostberg & Olivier Scaillet & Norman Schürhoff & Oksana Bashchenko & Nicola Mano & Michele Pelli, 2022. "Non-Standard Errors," Swiss Finance Institute Research Paper Series 22-09, Swiss Finance Institute.
      • Albert J. Menkveld & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neusüss & Michael Razen & Utz Weitzel & Edwin Baidoo & Michael Frömmel & et al, 2021. "Non-Standard Errors," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 21/1032, Ghent University, Faculty of Economics and Business Administration.
      • Menkveld, Albert J. & Dreber, Anna & Holzmeister, Felix & Huber, Juergen & Johannesson, Magnus & Hasse, Jean-Baptiste & e.a.,, 2023. "Non-Standard Errors," LIDAM Reprints LFIN 2023002, Université catholique de Louvain, Louvain Finance (LFIN).
      • Moinas, Sophie & Declerck, Fany & Menkveld, Albert J. & Dreber, Anna, 2023. "Non-Standard Errors," TSE Working Papers 23-1451, Toulouse School of Economics (TSE).
      • Menkveld, Albert J. & Dreber, Anna & Holzmeister, Felix & Huber, Juergen & Johannesson, Magnus & Kirchler, Michael & Neusüß, Sebastian & Razen, Michael & Weitzel, Utz & Abad-Díaz, David & Abudy, Menac, 2024. "Nonstandard errors," LSE Research Online Documents on Economics 123002, London School of Economics and Political Science, LSE Library.
      • Menkveld, A. & Dreber, A. & Holzmeister, F. & Huber, J. & Johannesson, M. & Kirchler, M. & Neusüss, S. & Razen, M. & Neusüss, S. & Neusüss, S., 2021. "Non-Standard Errors," Cambridge Working Papers in Economics 2182, Faculty of Economics, University of Cambridge.
      • Menkveld, Albert J. & Dreber, Anna & Holzmeister, Felix & Huber, Jürgen & Johannesson, Magnus & Kirchler, Michael & Neusüss, Sebastian & Razen, Michael & Weitzel, Utz, 2021. "Non-standard errors," SAFE Working Paper Series 327, Leibniz Institute for Financial Research SAFE.
      • Albert J. Menkveld & Anna Dreber & Felix Holzmeister & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neusüss & Michael Razen & Utz Weitzel & David Abad-Dí­az & Menachem Abudy & Tobi, 2021. "Non-Standard Errors," Working Papers 2021-31, Faculty of Economics and Statistics, Universität Innsbruck.
      • Ferrara, Gerardo & Jurkatis, Simon, 2021. "Non-standard errors," Bank of England working papers 955, Bank of England.
      • Ciril Bosch-Rosa & Bernhard Kassner, 2023. "Non-Standard Errors," Rationality and Competition Discussion Paper Series 385, CRC TRR 190 Rationality and Competition.
      • Albert J Menkveld & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johannesson & Michael Kirchler & Sebastian Neusüss & Michael Razen & Utz Weitzel & Gunther Capelle-Blancard & David Abad-Dí, 2021. "Non-Standard Errors," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-03500882, HAL.
      • Menkveld, A. & Dreber, A. & Holzmeister, F. & Huber, J. & Johannesson, M. & Kirchler, M. & Neusüss, S. & Razen, M. & Neusüss, S. & Neusüss, S., 2021. "Non-Standard Errors," Janeway Institute Working Papers 2112, Faculty of Economics, University of Cambridge.
      • Wolff, Christian & Menkveld, Albert J. & Dreber, Anna & Holzmeister, Felix & Huber, Juergen & Johannesson, Magnus & Kirchler, Michael & Neusüess, Sebastian & Razen, Michael & Weitzel, Utz, 2021. "Non-Standard Errors," CEPR Discussion Papers 16751, C.E.P.R. Discussion Papers.
    6. Isaiah Andrews & Maximilian Kasy, 2019. "Identification of and Correction for Publication Bias," American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
    7. repec:grz:wpsses:2021-03 is not listed on IDEAS
    8. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    9. Bull, Charles & Courty, Pascal & Doyon, Maurice & Rondeau, Daniel, 2019. "Failure of the Becker–DeGroot–Marschak mechanism in inexperienced subjects: New tests of the game form misconception hypothesis," Journal of Economic Behavior & Organization, Elsevier, vol. 159(C), pages 235-253.
    10. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    11. Oliver Braganza, 2020. "A simple model suggesting economically rational sample-size choice drives irreproducibility," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-19, March.
    12. Adam Altmejd & Anna Dreber & Eskil Forsell & Juergen Huber & Taisuke Imai & Magnus Johannesson & Michael Kirchler & Gideon Nave & Colin Camerer, 2019. "Predicting the replicability of social science lab experiments," PLOS ONE, Public Library of Science, vol. 14(12), pages 1-18, December.
    13. Dohmen, Thomas & Quercia, Simone & Willrodt, Jana, 2023. "A note on salience of own preferences and the consensus effect," Journal of Economic Behavior & Organization, Elsevier, vol. 209(C), pages 15-21.
    14. Fanelli, Daniele, 2020. "Metascientific reproducibility patterns revealed by informatic measure of knowledge," MetaArXiv 5vnhj, Center for Open Science.
    15. Anna Dreber & Magnus Johannesson & Yifan Yang, 2024. "Selective reporting of placebo tests in top economics journals," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
    16. Williams, Cole Randall, 2019. "How redefining statistical significance can worsen the replication crisis," Economics Letters, Elsevier, vol. 181(C), pages 65-69.
    17. Huber, Christoph & Kirchler, Michael, 2023. "Experiments in finance: A survey of historical trends," Journal of Behavioral and Experimental Finance, Elsevier, vol. 37(C).
    18. Felipe González-Arango & Javier Corredor & María Angélica López-Ardila & María Camila Contreras-González & Juan Herrera-Santofimio & Jhonathan Jared González, 2022. "The duality of poverty: a replication of Mani et al. (2013) in Colombia," Theory and Decision, Springer, vol. 92(1), pages 39-73, February.
    19. Rebecca Hamilton & Debora Thompson & Sterling Bone & Lan Nguyen Chaplin & Vladas Griskevicius & Kelly Goldsmith & Ronald Hill & Deborah Roedder John & Chiraag Mittal & Thomas O’Guinn & Paul Piff & Car, 2019. "The effects of scarcity on consumer decision journeys," Journal of the Academy of Marketing Science, Springer, vol. 47(3), pages 532-550, May.
    20. Merl, Robert & Stöckl, Thomas & Palan, Stefan, 2023. "Insider trading regulation and shorting constraints. Evaluating the joint effects of two market interventions," Journal of Banking & Finance, Elsevier, vol. 154(C).
    21. Muradchanian, Jasmine & Hoekstra, Rink & Kiers, Henk & van Ravenzwaaij, Don, 2020. "How Best to Quantify Replication Success? A Simulation Study on the Comparison of Replication Success Metrics," MetaArXiv wvdjf, Center for Open Science.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joepsy:v:75:y:2019:i:pa:s016748701830309x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joep .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.