IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-04875787.html
   My bibliography  Save this paper

Falling and failing (to learn) : Evidence from a nation-wide cybersecurity field experiment with SMEs

Author

Listed:
  • David Gonzalez-Jimenez

    (Erasmus University Rotterdam)

  • Francesco Capozza

    (WZB - Wissenschaftszentrum Berlin für Sozialforschung)

  • Thomas Dirkmaat
  • Evelien van de Veer
  • Amber van Druten
  • Aurélien Baillon

    (EM - EMLyon Business School)

Abstract

Prior experiences are crucial in shaping risk prevention behavior. Previous studies have shown that experiencing a simulated phishing attack (a "phishing drill") reduces the likelihood of clicking on unsafe links and disclosing one's password. In a large field experiment involving 670 small and medium-sized enterprises (SMEs) and their 33,000 employees, we examined the impact of experience on individuals' ability to detect cyber-security threats, and whether this effect persisted over several months. We collected data at both the company and individual levels, including risk preference, time preference, and trust. Our findings indicate only a non-systematic, short-term effect of previous phishing emails on clicking behavior. A cluster of individuals with greater patience, trust, and risk seeking was more likely to click on phishing links in the first place but then also more likely to benefit from phishing drills.

Suggested Citation

  • David Gonzalez-Jimenez & Francesco Capozza & Thomas Dirkmaat & Evelien van de Veer & Amber van Druten & Aurélien Baillon, 2025. "Falling and failing (to learn) : Evidence from a nation-wide cybersecurity field experiment with SMEs," Post-Print hal-04875787, HAL.
  • Handle: RePEc:hal:journl:hal-04875787
    DOI: 10.1016/j.jebo.2024.106868
    Note: View the original document on HAL open archive server: https://hal.science/hal-04875787v1
    as

    Download full text from publisher

    File URL: https://hal.science/hal-04875787v1/document
    Download Restriction: no

    File URL: https://libkey.io/10.1016/j.jebo.2024.106868?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Schudy, Simeon & Utikal, Verena, 2017. "‘You must not know about me’—On the willingness to share personal data," Journal of Economic Behavior & Organization, Elsevier, vol. 141(C), pages 1-13.
    2. Soo Hong Chew & Wei Huang & Xiaojian Zhao, 2020. "Motivated False Memory," Journal of Political Economy, University of Chicago Press, vol. 128(10), pages 3913-3939.
    3. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    4. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    5. Daniel J. Benjamin & James O. Berger & Magnus Johannesson & Brian A. Nosek & E.-J. Wagenmakers & Richard Berk & Kenneth A. Bollen & Björn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Chr, 2018. "Redefine statistical significance," Nature Human Behaviour, Nature, vol. 2(1), pages 6-10, January.
      • Daniel Benjamin & James Berger & Magnus Johannesson & Brian Nosek & E. Wagenmakers & Richard Berk & Kenneth Bollen & Bjorn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Christopher Chambe, 2017. "Redefine Statistical Significance," Artefactual Field Experiments 00612, The Field Experiments Website.
    6. Tran, Anh & Zeckhauser, Richard, 2012. "Rank as an inherent incentive: Evidence from a field experiment," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 645-650.
    7. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    8. A. G. Winegar & C. R. Sunstein, 2019. "How Much Is Data Privacy Worth? A Preliminary Investigation," Journal of Consumer Policy, Springer, vol. 42(3), pages 425-440, September.
    9. Avdeenko, Alexandra & Bohne, Albrecht & Frölich, Markus, 2019. "Linking savings behavior, confidence and individual feedback: A field experiment in Ethiopia," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 122-151.
    10. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David B. Huffman & Uwe Sunde, 2017. "Global Evidence on Economic Preferences," NBER Working Papers 23943, National Bureau of Economic Research, Inc.
    11. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    12. Avi Goldfarb & Verina F. Que, 2023. "The Economics of Digital Privacy," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 267-286, September.
    13. Aurélien Baillon & Jeroen de Bruin & Aysil Emirmahmutoglu & Evelien van de Veer & Bram van Dijk, 2019. "Informing, simulating experience, or both : A field experiment on phishing risks," Post-Print hal-04325609, HAL.
    14. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.
    15. Alessandro Acquisti & Curtis Taylor & Liad Wagman, 2016. "The Economics of Privacy," Journal of Economic Literature, American Economic Association, vol. 54(2), pages 442-492, June.
    16. Shai, Ori, 2022. "Out of time? The effect of an infrequent traumatic event on individuals’ time and risk preferences, beliefs, and insurance purchasing," Journal of Health Economics, Elsevier, vol. 86(C).
    17. Romensen, Gert-Jan & Soetevent, Adriaan R., 2021. "Improving Worker Productivity Through Tailored Performance Feedback: Field Experimental Evidence from Bus Drivers," EconStor Preprints 246811, ZBW - Leibniz Information Centre for Economics.
    18. Aurélien Baillon & Jeroen de Bruin & Aysil Emirmahmutoglu & Evelien van de Veer & Bram van Dijk, 2019. "Informing, simulating experience, or both: A field experiment on phishing risks," PLOS ONE, Public Library of Science, vol. 14(12), pages 1-15, December.
    19. Cai, Jing & Song, Changcheng, 2017. "Do disaster experience and knowledge affect insurance take-up decisions?," Journal of Development Economics, Elsevier, vol. 124(C), pages 83-94.
    20. Goette, Lorenz & Tripodi, Egon, 2020. "Does positive feedback of social impact motivate prosocial behavior? A field experiment with blood donors," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 1-8.
    21. Ryan T. Wright & Matthew L. Jensen & Jason Bennett Thatcher & Michael Dinger & Kent Marett, 2014. "Research Note ---Influence Techniques in Phishing Attacks: An Examination of Vulnerability and Resistance," Information Systems Research, INFORMS, vol. 25(2), pages 385-400, June.
    22. Tyler Moore & Richard Clayton & Ross Anderson, 2009. "The Economics of Online Crime," Journal of Economic Perspectives, American Economic Association, vol. 23(3), pages 3-20, Summer.
    23. Alessandro Acquisti & Leslie K. John & George Loewenstein, 2013. "What Is Privacy Worth?," The Journal of Legal Studies, University of Chicago Press, vol. 42(2), pages 249-274.
    24. Biener, Christian & Eling, Martin & Lehmann, Martin, 2020. "Balancing the desire for privacy against the desire to hedge risk," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 608-620.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kalwij, Adriaan, 2023. "Risk preferences, preventive behaviour, and the probability of a loss: Empirical evidence from the COVID-19 pandemic," Social Science & Medicine, Elsevier, vol. 334(C).
    2. Finley, Brian & Kalwij, Adriaan & Kapteyn, Arie, 2022. "Born to be wild: Second-to-fourth digit length ratio and risk preferences," Economics & Human Biology, Elsevier, vol. 47(C).
    3. Cloos, Janis & Mohr, Svenja, 2022. "Acceptance of data sharing in smartphone apps from key industries of the digital transformation: A representative population survey for Germany," Technological Forecasting and Social Change, Elsevier, vol. 176(C).
    4. Bašić, Zvonimir & Bortolotti, Stefania & Salicath, Daniel & Schmidt, Stefan & Schneider, Sebastian O. & Sutter, Matthias, 2024. "One Size Fits All? The Interplay of Incentives, Effort Provision, and Personality," IZA Discussion Papers 17287, Institute of Labor Economics (IZA).
    5. Bauer, Michal & Chytilová, Julie & Miguel, Edward, 2020. "Using survey questions to measure preferences: Lessons from an experimental validation in Kenya," European Economic Review, Elsevier, vol. 127(C).
    6. Arslan, Ruben C. & Brümmer, Martin & Dohmen, Thomas & Drewelies, Johanna & Hertwig, Ralph & Wagner, Gert G., 2020. "How people know their risk preference," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 10.
    7. Philipp Doerrenberg & Andreas Peichl, 2022. "Tax Morale and the Role of Social Norms and Reciprocity - Evidence from a Randomized Survey Experiment," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 78(1-2), pages 44-86.
    8. Müller, Stephan & Rau, Holger A., 2020. "Economic preferences and compliance in the social stress test of the Corona crisis," University of Göttingen Working Papers in Economics 391, University of Goettingen, Department of Economics.
    9. Bellemare, Charles & Sebald, Alexander & Suetens, Sigrid, 2019. "Guilt aversion in economics and psychology," Journal of Economic Psychology, Elsevier, vol. 73(C), pages 52-59.
    10. Felix Holzmeister & Martin Holmén & Michael Kirchler & Matthias Stefan & Erik Wengström, 2023. "Delegation Decisions in Finance," Management Science, INFORMS, vol. 69(8), pages 4828-4844, August.
    11. Preuss, Malte, 2021. "Intra-individual stability of two survey measures on forward-looking attitude," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 201-227.
    12. Schunk, Daniel & Wagner, Valentin, 2021. "What determines the willingness to sanction violations of newly introduced social norms: Personality traits or economic preferences? evidence from the COVID-19 crisis," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 93(C).
    13. Dahmann, Sarah C. & Kettlewell, Nathan & Lam, Jack, 2022. "Parental Separation and the Formation of Economic Preferences," IZA Discussion Papers 14993, Institute of Labor Economics (IZA).
    14. König, Adriana N. & Laxy, Michael & Peters, Annette & Schneider, Alexandra & Wolf, Kathrin & Schwettmann, Lars & Wiesen, Daniel, 2024. "What is the relationship between risk attitudes and ambient temperature? Evidence from a large population-based cohort study," Economics & Human Biology, Elsevier, vol. 55(C).
    15. Joshua Tasoff & Wenjie Zhang, 2022. "The Performance of Time-Preference and Risk-Preference Measures in Surveys," Management Science, INFORMS, vol. 68(2), pages 1149-1173, February.
    16. Fallucchi, Francesco & Nosenzo, Daniele & Reuben, Ernesto, 2020. "Measuring preferences for competition with experimentally-validated survey questions," Journal of Economic Behavior & Organization, Elsevier, vol. 178(C), pages 402-423.
    17. Groh, Elke D. & Ziegler, Andreas, 2020. "On the relevance of economic preferences, values, norms, and socio-demographics for electricity consumption," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224587, Verein für Socialpolitik / German Economic Association.
    18. Katharina Werner, 2019. "The Role of Information for Public Preferences on Education – Evidence from Representative Survey Experiments," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 82, March.
    19. Castillo, Jose Gabriel & Hernandez, Manuel A., 2023. "The unintended consequences of confinement: Evidence from the rural area in Guatemala," Journal of Economic Psychology, Elsevier, vol. 95(C).
    20. Habla, Wolfgang & Kokash, Kumai & Löfgren, Åsa & Straubinger, Anna & Ziegler, Andreas, 2024. "Self-interest and support of climate-related transport policy measures: An empirical analysis for citizens in Germany and Sweden," ZEW Discussion Papers 24-028, ZEW - Leibniz Centre for European Economic Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-04875787. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.