IDEAS home Printed from https://ideas.repec.org/a/wly/isacfm/v27y2020i2p95-107.html
   My bibliography  Save this article

Predicting credit card fraud with Sarbanes‐Oxley assessments and Fama‐French risk factors

Author

Listed:
  • James Christopher Westland

Abstract

This research developed and tested machine learning models to predict significant credit card fraud in corporate systems using Sarbanes‐Oxley (SOX) reports, news reports of breaches and Fama‐French risk factors (FF). Exploratory analysis found that SOX information predicted several types of security breaches, with the strongest performance in predicting credit card fraud. A systematic tuning of hyperparamters for a suite of machine learning models, starting with a random forest, an extremely‐randomized forest, a random grid of gradient boosting machines (GBMs), a random grid of deep neural nets, a fixed grid of general linear models where assembled into two trained stacked ensemble models optimized for F1 performance; an ensemble that contained all the models, and an ensemble containing just the best performing model from each algorithm class. Tuned GBMs performed best under all conditions. Without FF, models yielded an AUC of 99.3% and closeness of the training and validation matrices confirm that the model is robust. The most important predictors were firm specific, as would be expected, since control weaknesses vary at the firm level. Audit firm fees were the most important non‐firm‐specific predictors. Adding FF to the model rendered perfect prediction (100%) in the trained confusion matrix and AUC of 99.8%. The most important predictors of credit card fraud were the FF coefficient for the High book‐to‐market ratio Minus Low factor. The second most influential variable was the year of reporting, and third most important was the Fama‐French 3‐factor model R2 – together these described most of the variance in credit card fraud occurrence. In all cases the four major SOX specific opinions rendered by auditors and the signed SOX report had little predictive influence.

Suggested Citation

  • James Christopher Westland, 2020. "Predicting credit card fraud with Sarbanes‐Oxley assessments and Fama‐French risk factors," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 27(2), pages 95-107, April.
  • Handle: RePEc:wly:isacfm:v:27:y:2020:i:2:p:95-107
    DOI: 10.1002/isaf.1472
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/isaf.1472
    Download Restriction: no

    File URL: https://libkey.io/10.1002/isaf.1472?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Feng, Mei & Li, Chan & McVay, Sarah, 2009. "Internal control and management guidance," Journal of Accounting and Economics, Elsevier, vol. 48(2-3), pages 190-209, December.
    2. Ralitsa Petkova, 2006. "Do the Fama–French Factors Proxy for Innovations in Predictive Variables?," Journal of Finance, American Finance Association, vol. 61(2), pages 581-612, April.
    3. John C. Coates IV, 2007. "The Goals and Promise of the Sarbanes-Oxley Act," Journal of Economic Perspectives, American Economic Association, vol. 21(1), pages 91-116, Winter.
    4. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    5. Sarah C. Rice & David P. Weber, 2012. "How Effective Is Internal Control Reporting under SOX 404? Determinants of the (Non‐)Disclosure of Existing Material Weaknesses," Journal of Accounting Research, Wiley Blackwell, vol. 50(3), pages 811-843, June.
    6. Kang, Qiang & Liu, Qiao & Qi, Rong, 2010. "The Sarbanes-Oxley act and corporate investment: A structural assessment," Journal of Financial Economics, Elsevier, vol. 96(2), pages 291-305, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. Christopher Westland, 2022. "Assessing Privacy and Security of Information Systems from Audit Data," Information Systems Frontiers, Springer, vol. 24(5), pages 1417-1434, October.
    2. J. Christopher Westland, 2018. "The Information Content of Sarbanes-Oxley in Predicting Security Breaches," Papers 1802.10001, arXiv.org.
    3. Andrade, Sandro C. & Bernile, Gennaro & Hood, Frederick M., 2014. "SOX, corporate transparency, and the cost of debt," Journal of Banking & Finance, Elsevier, vol. 38(C), pages 145-165.
    4. Ge, Weili & Koester, Allison & McVay, Sarah, 2017. "Benefits and costs of Sarbanes-Oxley Section 404(b) exemption: Evidence from small firms’ internal control disclosures," Journal of Accounting and Economics, Elsevier, vol. 63(2), pages 358-384.
    5. DeFond, Mark & Zhang, Jieying, 2014. "A review of archival auditing research," Journal of Accounting and Economics, Elsevier, vol. 58(2), pages 275-326.
    6. Giovanni Calice & Levent Kutlu & Ming Zeng, 2021. "Understanding US firm efficiency and its asset pricing implications," Empirical Economics, Springer, vol. 60(2), pages 803-827, February.
    7. Susana Iglesias Antelo & Jean-Pierre Levy Mangin, 2010. "An analysis of the risk-return relationship in the Spanish capital market using a structural equation model," Applied Economics Letters, Taylor & Francis Journals, vol. 17(14), pages 1397-1403.
    8. Dimitrios D. Thomakos & Michail S. Koubouros, 2011. "The Role of Realised Volatility in the Athens Stock Exchange," Multinational Finance Journal, Multinational Finance Journal, vol. 15(1-2), pages 87-124, March - J.
    9. Tim Brailsford & Clive Gaunt & Michael A O’Brien, 2012. "Size and book-to-market factors in Australia," Australian Journal of Management, Australian School of Business, vol. 37(2), pages 261-281, August.
    10. Gomez Biscarri, Javier & Lopez Espinosa, German, 2008. "The influence of differences in accounting standards on empirical pricing models: An application to the Fama-French model," Journal of Multinational Financial Management, Elsevier, vol. 18(4), pages 369-388, October.
    11. Joanna Olbryś, 2010. "Three-factor market-timing models with Fama and French’s spread variables," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 20(2), pages 91-106.
    12. Semenov, Andrei, 2021. "Measuring the stock's factor beta and identifying risk factors under market inefficiency," The Quarterly Review of Economics and Finance, Elsevier, vol. 80(C), pages 635-649.
    13. Alexandros Kontonikas & Alexandros Kostakis, 2013. "On Monetary Policy and Stock Market Anomalies," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 40(7-8), pages 1009-1042, September.
    14. Yu Wang & Haicheng Shu, 2019. "Evaluating the Performance of Factor Pricing Models for Different Stock Market Trends: Evidence from China," Working Papers 2019-10-10, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    15. Wunhong Su & Liuzhen Zhang & Chao Ge & Shuai Chen, 2022. "Association between Internal Control and Sustainability: A Literature Review Based on the SOX Act Framework," Sustainability, MDPI, vol. 14(15), pages 1-30, August.
    16. Yacine Hammami, 2014. "An empirical investigation of asset pricing models under divergent lending and borrowing rates," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 28(3), pages 263-279, August.
    17. Lindaas, Knut F. & Simlai, Prodosh, 2014. "The value premium, aggregate risk innovations, and average stock returns," Finance Research Letters, Elsevier, vol. 11(3), pages 303-317.
    18. Sabine Artmann & Philipp Finter & Alexander Kempf & Stefan Koch & Erik Theissen, 2012. "The Cross-Section of German Stock Returns: New Data and New Evidence," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 64(1), pages 20-43, January.
    19. Cho, Sungjun, 2013. "New return anomalies and new-Keynesian ICAPM," International Review of Financial Analysis, Elsevier, vol. 29(C), pages 87-106.
    20. Elsayed, Mohamed & Elshandidy, Tamer, 2021. "Internal control effectiveness, textual risk disclosure, and their usefulness: U.S. evidence," Advances in accounting, Elsevier, vol. 53(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:isacfm:v:27:y:2020:i:2:p:95-107. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/1099-1174/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.