IDEAS home Printed from https://ideas.repec.org/a/bla/joares/v58y2020i1p237-291.html
   My bibliography  Save this article

What Are You Saying? Using topic to Detect Financial Misreporting

Author

Listed:
  • NERISSA C. BROWN
  • RICHARD M. CROWLEY
  • W. BROOKE ELLIOTT

Abstract

We use a machine learning technique to assess whether the thematic content of financial statement disclosures (labeled topic) is incrementally informative in predicting intentional misreporting. Using a Bayesian topic modeling algorithm, we determine and empirically quantify the topic content of a large collection of 10‐K narratives spanning 1994 to 2012. We find that the algorithm produces a valid set of semantically meaningful topics that predict financial misreporting, based on samples of Securities and Exchange Commission (SEC) enforcement actions (Accounting and Auditing Enforcement Releases [AAERs]) and irregularities identified from financial restatements and 10‐K filing amendments. Our out‐of‐sample tests indicate that topic significantly improves the detection of financial misreporting by as much as 59% when added to models based on commonly used financial and textual style variables. Furthermore, models that incorporate topic significantly outperform traditional models when detecting serious revenue recognition and core expense errors. Taken together, our results suggest that the topics discussed in annual report filings and the attention devoted to each topic are useful signals in detecting financial misreporting.

Suggested Citation

  • Nerissa C. Brown & Richard M. Crowley & W. Brooke Elliott, 2020. "What Are You Saying? Using topic to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 237-291, March.
    • Handle: RePEc:bla:joares:v:58:y:2020:i:1:p:237-291
    DOI: 10.1111/1475-679X.12294
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1475-679X.12294
    Download Restriction: no
    File URL: https://libkey.io/10.1111/1475-679X.12294?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David F. Larcker & Anastasia A. Zakolyukina, 2012. "Detecting Deceptive Discussions in Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 495-540, May.
    2. Yang Bao & Bin Ke & Bin Li & Y. Julia Yu & Jie Zhang, 2020. "Detecting Accounting Fraud in Publicly Traded U.S. Firms Using a Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 199-235, March.
    3. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    4. Palmrose, Zoe-Vonna & Richardson, Vernon J. & Scholz, Susan, 2004. "Determinants of market reactions to restatement announcements," Journal of Accounting and Economics, Elsevier, vol. 37(1), pages 59-89, February.
    5. Joseph F. Brazel & Keith L. Jones & Mark F. Zimbelman, 2009. "Using Nonfinancial Measures to Assess Fraud Risk," Journal of Accounting Research, Wiley Blackwell, vol. 47(5), pages 1135-1166, December.
    6. Lynnette Purda & David Skillicorn, 2015. "Accounting Variables, Deception, and a Bag of Words: Assessing the Tools of Fraud Detection," Contemporary Accounting Research, John Wiley & Sons, vol. 32(3), pages 1193-1223, September.
    7. Files, Rebecca, 2012. "SEC enforcement: Does forthright disclosure and cooperation really matter?," Journal of Accounting and Economics, Elsevier, vol. 53(1), pages 353-374.
    8. Jessen L. Hobson & William J. Mayew & Mohan Venkatachalam, 2012. "Analyzing Speech to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 349-392, May.
    9. Hoberg, Gerard & Lewis, Craig, 2017. "Do fraudulent firms produce abnormal disclosure?," Journal of Corporate Finance, Elsevier, vol. 43(C), pages 58-85.
    10. Bloomfield, Robert, 2008. "Discussion of "Annual report readability, current earnings, and earnings persistence"," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 248-252, August.
    11. Beneish, Messod D., 1997. "Detecting GAAP violation: implications for assessing earnings management among firms with extreme financial performance," Journal of Accounting and Public Policy, Elsevier, vol. 16(3), pages 271-309.
    12. Kristina Rennekamp, 2012. "Processing Fluency and Investors’ Reactions to Disclosure Readability," Journal of Accounting Research, Wiley Blackwell, vol. 50(5), pages 1319-1354, December.
    13. Dyer, Travis & Lang, Mark & Stice-Lawrence, Lorien, 2017. "The evolution of 10-K textual disclosure: Evidence from Latent Dirichlet Allocation," Journal of Accounting and Economics, Elsevier, vol. 64(2), pages 221-245.
    14. Patricia M. Dechow & Richard G. Sloan & Amy P. Sweeney, 1996. "Causes and Consequences of Earnings Manipulation: An Analysis of Firms Subject to Enforcement Actions by the SEC," Contemporary Accounting Research, John Wiley & Sons, vol. 13(1), pages 1-36, March.
    15. Brian J. Bushee & Ian D. Gow & Daniel J. Taylor, 2018. "Linguistic Complexity in Firm Disclosures: Obfuscation or Information?," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 85-121, March.
    16. Feroz, Eh & Park, K & Pastena, Vs, 1991. "The Financial And Market Effects Of The Secs Accounting And Auditing Enforcement Releases," Journal of Accounting Research, Wiley Blackwell, vol. 29, pages 107-142.
    17. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    18. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    19. Guay, Wayne & Samuels, Delphine & Taylor, Daniel, 2016. "Guiding through the Fog: Financial statement complexity and voluntary disclosure," Journal of Accounting and Economics, Elsevier, vol. 62(2), pages 234-269.
    20. Doyle, Jeffrey & Ge, Weili & McVay, Sarah, 2007. "Determinants of weaknesses in internal control over financial reporting," Journal of Accounting and Economics, Elsevier, vol. 44(1-2), pages 193-223, September.
    21. Yang Bao & Anindya Datta, 2014. "Simultaneously Discovering and Quantifying Risk Types from Textual Risk Disclosures," Management Science, INFORMS, vol. 60(6), pages 1371-1391, June.
    22. Allen H. Huang & Reuven Lehavy & Amy Y. Zang & Rong Zheng, 2018. "Analyst Information Discovery and Interpretation Roles: A Topic Modeling Approach," Management Science, INFORMS, vol. 64(6), pages 2833-2855, June.
    23. Bozanic, Zahn & Roulstone, Darren T. & Van Buskirk, Andrew, 2018. "Management earnings forecasts and other forward-looking statements," Journal of Accounting and Economics, Elsevier, vol. 65(1), pages 1-20.
    24. Andrew C. Call & Gerald S. Martin & Nathan Y. Sharp & Jaron H. Wilde, 2018. "Whistleblowers and Outcomes of Financial Misrepresentation Enforcement Actions," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 123-171, March.
    25. Kevin M. Quinn & Burt L. Monroe & Michael Colaresi & Michael H. Crespin & Dragomir R. Radev, 2010. "How to Analyze Political Attention with Minimal Assumptions and Costs," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 209-228, January.
    26. Anastasia A. Zakolyukina, 2018. "How Common Are Intentional GAAP Violations? Estimates from a Dynamic Model," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 5-44, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James P. Ryans, 2021. "Textual classification of SEC comment letters," Review of Accounting Studies, Springer, vol. 26(1), pages 37-80, March.
    2. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    3. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    4. Senave, Elseline & Jans, Mieke J. & Srivastava, Rajendra P., 2023. "The application of text mining in accounting," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    5. Berkin, Anil & Aerts, Walter & Van Caneghem, Tom, 2023. "Feasibility analysis of machine learning for performance-related attributional statements," International Journal of Accounting Information Systems, Elsevier, vol. 48(C).
    6. Dan Amiram & Zahn Bozanic & James D. Cox & Quentin Dupont & Jonathan M. Karpoff & Richard Sloan, 2018. "Financial reporting fraud and other forms of misconduct: a multidisciplinary review of the literature," Review of Accounting Studies, Springer, vol. 23(2), pages 732-783, June.
    7. Laure Batz, 2023. "Financial market enforcement in France," European Journal of Law and Economics, Springer, vol. 55(3), pages 409-468, June.
    8. Jin, Zuben, 2024. "Business aspects in focus, investor underreaction and return predictability," Journal of Corporate Finance, Elsevier, vol. 84(C).
    9. Peter M. Clarkson & Jordan Ponn & Gordon D. Richardson & Frank Rudzicz & Albert Tsang & Jingjing Wang, 2020. "A Textual Analysis of US Corporate Social Responsibility Reports," Abacus, Accounting Foundation, University of Sydney, vol. 56(1), pages 3-34, March.
    10. Bhattacharya, Indranil & Mickovic, Ana, 2024. "Accounting fraud detection using contextual language learning," International Journal of Accounting Information Systems, Elsevier, vol. 53(C).
    11. Umar, Tarik, 2022. "Complexity aversion when SeekingAlpha," Journal of Accounting and Economics, Elsevier, vol. 73(2).
    12. Zvi Singer & Jing Zhang, 2022. "Do companies try to conceal financial misstatements through auditor shopping?," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 49(1-2), pages 140-180, January.
    13. Chychyla, Roman & Leone, Andrew J. & Minutti-Meza, Miguel, 2019. "Complexity of financial reporting standards and accounting expertise," Journal of Accounting and Economics, Elsevier, vol. 67(1), pages 226-253.
    14. Gao, Lei & Calderon, Thomas G. & Tang, Fengchun, 2020. "Public companies' cybersecurity risk disclosures," International Journal of Accounting Information Systems, Elsevier, vol. 38(C).
    15. Pastwa, Anna M. & Shrestha, Prabal & Thewissen, James & Torsin, Wouter, 2021. "Unpacking the black box of ICO white papers: a topic modeling approach," LIDAM Discussion Papers LFIN 2021018, Université catholique de Louvain, Louvain Finance (LFIN).
    16. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    17. Hills, Robert & Kubic, Matthew & Mayew, William J., 2021. "State sponsors of terrorism disclosure and SEC financial reporting oversight," Journal of Accounting and Economics, Elsevier, vol. 72(1).
    18. Thewissen, James & Shrestha, Prabal & Torsin, Wouter & Pastwa, Anna M., 2022. "Unpacking the black box of ICO white papers: A topic modeling approach," Journal of Corporate Finance, Elsevier, vol. 75(C).
    19. Chantziaras, Antonios & Koulikidou, Kleopatra & Leventis, Stergios, 2021. "The power of words in capital markets: SEC comment letters on foreign issuers and the impact of home country enforcement," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 42(C).
    20. Abdullah Albizri & Deniz Appelbaum & Nicholas Rizzotto, 2019. "Evaluation of financial statements fraud detection research: a multi-disciplinary analysis," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 16(4), pages 206-241, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:joares:v:58:y:2020:i:1:p:237-291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0021-8456 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.