IDEAS home Printed from https://ideas.repec.org/a/spr/reaccs/v26y2021i1d10.1007_s11142-020-09565-6.html
   My bibliography  Save this article

Textual classification of SEC comment letters

Author

Listed:
  • James P. Ryans

    (London Business School)

Abstract

This study examines the impact of SEC comment letters on future financial reporting outcomes and earnings credibility. Naïve Bayesian classification identifies comment letters associated with future restatements and write-downs. An investor attention-based quantitative measure of importance, using EDGAR downloads, also predicts these outcomes. Disclosure-event abnormal returns, revenue recognition comments, and the number of letters in a conversation appear to be useful quantitative metrics for classifying importance in certain settings. This study also documents trends in comment letter topics over time and identifies topics associated with the textual and quantitative classifications of importance, providing insights into the factors that draw investor attention and that relate to future restatements and write-downs. Innocuous comment letters are associated with improvements in earnings credibility following comment letter reviews.

Suggested Citation

  • James P. Ryans, 2021. "Textual classification of SEC comment letters," Review of Accounting Studies, Springer, vol. 26(1), pages 37-80, March.
    • Handle: RePEc:spr:reaccs:v:26:y:2021:i:1:d:10.1007_s11142-020-09565-6
    DOI: 10.1007/s11142-020-09565-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11142-020-09565-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11142-020-09565-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David F. Larcker & Anastasia A. Zakolyukina, 2012. "Detecting Deceptive Discussions in Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 495-540, May.
    2. Dyer, Travis & Lang, Mark & Stice-Lawrence, Lorien, 2017. "The evolution of 10-K textual disclosure: Evidence from Latent Dirichlet Allocation," Journal of Accounting and Economics, Elsevier, vol. 64(2), pages 221-245.
    3. Angela K. Davis & Jeremy M. Piger & Lisa M. Sedor, 2012. "Beyond the Numbers: Measuring the Information Content of Earnings Press Release Language," Contemporary Accounting Research, John Wiley & Sons, vol. 29(3), pages 845-868, September.
    4. Hirshleifer, David & Teoh, Siew Hong, 2003. "Limited attention, information disclosure, and financial reporting," Journal of Accounting and Economics, Elsevier, vol. 36(1-3), pages 337-386, December.
    5. Alexander Dyck & Adair Morse & Luigi Zingales, 2010. "Who Blows the Whistle on Corporate Fraud?," Journal of Finance, American Finance Association, vol. 65(6), pages 2213-2253, December.
    6. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    7. Rafael La Porta & Florencio Lopez‐De‐Silanes & Andrei Shleifer, 2006. "What Works in Securities Laws?," Journal of Finance, American Finance Association, vol. 61(1), pages 1-32, February.
    8. Holthausen, Rw & Verrecchia, Re, 1988. "The Effect Of Sequential Information Releases On The Variance Of Price Changes In An Intertemporal Multi-Asset Market," Journal of Accounting Research, Wiley Blackwell, vol. 26(1), pages 82-106.
    9. Miguel Duro & Jonas Heese & Gaizka Ormazabal, 2019. "The effect of enforcement transparency: Evidence from SEC comment-letter reviews," Review of Accounting Studies, Springer, vol. 24(3), pages 780-823, September.
    10. Dye, Ra, 1985. "Disclosure Of Nonproprietary Information," Journal of Accounting Research, Wiley Blackwell, vol. 23(1), pages 123-145.
    11. Alexander Ljungqvist & Wenlan Qian, 2016. "How Constraining Are Limits to Arbitrage?," The Review of Financial Studies, Society for Financial Studies, vol. 29(8), pages 1975-2028.
    12. Ball, R & Brown, P, 1968. "Empirical Evaluation Of Accounting Income Numbers," Journal of Accounting Research, Wiley Blackwell, vol. 6(2), pages 159-178.
    13. Christensen, Hans B. & Hail, Luzi & Leuz, Christian, 2013. "Mandatory IFRS reporting and changes in enforcement," Journal of Accounting and Economics, Elsevier, vol. 56(2), pages 147-177.
    14. Patricia M. Dechow & Weili Ge & Chad R. Larson & Richard G. Sloan, 2011. "Predicting Material Accounting Misstatements," Contemporary Accounting Research, John Wiley & Sons, vol. 28(1), pages 17-82, March.
    15. Kinney, William Jr. & McDaniel, Linda S., 1989. "Characteristics of firms correcting previously reported quarterly earnings," Journal of Accounting and Economics, Elsevier, vol. 11(1), pages 71-93, February.
    16. Collins, Daniel W. & Kothari, S. P., 1989. "An analysis of intertemporal and cross-sectional determinants of earnings response coefficients," Journal of Accounting and Economics, Elsevier, vol. 11(2-3), pages 143-181, July.
    17. Kelvin K. F. Law & Lillian F. Mills, 2015. "Taxes and Financial Constraints: Evidence from Linguistic Cues," Journal of Accounting Research, Wiley Blackwell, vol. 53(4), pages 777-819, September.
    18. S. P. Kothari & Susan Shu & Peter D. Wysocki, 2009. "Do Managers Withhold Bad News?," Journal of Accounting Research, Wiley Blackwell, vol. 47(1), pages 241-276, March.
    19. Christian Leuz & Peter D. Wysocki, 2016. "The Economics of Disclosure and Financial Reporting Regulation: Evidence and Suggestions for Future Research," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 525-622, May.
    20. Feng Li, 2010. "The Information Content of Forward‐Looking Statements in Corporate Filings—A Naïve Bayesian Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 48(5), pages 1049-1102, December.
    21. Rick Johnston & Reining Petacchi, 2017. "Regulatory Oversight of Financial Reporting: Securities and Exchange Commission Comment Letters," Contemporary Accounting Research, John Wiley & Sons, vol. 34(2), pages 1128-1155, June.
    22. Kevin M. Quinn & Burt L. Monroe & Michael Colaresi & Michael H. Crespin & Dragomir R. Radev, 2010. "How to Analyze Political Attention with Minimal Assumptions and Costs," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 209-228, January.
    23. Francis, Jennifer & LaFond, Ryan & Olsson, Per & Schipper, Katherine, 2005. "The market pricing of accruals quality," Journal of Accounting and Economics, Elsevier, vol. 39(2), pages 295-327, June.
    24. Beaver, Wh, 1968. "Information Content Of Annual Earnings Announcements," Journal of Accounting Research, Wiley Blackwell, vol. 6, pages 67-92.
    25. Bartov, Eli & Givoly, Dan & Hayn, Carla, 2002. "The rewards to meeting or beating earnings expectations," Journal of Accounting and Economics, Elsevier, vol. 33(2), pages 173-204, June.
    26. Jennifer Francis & Dhananjay Nanda & Per Olsson, 2008. "Voluntary Disclosure, Earnings Quality, and Cost of Capital," Journal of Accounting Research, Wiley Blackwell, vol. 46(1), pages 53-99, March.
    27. Jung, Wo & Kwon, Yk, 1988. "Disclosure When The Market Is Unsure Of Information Endowment Of Managers," Journal of Accounting Research, Wiley Blackwell, vol. 26(1), pages 146-153.
    28. Tim Loughran & Bill McDonald, 2017. "The Use of EDGAR Filings by Investors," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 18(2), pages 231-248, April.
    29. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    30. Stephen V. Brown & Xiaoli (Shaolee) Tian & Jennifer Wu Tucker, 2018. "The Spillover Effect of SEC Comment Letters on Qualitative Corporate Disclosure: Evidence from the Risk Factor Disclosure," Contemporary Accounting Research, John Wiley & Sons, vol. 35(2), pages 622-656, June.
    31. Jones Heese & Mozaffar Khan & Karthik Ramanna, 2017. "Is the SEC Captured? Evidence from Comment-Letter Reviews," Harvard Business School Working Papers 17-087, Harvard Business School.
    32. Feroz, Eh & Park, K & Pastena, Vs, 1991. "The Financial And Market Effects Of The Secs Accounting And Auditing Enforcement Releases," Journal of Accounting Research, Wiley Blackwell, vol. 29, pages 107-142.
    33. Joshua Livnat & Richard R. Mendenhall, 2006. "Comparing the Post–Earnings Announcement Drift for Surprises Calculated from Analyst and Time Series Forecasts," Journal of Accounting Research, Wiley Blackwell, vol. 44(1), pages 177-205, March.
    34. Yang Bao & Anindya Datta, 2014. "Simultaneously Discovering and Quantifying Risk Types from Textual Risk Disclosures," Management Science, INFORMS, vol. 60(6), pages 1371-1391, June.
    35. Joseph E. Engelberg & Christopher A. Parsons, 2011. "The Causal Impact of Media in Financial Markets," Journal of Finance, American Finance Association, vol. 66(1), pages 67-97, February.
    36. Kormendi, Roger & Lipe, Robert, 1987. "Earnings Innovations, Earnings Persistence, and Stock Returns," The Journal of Business, University of Chicago Press, vol. 60(3), pages 323-345, July.
    37. Michael S. Drake & Darren T. Roulstone & Jacob R. Thornock, 2015. "The Determinants and Consequences of Information Acquisition via EDGAR," Contemporary Accounting Research, John Wiley & Sons, vol. 32(3), pages 1128-1161, September.
    38. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    39. Palmrose, Zoe-Vonna & Richardson, Vernon J. & Scholz, Susan, 2004. "Determinants of market reactions to restatement announcements," Journal of Accounting and Economics, Elsevier, vol. 37(1), pages 59-89, February.
    40. Hoberg, Gerard & Lewis, Craig, 2017. "Do fraudulent firms produce abnormal disclosure?," Journal of Corporate Finance, Elsevier, vol. 43(C), pages 58-85.
    41. Lawrence, Alastair & Sloan, Richard & Sun, Yuan, 2013. "Non-discretionary conservatism: Evidence and implications," Journal of Accounting and Economics, Elsevier, vol. 56(2), pages 112-133.
    42. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    43. repec:bla:jfinan:v:59:y:2004:i:3:p:1259-1294 is not listed on IDEAS
    44. Heese, Jonas & Khan, Mozaffar & Ramanna, Karthik, 2017. "Is the SEC captured? Evidence from comment-letter reviews," Journal of Accounting and Economics, Elsevier, vol. 64(1), pages 98-122.
    45. Lang, M & Lundholm, R, 1993. "Cross-Sectional Determinants Of Analyst Ratings Of Corporate Disclosures," Journal of Accounting Research, Wiley Blackwell, vol. 31(2), pages 246-271.
    46. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    47. Allen H. Huang & Reuven Lehavy & Amy Y. Zang & Rong Zheng, 2018. "Analyst Information Discovery and Interpretation Roles: A Topic Modeling Approach," Management Science, INFORMS, vol. 64(6), pages 2833-2855, June.
    48. Eric Talley & Drew O'Kane, 2012. "The Measure of a MAC: A Machine-Learning Protocol for Analyzing Force Majeure Clauses in M&A Agreements," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 168(1), pages 181-201, March.
    49. William R. Kinney & Zoe‐Vonna Palmrose & Susan Scholz, 2004. "Auditor Independence, Non‐Audit Services, and Restatements: Was the U.S. Government Right?," Journal of Accounting Research, Wiley Blackwell, vol. 42(3), pages 561-588, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Koulikidou, Kleopatra & Chantziaras, Antonios & Dedoulis, Emmanouil & Leventis, Stergios, 2023. "Regulatory enforcement, foreignness, and language negativity: Evidence from SEC comment letters," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 51(C).
    2. Zhang, Junsheng & Peng, Zezhi & Zeng, Yamin & Yang, Haisheng, 2024. "Spot check on corporate disclosure quality: Insights from policy learning," Pacific-Basin Finance Journal, Elsevier, vol. 86(C).
    3. Marshall A. Geiger & Bret Johnson & Keith L. Jones & Abdullah Kumas, 2022. "Information Leakage Around SEC Comment Letters," Management Science, INFORMS, vol. 68(11), pages 8449-8463, November.
    4. Bret A. Johnson & Ling Lei Lisic & Joon Seok Moon & Mengmeng Wang, 2023. "SEC comment letters on form S-4 and M&A accounting quality," Review of Accounting Studies, Springer, vol. 28(2), pages 862-909, June.
    5. Yewei Wu & Bofu Zhang, 2023. "Inquiry Letters and Tax Aggressiveness," China & World Economy, Institute of World Economics and Politics, Chinese Academy of Social Sciences, vol. 31(4), pages 37-65, July.
    6. Hou, Chenxue & Wang, Qijian, 2023. "CSRC oral communication and corporate disclosure," Journal of Corporate Finance, Elsevier, vol. 79(C).
    7. Li, Ken, 2022. "Textual fundamentals in earnings press releases," Advances in accounting, Elsevier, vol. 57(C).
    8. Xunan Feng & Dengxi Wei, 2024. "Political ranking in hierarchy and receipt of a comment letter: Evidence from China," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 64(1), pages 277-307, March.
    9. Lu, Jing & Qiu, Yuhang, 2023. "Does non-punitive regulation diminish stock price crash risk?," Journal of Banking & Finance, Elsevier, vol. 148(C).
    10. Han, Mengrui & Ying, Qianwei & Huang, Li, 2023. "Firms’ delayed replies and investor confidence: Evidence from M&A comment letters in China," Finance Research Letters, Elsevier, vol. 56(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    2. Dechow, Patricia & Ge, Weili & Schrand, Catherine, 2010. "Understanding earnings quality: A review of the proxies, their determinants and their consequences," Journal of Accounting and Economics, Elsevier, vol. 50(2-3), pages 344-401, December.
    3. Chantziaras, Antonios & Koulikidou, Kleopatra & Leventis, Stergios, 2021. "The power of words in capital markets: SEC comment letters on foreign issuers and the impact of home country enforcement," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 42(C).
    4. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    5. Nerissa C. Brown & Richard M. Crowley & W. Brooke Elliott, 2020. "What Are You Saying? Using topic to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 237-291, March.
    6. Judson Caskey & Kanyuan Huang & Daniel Saavedra, 2023. "Noncompliance with SEC regulations: evidence from timely loan disclosures," Review of Accounting Studies, Springer, vol. 28(1), pages 126-163, March.
    7. Koulikidou, Kleopatra & Chantziaras, Antonios & Dedoulis, Emmanouil & Leventis, Stergios, 2023. "Regulatory enforcement, foreignness, and language negativity: Evidence from SEC comment letters," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 51(C).
    8. Nicholas M. Guest, 2021. "The Information Role of the Media in Earnings News," Journal of Accounting Research, Wiley Blackwell, vol. 59(3), pages 1021-1076, June.
    9. Hills, Robert & Kubic, Matthew & Mayew, William J., 2021. "State sponsors of terrorism disclosure and SEC financial reporting oversight," Journal of Accounting and Economics, Elsevier, vol. 72(1).
    10. Fargher, Neil & Wee, Marvin, 2019. "The impact of Ball and Brown (1968) on generations of research," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 55-72.
    11. Miguel Duro & Jonas Heese & Gaizka Ormazabal, 2019. "The effect of enforcement transparency: Evidence from SEC comment-letter reviews," Review of Accounting Studies, Springer, vol. 24(3), pages 780-823, September.
    12. Li, Ken, 2022. "Textual fundamentals in earnings press releases," Advances in accounting, Elsevier, vol. 57(C).
    13. Ormazabal, Gaizka & Duro, Miguel & Heese, Jonas, 2017. "Does the Public Disclosure of the SEC’s Oversight Actions Matter?," CEPR Discussion Papers 12145, C.E.P.R. Discussion Papers.
    14. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    15. Matthew Ege & Jennifer L. Glenn & John R. Robinson, 2020. "Unexpected SEC Resource Constraints and Comment Letter Quality†," Contemporary Accounting Research, John Wiley & Sons, vol. 37(1), pages 33-67, March.
    16. Crawley, Michael & Wahlen, James, 2014. "Analytics in empirical/archival financial accounting research," Business Horizons, Elsevier, vol. 57(5), pages 583-593.
    17. Christian Leuz & Peter D. Wysocki, 2016. "The Economics of Disclosure and Financial Reporting Regulation: Evidence and Suggestions for Future Research," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 525-622, May.
    18. Craja, Patricia & Kim, Alisa & Lessmann, Stefan, 2020. "Deep Learning application for fraud detection in financial statements," IRTG 1792 Discussion Papers 2020-007, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    19. Iatridis, George Emmanuel, 2016. "Financial reporting language in financial statements: Does pessimism restrict the potential for managerial opportunism?," International Review of Financial Analysis, Elsevier, vol. 45(C), pages 1-17.
    20. John L. Campbell & Hye Seung “Grace” Lee & Hsin‐Min Lu & Logan B. Steele, 2020. "Express Yourself: Why Managers' Disclosure Tone Varies Across Time and What Investors Learn From It," Contemporary Accounting Research, John Wiley & Sons, vol. 37(2), pages 1140-1171, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reaccs:v:26:y:2021:i:1:d:10.1007_s11142-020-09565-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.