IDEAS home Printed from https://ideas.repec.org/p/ebg/heccah/1446.html
   My bibliography  Save this paper

Computational Indicators in the Legal Profession: Can Artificial Intelligence Measure Lawyers' Performance?

Author

Listed:
  • Restrepo-Amariles, David

    (HEC Paris)

  • Baquero, Pablo Marcello

    (HEC Paris)

  • Boniol, Paul

    (University of Paris)

  • El Hamdani, Rajaa

    (HEC Paris)

  • Vazirgiannis, Michalis

Abstract

The assessment of the legal professionals’ performance is increasingly important in the market of legal services to provide relevant information both to consumers and to law firms regarding the quality of legal services. In this article, we explore how computational indicators are produced to assess lawyers’ performance in courtroom litigation, analyzing the specific types of information they can generate. We capitalize on artificial intelligence (AI) methods to analyze a sample of 8,045 cases from the French Courts of Appeal, explore different associations involving lawyers, courts, and cases, and assess the strengths and flaws of the resulting metrics to evaluate the performance of legal professionals. The methods we use include natural language processing, machine learning, graph mining and advanced visualization. Based on the examination of the resulting analytics, we uncover both the advantages and challenges of assessing performance in the legal profession through AI methods. We argue that computational indicators need to address deficiencies regarding their methodology and diffusion to users to become effective means of information in the market of legal services. We conclude proposing adjustments to computational indicators and existing regulatory tools to achieve this purpose, seeking to pave the way for further research on this topic.

Suggested Citation

  • Restrepo-Amariles, David & Baquero, Pablo Marcello & Boniol, Paul & El Hamdani, Rajaa & Vazirgiannis, Michalis, 2021. "Computational Indicators in the Legal Profession: Can Artificial Intelligence Measure Lawyers' Performance?," HEC Research Papers Series 1446, HEC Paris.
  • Handle: RePEc:ebg:heccah:1446
    as

    Download full text from publisher

    File URL: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3974526
    File Function: Full text
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    Law and technology; artificial intelligence; legal informatics; machine learning; NLP;
    All these keywords.

    JEL classification:

    • K10 - Law and Economics - - Basic Areas of Law - - - General (Constitutional Law)
    • K41 - Law and Economics - - Legal Procedure, the Legal System, and Illegal Behavior - - - Litigation Process
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ebg:heccah:1446. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Antoine Haldemann (email available below). General contact details of provider: https://edirc.repec.org/data/hecpafr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.