From Business Law Today:
Artificial Intelligence (AI) is disrupting almost every industry and profession, some faster and more profoundly than others. Unlike the industrial revolution that automated physical labor and replaced muscles with hydraulic pistons and diesel engines, the AI-powered revolution is automating mental tasks. While it may be merely optimizing some blue-collar jobs, AI is bringing about a more fundamental change to many white-collar roles previously thought safe from automation. Some of these professions are being completely transformed by the superhuman capabilities of AI to do things that were not possible before, augmenting — and to some degree replacing — their human colleagues in offices.
In this way, AI is having a profound effect on the practice of law. Though AI is more likely to aid than replace attorneys in the near term, it is already being used to review contracts, find relevant documents in the discovery process, and conduct legal research. More recently, AI has begun to be used to help draft contracts, predict legal outcomes, and even recommend judicial decisions about sentencing or bail.
The potential benefits of AI in the law are real. It can increase attorney productivity and avoid costly mistakes. In some cases, it can also grease the wheels of justice to increase the speed of research and decision-making. However, AI is not yet ready to replace human judgment in the legal profession. The risk of embedded bias in data that fuels AI and the inability to adequately understand the rationale behind AI-derived decisions in a way understandable to humans (i.e., explainability) must be overcome before using the technology in some legal contexts.
. . . .
Attorneys are already using AI, and especially Machine Learning (ML), to review contracts more quickly and consistently, spotting issues and errors that may have been missed by human lawyers. Startups like Lawgeex provide a service that can review contracts faster, and in some cases more accurately, than humans.
For some time, algorithms have been used in discovery — the legal process for identifying the relevant documents from an opponent in a lawsuit. Now, ML is also being used in this effort. One of the challenges of requesting and locating all the relevant documents is to think of all the different ways a topic may be described or referenced. At the same time, some documents are protected from scrutiny, and counsel (or the judge) may seek to limit the scope of the search so as not to overburden the producing party. ML threads this needle using supervised and unsupervised learning. Companies like CS Disco, which went public recently, provide AI-powered discovery services to law firms across the US.
Another area where AI is already used extensively in the practice of law is in conducting legal research. Practicing attorneys may not even be aware they are using AI in this area, since it has been seamlessly woven into many research services. One such service is Westlaw Edge, launched by Thomson Reuters more than three years ago. The keyword or boolean search approach that was the hallmark of the service for decades has been augmented by semantic search. This means the machine learning algorithms are trying to understand the meaning of the words, not just match them to keywords. Another example of an AI-powered feature from Westlaw Edge is Quick Check, which uses AI to analyze a draft argument to gain further insights or identify relevant authority that may have been missed. Quick Check can even detect when a case cited has been indirectly overturned.
. . . .
AI can generate content as well as analyze it. Unlike AI used to power self-driving cars where mistakes can have fatal consequences, generative AI does not have to be perfect every time. In fact, the unexpected and unusual artifacts associated with AI-created works are part of what makes it interesting. AI approaches the creative process in a fundamentally different way than humans, so the path taken or end result can sometimes be surprising. This aspect of AI is called “emergent behavior.” Emergent behavior may lead to new strategies to win games, discovering new drugs or simply expressing ideas in novel ways. In the case of written content, human authors are still needed to manage the creative process, selecting which of the many AI-generated phrases or versions to use.
Much of this is possible due to new algorithms and enormous AI models. GPT-3, created by OpenAI, is one such model. GPT-3 is a generative model that can predict the next token in a sequence, whether that token is audio or text. GPT-3 is a transformer, meaning it takes sequences of data in context, like a sentence, and focuses attention on the more relevant portions to extend the work in a way that seems natural, expected and harmonious. What makes GPT-3 unusual is that it is a pre-trained model, and it’s huge — using almost 200 billion parameters, and trained on half a trillion words.
This approach has already been used in creative writing and journalism, and there are now lots of generative text tools in that area, some built on GPT-3. With a short prompt, an AI writer can create a story, article or report — but don’t expect perfection. Sometimes the AI tool brings up random topics or ideas, and since AI lacks human experience, it may have some factual inaccuracies or strange references.
In order for AI to draft legal contracts, for example, it will need to be trained to be a competent lawyer. This requires that the creator of the AI collect the legal performance data on various versions of contract language, a process called “labeling.” This labeled data then is used to train the AI about how to generate a good contract. However, the legal performance of a contract is often context-specific, not to mention varying by jurisdiction and an ever-changing body of law. Plus, most contracts are never seen in a courtroom, so their provisions remain untested and private to the parties. AI generative systems training on contracts run the risk of amplifying bad legal work as much as good. For these reasons, it’s unclear how AI contract writers can get much better any time soon. AI tools simply lack the domain expertise and precision in language to be left to work independently. While these tools may be useful to draft language, human professionals are still needed to review the output before being used.
. . . .
Another novel use of AI is predicting legal outcomes. Accurately assessing the likelihood of a successful outcome for a lawsuit can be very valuable. It allows an attorney to decide whether they should take a case on contingency, or how much to invest in experts, or whether to advise their clients to settle. Companies such as Lex Machina use machine learning and predictive analytics to draw insights on individual judges and lawyers, as well as the legal case itself, to predict behaviors and outcomes.
A more concerning use of AI is in advising judges on bail and sentencing decisions. One such application is Correctional Offender Management Profiling for Alternative Sanctions (COMPAS). COMPAS and similar AI tools are used by criminal judges in many states to assess the recidivism risk of defendants or convicted persons in decisions on pre-trial detention, sentencing or early release. There is much debate about the fairness or accuracy of these systems. According to a ProPublica study, such assessment tools seemed biased against black prisoners, disproportionately flagging them as being significantly more likely to reoffend than white prisoners.
Equivant, the company that developed COMPAS, sought to refute the ProPublica analysis and rejected its conclusions about racial bias.
Regardless, using AI in this context may reflect, or even amplify, the inherent bias in the data of the criminal justice system. The data used to train the ML models is based on actual arrests and conviction rates that may be slanted against some populations. Thus it may enshrine past injustices, or worse, falsely cloak them in the vestment of computer-generated objectivity.
Link to the rest at Business Law Today
As PG has mentioned before, he would love to be practicing law with all the AI tools available.
Back in the days when a ten-megabyte hard drive was hot stuff, PG developed computer tools to speed the process of generating legal documents and court filings. He managed to sell a whole bunch of a document assembly package for divorces that he called, Splitsville.
He just ran a search and found Splitsville, a term he originally picked up from one of his divorce clients, is used for all sorts of tools, books, etc., relating to divorce.
What about the stories of the bots inventing cases and references, and the lawyers too lazy to check them out before sending the results of ‘research’ to a judge?
Outright invention, otherwise known as lying.
Called ‘hallucinating’, it should be called deliberate deception – AN answer is more important than accuracy.
Alicia, that the computer can produce documents that look like the real thing is a leap forward. (Admittedly, over a rather low bar. Over many years before this entire issue blew up, I have read several rulings – and dissents, for that matter – and was certain that various interesting substances were involved in their formulation. This reading is not, and never has been, my job, either. Just my simple curiosity.)
It will not take all that long to refine the algorithms to eliminate the “hallucinations.”