91Ƶ

Skip to content

AI 91Ƶhallucination91Ƶ in B.C. court case called wakeup call for justice system

91ƵIt doesn91Ƶt surprise me that lawyers don91Ƶt know a lot about it91Ƶ

Vancouver tech lawyer Ryan Black91Ƶs work with video game companies put him in a position to watch the rise of artificial intelligence in the industry.

Now he finds himself on the front lines again as his own profession grapples with the technology.

91ƵThe degree to which it was impacting game studios really surprised people,91Ƶ said Black, who helped the Law Society of British Columbia draft advice for lawyers about the use of AI.

91ƵThe generative (AI) revolution kind of has really hit people really hard in terms of, 91ƵOh my gosh, we have to really pay attention to this now,91Ƶ so I would say that it91Ƶs a new thing for a lot of people,91Ƶ he said referring to the type of technology that can create arguments and essays based on prompts from a user.

91ƵIt doesn91Ƶt surprise me that lawyers don91Ƶt know a lot about it.91Ƶ

The rise of generative AI tools like ChatGPT, he said, is a 91Ƶrevolutionary change to the practice of law,91Ƶ but a recent ruling by the B.C. Supreme Court shows lawyers must use the technology cautiously and skeptically, legal experts say.

In a costs ruling released Feb. 20 related to a child custody case, it was revealed that Vancouver lawyer Chong Ke had used ChatGPT to prepare material submitted in the case.

The material included citations to cases that don91Ƶt exist, something her opponent in the case called an AI 91Ƶhallucination.91Ƶ

Ke told the court that discovering that the cited cases were fictitious was 91Ƶmortifying,91Ƶ and she quickly informed the Law Society and admitted a 91Ƶlack of knowledge of the risks91Ƶ of using AI to draft court submissions.

91ƵI am now aware of the dangers of relying on Al generated materials,91Ƶ Ke said in an affidavit. 91ƵI understand that this issue has arisen in other jurisdictions and that the Law Society has published materials in recent months intended to alert lawyers in B.C. to these dangers.91Ƶ

Ke apologized to the court and her fellow lawyers.

Her lawyer John Forstrom said in an email that the case 91Ƶhas provoked significant public interest, but the substance of what happened is otherwise unremarkable.91Ƶ

91ƵI91Ƶm not sure that the case has any significant implications regarding the use of generative AI in court proceedings generally,91Ƶ Forstrom said.

91ƵMs. Ke91Ƶs use of AI in this case was an acknowledged mistake. The question if or how generative AI might appropriately be employed in legal work did not arise.91Ƶ

The society is now investigating Ke91Ƶs conduct, spokeswoman Christine Tam said in an email.

91ƵWhile recognizing the potential benefits of using AI in the delivery of legal services, the Law Society has also issued guidance to lawyers on the appropriate use of AI and expects lawyers to comply with the standards of conduct expected of a competent lawyer if they do rely on AI in serving their clients,91Ƶ Tam said.

The law society91Ƶs guidance, issued in late 2023, urges lawyers to seek training in the use of the technology, and be aware of confidentiality issues around data security, plagiarism and copyright concerns, and potential bias in materials produced by the technology.

Law societies and courts in other provinces and territories have also produced guidance on the use of AI. For instance, the Supreme Court of Yukon said in a June 2023 practice direction that if any lawyer relies on AI 91Ƶfor their legal research or submissions in any matter and in any form,91Ƶ they must tell the court.

For Black, with the firm DLA Piper, the use of AI is causing a lot of 91Ƶnecessary angst about relying on a tool like this to do any real heavy lifting.91Ƶ

Black said delivering justice requires the impartiality of a 91Ƶhuman peer,91Ƶ capable of evaluating and making important legally binding decisions.

He said he91Ƶs encountered lawyers and judges who are either 91Ƶcompletely dialed into it, to completely averse to it, to completely agnostic to it.91Ƶ

He said he91Ƶs been 91Ƶimpressed by the pace of the technology,91Ƶ but the need for caution and skepticism around any materials generated by the material is essential for lawyers now and into the future.

Reflecting on the Ke case and others like it, Black said tools like ChatGPT are 91Ƶreally good autocorrect tools that do a fantastic job of relating text to other text, but they have no understanding of the world, they have no understanding of reality.91Ƶ

UBC law professor Kristen Thomasen said in an interview that the B.C. Supreme Court case shows not only the limitations of the technology, but also the need for lawyers and other professionals 91Ƶto be critical of the technologies that they91Ƶre using.91Ƶ

Thomasen said evaluating the strengths and weaknesses of technology has to be done 91Ƶin spite of what is often a lot of hype.91Ƶ

She said it91Ƶs important not to delegate work that requires a human element to a computer system in 91Ƶhigh stakes91Ƶ professions like law and policing where new, potentially problematic technologies should be approached and employed with caution.

Thomasen said the technology has been described as a 91Ƶliving thing91Ƶ or an existential threat to humanity, or thought of as a 91Ƶsuperhuman ghost in the machine,91Ƶ but despite being highly sophisticated, it91Ƶs just doing math based on data scraped from the internet.

She said that stepping back from seeing it as a 91Ƶperson91Ƶ would help institutions, students and teachers better understand what the technology actually does.

91ƵAs we see how it progresses, I think it makes sense to then, kind of like the law societies, keep developing more refined and detailed guidelines or rules as we gain a better understanding of what the technology looks like,91Ƶ she said.

The judge in the case that involved Ke said it would be 91Ƶprudent91Ƶ for her to tell the court and opposing lawyers if any other material employed AI technology like ChatGPT.

91ƵAs this case has unfortunately made clear, generative AI is still no substitute for the professional expertise that the justice system requires of lawyers,91Ƶ Justice David Masuhara wrote in his costs ruling. 91ƵCompetence in the selection and use of any technology tools, including those powered by AI, is critical. The integrity of the justice system requires no less.91Ƶ

Black said artificial intelligence technology isn91Ƶt going away, and any rules developed now will likely need changing due to the 91Ƶbreakneck speed91Ƶ of its evolution.

91ƵWe are for sure now in a world where AI will exist,91Ƶ he said. 91ƵThere is no un-ringing this bell as far as I91Ƶm concerned.91Ƶ

READ ALSO:

READ ALSO:





(or

91Ƶ

) document.head.appendChild(flippScript); window.flippxp = window.flippxp || {run: []}; window.flippxp.run.push(function() { window.flippxp.registerSlot("#flipp-ux-slot-ssdaw212", "Black Press Media Standard", 1281409, [312035]); }); }