Artificial intelligence tools are becoming popular among lawyers, but judges are not amused when these tools lead to mistakes. Recently, a district judge in the U.S. found that two defense lawyers used ChatGPT to help prepare a legal document. The result? At least 14 citations of case law that turned out to be fake or misrepresented. When confronted, the lawyers quickly admitted they had relied on AI to draft and edit the document.

Judge’s Unusual Punishment for AI-Related Errors

Judge David Hardy didn’t just fine the lawyers. He gave them a tough choice: pay a $2,500 fine each, get kicked off the case, or write letters to their law school deans and bar officials admitting their mistake. The lawyers chose to face the consequences, with one being fired from the firm. The firm, Cozen O’Connor, apologized and explained that an associate had filed an early draft made with ChatGPT. The other lawyer involved still remains with the firm.

Cozen O’Connor claims it has strict rules against using publicly available AI tools for client work, but it seems those rules weren’t enough to prevent this slip-up. The firm emphasized its commitment to responsibility, but the incident shows how risky AI can be if not properly supervised.

Other Courts Take a Hard Line on AI Fails

This isn’t the first time a judge has penalized lawyers for AI mistakes. In a case involving a big law firm, Morgan & Morgan, lawyers submitted fake case law generated by AI in a lawsuit against Walmart. The judge fined the firm thousands of dollars, highlighting the importance of verifying AI outputs. Despite the fines, the firm later warned its employees about the shortcomings of AI, even as it praised the technology’s usefulness.

Many legal professionals are now realizing that AI can produce false or misleading information. Sometimes, AI invents cases or mixes real ones with fake ones, and lawyers often don’t double-check the results. This careless reliance on AI is raising concerns across the legal industry. Even specialized legal AI tools aren’t immune from producing errors, and big firms aren’t exempt from mistakes either.

Judges Want to Curb AI-Generated Misinformation

Some judges are taking a firm stance against sloppy use of AI. For example, three lawyers from Butler Snow were removed from their case after the judge discovered they used fake citations generated by AI. Experts, like Gary Marchant from Arizona State University, say judges are increasingly frustrated and are looking for ways to punish misconduct and prevent future errors.

The issue extends beyond individual cases. Earlier this year, the California state bar admitted that some questions on a recent bar exam were created using AI. Even a judge in Mississippi was accused of issuing a confusing ruling that was supposedly crafted with AI help. These incidents show that AI’s impact on the legal field is growing and that the legal community is still figuring out how to handle its risks.

As AI tools become more integrated into legal work, lawyers and judges alike need to be cautious. Relying on AI without proper checks can lead to serious consequences, from legal sanctions to damaged reputations.

In the end, AI can be a useful tool, but it’s no substitute for careful review and professional judgment. The legal world is learning this lesson the hard way, and the message is clear: don’t trust AI blindly.

Inspired by

• https://futurism.com/judge-humiliating-punishment-lawyers-using-ai

Sources

• gmpg.org
• reuters.com
• reuters.com