(Kevser Oz an intern assisted with this blog) Artificial intelligence is being used more and more in the legal field, but its role raises ethical questions. While AI can be used for organizational tasks, replying on it for client advice, citations and legal cases has led to numerous incidents.
Law firms that focus on accountability, accuracy and client security highlight the truth: artificial intelligence can never replace the responsibility that comes with practicing law.
People trust legal advice generated by ChatGPT more than a lawyer – new study
Three experiments were conducted on a total of 288 people. In the first two experiments, participants were given legal advice and asked which they thought was the most approachable.
When people didn’t know if the advice had come from a lawyer or an AI, they were more willing to rely on the AI-generated advice. Inevitably participants prefer it to expert advice by lawyers – without questioning its accuracy.
Even when participants were told which advice came from a lawyer and which was AI-generated, they found that they were wanting to follow ChatGPT just as much as the lawyer.
One reason LLMs may be preferred, as found in the study, is that they use more complex language. On the other hand, lawyers tended to use simpler language ensuring that clients have no issues understanding.
A Man Used an A.I. Video to Argue His Case in Court — and Judge Was Not Happy
A man was scolded in a New York courtroom in late March after attempting to use an A.I.-generated person to argue his case in front of a panel of judges.
In a video of the incident shared on social media by USA Today, the judges on panel turn in question as a man on the screen says “May it please the court. I come here today a humble pro se before a panel of five distinguished justices.”
Justice Sallie Manzanet-Daniels, then interrupts the video in disbelief: “Alright, is this … is … hold on … is that counsel for the case?”
“I generated that, that is not a real person” the man replies. The man, Dewald argued that he had difficulties with public speaking and hoped that an A.I software would create a strong argument.
This highlights the risks of relying on such tools in today’s legal world and the public consequences you may face.
Attorney Slapped with Hefty Fine for Citing 21 Fake, AI-Generated Cases: Risks of AI legal advice
Amir Mostafavi submitted an appeal in an employment-related case, but 21 of the 23 cases he cited to support his argument were fake were created by AI and included citations from existing cases. He was fined $10,000, a clear indicator of the risks of AI legal advice
Mostafavi claims he wrote the first draft of the case but then used AI tools such as ChatGPT, Grok, Gemini, and Claude to rephrase, and enhance his work.
The use of inaccurate, AI-generated text in legal briefings is becoming far too common,” the judge adds. LLMs are creating inaccurate information, and misleading professionals.
Chaudhary Law Office
Here at Chaudhary Law Office, we believe that AI cannot replace experienced lawyers with ethical and creditable sources and mitigate the risks of AI legal advice. We commit to accuracy using human-verified, reliable sources in order to guarantee client security.
We ensure that our advice is based on real information that approaches your needs with diligence, integrity and responsibility. Tools may help with efficiency, but it should not replace professional reasoning and judgment.
Conclusion
The reliance on AI tools like ChatGPT for legal advice reveals many faults, creating consequences and public controversy. These real-life incidents showcase the risks of using AI in legal contexts without proper oversight.
These cases raise a critical issue: while AI may appear accurate, it lacks the ethicality, accountability and judgment of a legal professional.
Don’t turn to AI for legal advice, call 416-447-6118 today or visit Chaudhary Law to schedule a consultation. We will approach your legal needs with full transparency.
