India's Supreme Court Condemns Use of Fake AI-Generated Legal Citations by Junior Judge
Key Takeaways
- ▸A junior judge in Andhra Pradesh cited four completely fake AI-generated legal judgments in a property dispute ruling, prompting Supreme Court intervention
- ▸India's Supreme Court classified the use of fabricated AI citations as "misconduct" affecting the "integrity of adjudicatory process," not merely an error in judgment
- ▸The case has been escalated to India's top legal officials including the Attorney General and Bar Council of India for institutional review
Summary
India's Supreme Court has issued a stern rebuke after a junior civil judge in Andhra Pradesh cited four fake judgments generated by artificial intelligence while adjudicating a property dispute. The incident, which occurred in August 2024, saw the judge dismiss objections from defendants using AI-generated legal precedents that were later discovered to be entirely fabricated. While the state high court initially accepted the error was made in "good faith" and upheld the decision based on correct legal principles, the Supreme Court took a far harsher view, staying the lower court's order and calling the use of AI-generated citations an act of "misconduct" rather than a simple error.
The Supreme Court characterized the case as a matter of "institutional concern," emphasizing that fake AI-generated judgments have "a direct bearing on integrity of adjudicatory process." The junior judge explained this was her first time using an AI tool and she believed the citations to be genuine, with no intention to misrepresent rulings. The high court had advocated for "the exercise of actual intelligence over artificial intelligence" in its ruling. The Supreme Court has now issued notices to India's Attorney General, Solicitor General, and the Bar Council of India for further examination of the case.
This incident highlights the growing challenges AI poses to legal systems globally, as generative AI systems are known for their ability to "hallucinate" and present falsehoods as fact, sometimes even inventing sources. The use of AI in legal settings remains largely unregulated in India, and this case follows another recent Supreme Court warning about lawyers using AI tools to draft petitions. The incident has made headlines as the latest example of AI disrupting court proceedings in India and worldwide.
- The incident underscores the risks of AI hallucination in critical legal contexts and the lack of regulatory frameworks governing AI use in Indian courts
