Gujarat High Court Raises Alarm Over AI-Generated Fake Case Law in GST Orders
In a significant development, the Gujarat High Court has flagged what it describes as a "worrying trend" involving quasi-judicial orders that allegedly rely on artificial intelligence (AI)-generated and questionable case law. This comes just a week after the Supreme Court of India cautioned lawyers about the risks of using AI to draft legal petitions, highlighting a growing concern over the misuse of technology in the judicial process.
Unverifiable Judgments in GST Case Prompt Court Action
The issue surfaced in a case involving Marhaba Overseas Pvt Ltd, where the court discovered that several judgments cited in a Goods and Services Tax (GST) order could not be verified upon investigation. Some of these citations were even attributed to incorrect courts, such as labeling Supreme Court rulings as decisions of the Gujarat High Court. The case originated from proceedings against the company, which received a notice dated June 29, 2025, from the additional commissioner of Central Goods and Services Tax and Central Excise via the GST portal. After Marhaba Overseas filed its defense, the commissioner issued an order against the company on September 26, 2025.
Lawyers Highlight Need for Guidelines on AI Use in Legal Citations
Challenging this order, the company approached the High Court through senior advocate Saurabh Soparkar and advocate Parth Bhatt. They pointed out that despite thorough searches, many judgments referenced in the additional commissioner's order were untraceable. The lawyers argued that this situation underscores the necessity for establishing guidelines to regulate how quasi-judicial authorities cite judicial precedents, particularly when relying on AI-generated content. They emphasized that such AI tools can produce non-existent case law or citations that do not apply to the relevant legal issues raised by assessees.
Court's Response and Future Directions
Upon hearing these submissions, a bench comprising Justice A S Supehia and Justice Pranav Trivedi stated that the arguments "merit acceptance" and labeled the reliance on unverified AI-generated citations as "a worrying trend." The court criticized the reasoning and findings in the commissioner's order, describing them as "flawed and deceptive." It noted that the commissioner appeared to have followed AI-generated citations without reading the actual judgments, leading to erroneous conclusions.
The High Court further asserted that this case is appropriate for issuing directions to regulate and prescribe parameters for quasi-judicial authorities when citing judgments from high courts or the Supreme Court of India. This move aims to prevent the misuse of AI in legal contexts and ensure the integrity of judicial precedents. The court has scheduled a further hearing for March 13, where counsel for GST authorities will be required to address this issue in detail.
Broader Implications for Legal Practice and AI Integration
This incident echoes similar concerns raised by the Supreme Court regarding AI-assisted petitions citing non-existent judgments. It highlights the broader challenges of integrating AI into legal systems, where accuracy and reliability are paramount. As technology becomes more prevalent in judicial processes, courts are increasingly recognizing the need for safeguards to maintain legal standards and prevent misinformation. The Gujarat High Court's proactive stance may set a precedent for other jurisdictions to develop frameworks governing the use of AI in legal citations and decision-making.
