Manufacturing justice: On the top court, AI use observations
The use of AI-fabricated judicial ‘precedents’ amounts to criminal misconduct
360° Perspective Analysis
Deep-dive into Geography, Polity, Economy, History, Environment & Social dimensions — AI-powered, on-demand
Context
The has issued strong cautions against the use of Artificial Intelligence (AI) hallucinations in judicial proceedings, likening its potential harm to the 1984 Bhopal gas tragedy. The Court overturned orders by the (NCLT) and the (NCLAT) because the NCLT had relied on fictitious, AI-generated legal citations. This highlights the urgent need for stringent regulations, such as the proposed 'Regulations for Use of Artificial Intelligence (AI) in Courts, 2026', and proactive measures by bodies like the to ensure AI remains strictly an assistive tool rather than a replacement for human judicial reasoning.
UPSC Perspectives
Polity
The 's intervention underscores the foundational importance of judicial reasoning and independent application of mind in the justice delivery system. Under of the Constitution, the law declared by the Supreme Court is binding on all courts within the territory of India, making the accurate citation of precedents crucial. The reliance by statutory tribunals like the (NCLT) on fictitious, AI-generated case laws undermines the integrity of the judicial process and the principle of stare decisis (let the decision stand). The Court's assertion that such reliance constitutes 'no decision in the eyes of law' highlights that while technology can aid efficiency, the core adjudicatory function—requiring judicial discretion and human empathy—cannot be delegated to algorithms. This raises critical questions about the standard of professional accountability for advocates under the and the duty of judges to scrutinize submissions rigorously.
Governance
The integration of AI in courts presents significant governance challenges, particularly concerning institutional capacity and regulatory frameworks. The draft 'Regulations for Use of Artificial Intelligence (AI) in Courts, 2026' represents a crucial step in formalizing e-governance within the judiciary while establishing boundaries. By prohibiting AI in substantive judicial outcomes like adjudication, sentencing, or bail decisions, the regulations aim to prevent algorithmic bias and preserve human oversight. The 's directive to the (BCI) to formulate strict norms for lawyers highlights the need for a collaborative approach to capacity building and enforcing disciplinary action against professional misconduct involving unverified AI material. This incident serves as a case study for UPSC on the complexities of adopting emerging technologies in sensitive public institutions without compromising systemic integrity.
Ethics
From a GS Paper 4 perspective, the use of AI 'hallucinations' (where AI confidently generates false information) in legal proceedings poses profound ethical dilemmas concerning truth, integrity, and professional probity. The 's characterization of this as 'misconduct' rather than mere error emphasizes that lawyers and judges have an ethical obligation—a duty of care—to verify the information they present and rely upon. Presenting fabricated judgments violates the core ethical tenets of the legal profession, which demand honesty towards the court. Furthermore, the potential 'catastrophic' impact on litigants, as likened to the Bhopal gas tragedy, underscores the severe consequences of negligence in professional duties. The scenario emphasizes that technological advancement must be guided by moral philosophy and strict adherence to Public Service Ethics, ensuring that innovation does not lead to the 'manufacturing of justice' based on falsehoods.