The Delhi High Court has taken a stern stance against the circulation of objectionable content on social media platforms, specifically directing Meta to take immediate action. On Friday, the court ordered the social media giant to remove AI-morphed images and related material involving a woman and Prime Minister Narendra Modi within a strict 24 hour deadline. The directive comes after a petitioner approached the court alleging that her images were manipulated using artificial intelligence to create deepfake content that was then circulated across various social media platforms.
Allegations Against CJP Activists
The legal proceedings have brought several individuals under the scanner. The petitioner has specifically named activists associated with CJP, including Sourav Das, Abhijeet Dipke, Ashutosh Ranka, and Ratna Singh. According to the petition, these individuals were allegedly involved in circulating the morphed images that featured the woman alongside Prime Minister Narendra Modi. The petitioner claimed that the content was created using sophisticated AI tools to defame and cause distress. In response to these serious allegations, the Delhi High Court has not only issued orders to the platform but has also summoned the named CJP leaders to address the matter in court.
Court Observations and Prime Ministerial Context
During the hearing, the Delhi High Court emphasized the sensitivity of the case. The bench observed that this matter isn't limited to the privacy and dignity of an individual woman but also involves the name and office of the Prime Minister of India. The court noted that CJP activists Sourav Das and Abhijeet Dipke had shared these AI-morphed photos on Meta-owned social media platforms. The gravity of involving the country's top leadership in such deepfake content prompted the court to act swiftly and decisively. The court's intervention highlights the growing concern over the misuse of AI technology to create misleading and harmful digital content.
Police Protection and Status Report
In addition to the removal of the content, the Delhi High Court has prioritized the safety of the petitioner. The court has issued an order for the Delhi Police to provide adequate security to the woman who filed the writ petition. On top of that, the court has directed the Delhi Police to conduct a thorough investigation into the matter and submit a comprehensive status report within 2 weeks. This report is expected to detail the progress of the investigation and the steps taken against those responsible for creating and sharing the morphed content. The legal representation for the petitioner was led by Advocate Umesh Chandra Sharma, who argued for the immediate removal of the deepfake material from all online platforms.
Meta History and Future Proceedings
This isn't the first time Meta has faced scrutiny from Indian authorities regarding content moderation. The court noted that Meta had previously been summoned by the government in relation to Child Sexual Abuse Material (CSAM). In that instance, Meta had acknowledged its lapses and removed the objectionable posts involving children. The current case adds to the regulatory pressure on social media companies to maintain stricter oversight of AI-generated content. The Delhi High Court has scheduled the next hearing for this case on 14 October, where the status report from the police and the compliance of Meta and the CJP activists will be reviewed.