Skip to main content

Welcome to a Grasp lesson

Create a free account to keep studying and create your own study path.

Lesson 36

AI-Generated Deepfakes & Obscenity Laws

Recommended resources

Introduction

Welcome to our final lesson in the module on AI Regulation under the Indian IT Act. In our previous session, we examined the proactive cybersecurity duties that the Act imposes on organizations, focusing on the strict reporting and data-logging mandates from CERT-In. We saw how the law compels entities to build secure systems, especially those involving AI.

Today, we shift our focus from the security of the system to the nature of the content it produces. This lesson directly addresses a highly visible and contentious issue: the proliferation of AI-generated harmful content, most notably deepfakes. Our learning outcome is to analyze the applicability of provisions on obscene or harmful content to AI-generated material like deepfakes. We will dissect how legal frameworks designed for a pre-generative AI era are being stretched to address phenomena like non-consensual intimate imagery and political disinformation, and how Indian regulation is evolving in response.


1. The Challenge of Synthetic Media

Before we dive into the legal text, it's essential to grasp the nature and scope of the problem. AI-generated media, or "deepfakes," are not a single category of content; they can be used for parody, art, political messaging, and malicious harm. Understanding this spectrum is key to appreciating the legal and ethical complexities.

To see this in action, please watch the following video from BBC News. It provides vivid, real-world examples of how deepfake technology is being used and misused, from political campaigns in India to non-consensual explicit images of public figures.

How AI and deepfakes are changing politics | BBC News

This video, 'How AI and deepfakes are changing politics', illustrates the diverse applications and harms of deepfakes, setting the context for why legal regulation is so critical.

Please watch the full video (up to 04:31). As you watch, note the different types of harm caused by deepfakes: personal harm (fake explicit images), political harm (disinformation), and the blurring of trust in institutions.

The video demonstrates that the term "harmful content" is broad. It can refer to:

  • Defamation and Reputational Harm: Falsely depicting someone saying or doing something damaging.
  • Privacy Invasion and Harassment: Creating non-consensual intimate or explicit imagery.
  • Public Mischief and Disinformation: Spreading false information to manipulate elections or incite unrest.

With this context in mind, let's analyze the primary legal tool India currently uses to combat such content: the Information Technology Act, 2000.


2. Applying Pre-AI Laws to Post-AI Content

The IT Act was enacted long before generative AI became mainstream. Consequently, regulators and courts must interpret its existing provisions to address new forms of harm.

Let's start by examining the core paper that outlines the legal landscape. This will serve as our guide to the relevant statutes.

Deepfake Evidence and the Indian Criminal Justice System

The paper 'Deepfake Evidence and the Indian Criminal Justice System' provides a detailed analysis of how various Indian laws apply to deepfakes. We will use it to identify the key sections of the IT Act.

Please read the sections '1.3 Deepfakes In a Criminal Context' and '2.4 Information Technology Act, 2000'. These sections list the primary provisions within the IT Act that are invoked to tackle deepfake-related crimes. Pay attention to which section addresses which type of harm.

As the paper outlines, there isn't one "deepfake law" but a collection of provisions that can be applied depending on the nature of the harmful content. Let's break them down.

Provisions for Obscene and Sexually Explicit Content

The most direct application of the IT Act to harmful deepfakes concerns obscene and explicit material. For this, we turn to a specialized analysis which breaks down the relevant sections.

Deepfake Regulation India 2025: MeitY's Comprehensive ...

This legal update, 'Deepfake Regulation India 2025', offers a concise breakdown of the IT Act's provisions that criminalize deepfake conduct, including those specifically dealing with obscene content.

Please read the subsection titled 'IT Act, 2000' under the 'Existing Legal Framework' heading. Focus on understanding the purpose and penalties of Sections 67 and 67A.

Based on this reading, the key provisions are:

  • Section 67: Punishment for publishing or transmitting obscene material in electronic form. This is the general provision against obscenity, carrying a penalty of up to three years imprisonment and a fine.
  • Section 67A: Punishment for publishing or transmitting of material containing sexually explicit act, etc., in electronic form. This is a more stringent provision targeting sexually explicit content, with penalties rising to five years imprisonment and a higher fine.
  • Section 67B: (Not detailed in the article but important to know) This section specifically deals with material depicting children in sexually explicit acts, carrying the most severe penalties.

These sections are the primary legal weapons against the creation and distribution of non-consensual deepfake pornography.

Provisions for Other Harms

As we saw in the BBC video, not all harmful deepfakes are obscene. For other harms like impersonation and privacy violation, other sections of the IT Act are used:

  • Section 66C (Identity Theft): Punishes the fraudulent use of another person's electronic signature, password, or other unique identification feature. This could apply if a deepfake voice is used to bypass biometric security.
  • Section 66D (Cheating by Impersonation): Punishes cheating by impersonating someone using a computer resource. This is highly relevant for deepfakes used in financial fraud or to spread disinformation.
  • Section 66E (Violation of Privacy): Punishes anyone who "intentionally or knowingly captures, publishes or transmits the image of a private area of any person without his or her consent."

The Analytical Gap: The Challenge of "Synthetic" Reality

Your background in legal research will help you appreciate the nuance here. While these provisions seem applicable, they contain language that a defense counsel could challenge in the context of purely synthetic media.

Let's return to our core academic paper to explore a critical analytical gap.

Deepfake Evidence and the Indian Criminal Justice System

The strength of a legal argument often lies in exploiting the ambiguities of statutory language. This is particularly true when applying old laws to new technology.

Please read the subsection '5.5 Non-consensual Intimate Imagery'. Focus on the author's critique of Section 66E and why its language might be insufficient for deepfakes.

The paper raises a crucial point: Section 66E penalizes the act of "capturing" or "transmitting" an image of a person's private area. A defense could argue that a deepfake is not a "captured" image of a real event but an entirely new, synthetically generated artifact. It doesn't depict something that happened; it creates a depiction of something that never happened. This textual ambiguity highlights the need for laws that are technologically neutral or specifically designed for AI-generated content.

Test your understanding!

A malicious actor creates a deepfake video showing a corporate CEO in a fabricated, sexually explicit scene and posts it online. The video is entirely computer-generated using publicly available photos of the CEO.

  1. Which section of the IT Act most directly addresses the sexually explicit nature of the content?
  2. Which section addresses the violation of the CEO's privacy?
  3. What is the core analytical challenge in applying the privacy-related section to this specific case?
Show answer
  1. Section 67A is the most direct provision, as it punishes the publication of material containing a sexually explicit act.
  2. Section 66E addresses the violation of privacy.
  3. The analytical challenge is that Section 66E uses the word "captures". A defense lawyer could argue that since the explicit scene was never "captured" from reality but was synthetically generated by an AI, the literal text of the law does not apply. The prosecution would need to argue for a purposive interpretation of the statute to cover this new form of harm.

3. The Evolving Regulatory Response

Recognizing these gaps, the Indian government has been actively working to strengthen the regulatory framework beyond the baseline provisions of the IT Act. This has been a multi-step process.

First, the Ministry of Electronics and Information Technology (MeitY) issued advisories, putting pressure on social media intermediaries to proactively tackle deepfakes.

MeitY Advisory on Deepfakes Mind Map
This mind map of the December 2023 MeitY Advisory on Deepfakes shows the government's initial response. It reminds platforms of their existing obligations under the IT Rules to remove harmful content (listed in Rule 3(1)(b)) and warns them that this includes deepfakes, signaling a move towards stricter enforcement.

Following these advisories, the next logical step is to amend the rules to make these obligations explicit. The article from Khurana & Khurana, which you read earlier, discusses amendments to the IT Rules that create a more direct regulatory framework for AI-generated content. These amendments focus on:

  1. Formal Definition: Creating a statutory definition of “synthetically generated information” to remove ambiguity.
  2. Mandatory Labeling: Requiring platforms and tool providers to clearly and permanently label AI-generated content, empowering users to distinguish between authentic and synthetic media.
  3. Platform Accountability: Reinforcing the obligations of intermediaries to remove harmful deepfakes upon notification to retain their "safe harbour" protection under Section 79 of the IT Act.

This evolution—from general criminal provisions to intermediary advisories to specific labeling rules—demonstrates a maturing regulatory approach that tries to keep pace with technology.


Conclusion

In this lesson, we have analyzed how India's legal framework, primarily the IT Act of 2000, applies to obscene and harmful AI-generated content like deepfakes. We have seen that while the Act provides a foundational toolkit, its effectiveness is challenged by the nature of synthetic media.

Key Takeaways:

  • Existing Provisions: Harmful deepfakes are primarily tackled using Sections 67 and 67A (obscene/explicit content) and Sections 66C, 66D, and 66E (impersonation/privacy violation) of the IT Act.
  • Analytical Gaps: The language of these pre-AI statutes, such as the word "captures" in Section 66E, creates potential legal loopholes when applied to purely synthetic content.
  • Regulatory Evolution: The government is closing these gaps through a combination of advisories and amendments to the IT Rules, 2021. The new focus is on creating clear definitions for synthetic media, mandating labeling for transparency, and reinforcing platform accountability.
  • Layered Approach: The legal strategy is not a single law but a multi-layered approach combining criminal liability for creators with due diligence obligations for intermediaries.

Preview of the Next Lesson:

This lesson concludes our module on the IT Act. We have covered intermediary liability, cybersecurity, and now, content regulation. We will now pivot to a new and fascinating domain in Module 7: AI in the Justice System. Our first lesson will explore the foundational concept of 'access to justice' and analyze how AI technologies can be a double-edged sword, both enhancing and impeding it. This will prepare us for later discussions on predictive justice and the automation of legal practice.