This article is written by Bhumika Rai, a second-year undergraduate law student at Prof. Rajendra Singh (Rajju Bhaiya) University, Prayagraj.
Abstract
The rapid advancement of Artificial Intelligence (AI) has transformed the digital landscape, offering innovative solutions across various sectors. However, it has also given rise to emerging threats, one of the most concerning being deepfake technology. Deepfakes are AI-generated or manipulated images, videos, and audio recordings that appear highly realistic, making it increasingly difficult to distinguish between authentic and fabricated content. The widespread availability of such technology has created significant legal, ethical, and societal challenges. With the exponential growth of internet usage, cybercrimes have become more prevalent, while many users remain unaware of the risks associated with digital technologies. In India, deepfake technology has emerged as a serious concern due to its potential misuse for identity theft, misinformation, defamation, financial fraud, and political manipulation. This article examines the impact of deepfake technology on society, governance, and cybersecurity. It analyses the applicability of existing Indian legal frameworks, including the Information Technology Act, 2000 and relevant criminal laws, in addressing offences involving deepfakes.
Keywords: Deepfake Technology, Identity Theft, Artificial Intelligence, Cybercrime, Information Technology Act, 2000, Misinformation.
Introduction
“Satyameva Jayate Nanritam, Satyena Pantha Vitato Devayanah.”
Meaning: “Truth alone triumphs, not falsehood; through truth the path to the highest good is revealed.’’
The digital age has transformed the way people communicate, share information, and interact with technology. Among the many technological advancements, Artificial Intelligence (AI) has become an important part of modern society. AI enables machines to perform tasks that once required human intelligence, making processes faster and more efficient. One of the most significant and controversial developments in AI is deepfake technology. Deepfake technology uses advanced machine learning algorithms to create highly realistic but fabricated digital content. It can manipulate a person’s face, voice, or movements to produce audio and video recordings that appear genuine. As a result, it is often difficult for ordinary viewers to distinguish between authentic content and AI-generated material. Although deepfakes were initially developed for research, entertainment, and creative purposes, their misuse has raised serious ethical and legal concerns. The growing accessibility of AI tools has made it easier than ever for individuals to create customized and convincing deepfake content. Consequently, malicious actors are increasingly using this technology for fraud, misinformation campaigns, identity theft, cyberbullying, and personal attacks. India, one of the world’s largest digital markets, faces significant challenges in regulating deepfake technology. The rapid advancement of AI has outpaced existing legal frameworks, leaving gaps in protection against AI-enabled cybercrimes. While current laws provide some remedies, they are often inadequate to address the unique risks posed by deepfakes. Therefore, there is an urgent need for a comprehensive and robust regulatory framework that can effectively tackle the evolving challenges of deepfake technology and safeguard individuals, institutions, and society as a whole.
Meaning and Evolution of Deepfake Technology
The term “deepfake” is derived from the words “deep learning” and “fake.” Deepfake technology refers to the use of Artificial Intelligence (AI) and machine learning algorithms to create or manipulate digital content, including images, videos, and audio recordings, in a way that makes them appear real even when they are not. This technology can modify a person’s face, voice, facial expressions, or movements, making it seem as though they said or did something that never actually happened. Because deepfakes are often highly realistic, it can be difficult for viewers to distinguish them from genuine content. The evolution of deepfake technology is closely connected to advancements in artificial intelligence and deep learning. Before the emergence of deepfakes, digital manipulation was mainly carried out using software such as Adobe Photoshop and CorelDRAW. These tools required significant manual effort and technical expertise. However, with the development of AI-powered technologies, computers became capable of automatically generating realistic images, videos, and audio content with minimal human intervention. Today, deepfake technology has become more sophisticated and accessible, offering both opportunities and challenges. While it has several beneficial applications in fields such as entertainment, education, healthcare, and cultural preservation, its misuse has also raised serious ethical, social, and legal concerns.
How Deepfake Technology Works
The image shows how fake audio is identified. First, an audio recording is taken to remove unwanted noise. Important sound patterns are then studied and checked by computer programs trained to recognize differences between real and artificial voices. Based on this analysis, the system decides whether the audio is genuine or a deepfake.
Positive Application of Deepfake Technology
Despite the concerns surrounding deepfake technology, it can be used in many positive and useful ways when applied responsibly and ethically.
Entertainment Industry
The entertainment industry uses deepfake technology to recreate historical figures, enhance visual effects, and digitally de-age actors in films and television shows. This technology helps reduce production costs while giving filmmakers greater creative freedom and new storytelling opportunities.
Education and Training
Deepfake technology can make learning more engaging and interactive. Educational institutions can use AI-generated simulations and digitally recreated historical figures to provide students with a more immersive learning experience and a better understanding of historical events.
Healthcare and Accessibility
Voice-cloning technology can assist individuals who have lost their ability to speak due to illness, injury, or medical conditions. AI-generated personalized voices help improve communication and enhance their overall quality of life.
Cultural Preservation
Museums, educational institutions, and cultural organizations can use synthetic media to recreate historical events, preserve cultural heritage, and make history more accessible and engaging for future generations.
Deepfakes as a Tool for Cybercrime
The misuse of deepfake technology has made it a growing threat in the field of cybercrime. Criminals are increasingly using AI-generated content to deceive individuals, spread misinformation, and carry out various illegal activities.
Identity Theft
Cybercriminals can use deepfake videos and voice recordings to impersonate individuals and gain unauthorized access to personal information, bank accounts, social media accounts, and other digital platforms. Such activities can result in financial losses and serious privacy violations.
Financial Fraud
Deepfake technology has been used in several cases of financial fraud around the world. Criminals create AI-generated voice clones of company executives or business leaders to trick employees into transferring large sums of money to fraudulent accounts.
Cyberbullying and Online Harassment
Deepfake images and videos are often used to harass, intimidate, or defame individuals. The circulation of such fabricated content can damage a person’s reputation and have serious emotional and psychological consequences.
Political Manipulation
Deepfakes can be used to create fake speeches, statements, or videos of political leaders. Such content can spread misinformation, influence public opinion, manipulate elections, and undermine trust in democratic institutions.
Non-Consensual Explicit Content
One of the most harmful uses of deepfake technology is the creation of non-consensual explicit content. In such cases, a person’s face is digitally inserted into intimate or sexually explicit images or videos without their consent. This violates an individual’s privacy, dignity, and personal rights, often causing significant emotional distress and reputational harm.
Legal Framework Governing Deepfakes in India
India currently does not have a specific law regulating deepfake technology. However, several provisions under existing cyber and criminal laws can be used to address offences arising from the misuse of deepfakes. Information Technology Act, 2000 provides certain safeguards against digital misconduct. Section 66C deals with identity theft, while Section 66D criminalizes cheating by personation through computer resources. Additionally, Sections 67 and 67A prohibit the publication and transmission of obscene or sexually explicit content in electronic form, making them relevant in cases involving non-consensual deepfake images and videos. Bharatiya Nyaya Sanhita, 2023 also provides remedies for offences such as cheating, forgery, impersonation, defamation, and criminal intimidation. Victims may further seek protection under the fundamental right to privacy and the doctrine of personality rights, which safeguard an individual’s identity, image, voice, and reputation. Despite these provisions, the existing legal framework remains inadequate to effectively address the challenges posed by deepfake technology. Since most laws were enacted before the rise of artificial intelligence, they do not specifically regulate AI-generated content. Issues relating to liability, identification of creators, cross-border dissemination, and rapid removal of harmful deepfakes continue to highlight the need for a comprehensive legal framework in India.
Deepfake and AI Misuse
CASE:- Rashmika Mandanna deepfake incident
One of the most significant examples highlighting the dangers of deepfake technology in India is the Rashmika Mandanna deepfake incident. In 2023, a manipulated video went viral on social media in which the face of actress Rashmika Mandanna was digitally superimposed onto another woman’s body using artificial intelligence-based face-swapping technology. The video appeared realistic and misled many viewers into believing it was authentic. The incident generated widespread public concern regarding privacy violations, identity misuse, and the harmful consequences of AI-generated content. Several public figures, including actors and government officials, expressed concern over the increasing misuse of deepfake technology. The Government of India acknowledged the seriousness of the issue and emphasized the need for stronger legal and technological measures to combat AI-generated misinformation and impersonation.This case demonstrated how deepfake technology can be weaponized against individuals without their consent, causing reputational damage, emotional distress, and threats to personal dignity. It also exposed the limitations of existing legal frameworks in effectively addressing such emerging forms of cybercrime. Consequently, the incident became a turning point in the discussion surrounding AI regulation and digital safety in India.
CASE:- Anil Kapoor personality right
Delhi High Court granted personality rights protection to actor Anil Kapoor and restrained the unauthorized commercial use of his name, image, voice, likeness, and his famous catchphrase, “Jhakaas.” The Court recognized that a celebrity’s identity and reputation carry significant commercial value and deserve legal protection. It also expressed concerns about the growing misuse of Artificial Intelligence (AI), including deepfakes and face-morphing technologies, which can create realistic but misleading content using a person’s identity without consent. The judgment marked an important step in addressing the challenges posed
by emerging technologies and emphasized the need to protect individuals from digital impersonation and the unauthorized exploitation of their personality in the online environment. This case is particularly relevant in the context of deepfake technology, as it highlights the legal issues surrounding AI-generated content and reinforces the importance of safeguarding personality rights in the digital age.
Deepfake of Volodymyr Zelenskyy (2022)
During the Russia–Ukraine conflict in 2022, a deepfake video falsely portrayed Ukrainian President Volodymyr Zelenskyy urging Ukrainian soldiers to surrender to Russian forces. The video was circulated online and aimed to create confusion and weaken public morale. Although it was quickly identified as fake and removed from several platforms, the incident highlighted the growing dangers of deepfake technology. It demonstrated how AI-generated content can be used to spread misinformation, manipulate public opinion, and threaten national security during times of crisis. This case is widely cited as a significant example of the risks posed by deepfakes.
Comparative Analysis of Deepfake Regulations
Country/Region
Regulatory Approach
China:- Requirement to identify AI-generated content and hold platforms accountable.
European Union:- The AI Act requires clarity and the announcement of AI-created material. United States:- State laws regulate deepfakes associated with elections and those produced without authorization.
India:- There is no dedicated legislation addressing deepfakes; it relies on the IT Act of 2000 and the BNS of 2023.
Comparative Assessment and the Need for Stronger Regulation in India
Several countries have already taken steps to regulate deepfake technology. In the United States, some states have introduced laws targeting non-consensual and election-related deepfakes. China requires AI-generated content to be clearly labeled, while the European Union’s AI Act promotes transparency and accountability in the use of artificial intelligence.
India, however, does not yet have a dedicated law to regulate deepfakes. With the increasing misuse of AI-generated content, there is a growing need for stronger legal safeguards. To address this challenge, India should introduce specific legislation on deepfakes, require AI-generated content to be labeled, and hold social media platforms accountable for removing harmful content. The government should also establish specialized cybercrime units and AI forensic laboratories to investigate such offences. In addition, public awareness programs can help people identify and report deepfakes. These measures would help India effectively tackle the risks associated with deepfake technology while protecting privacy, security, and public trust.
Constitutional perspective on deepfakes
Deepfake technology not only creates cybersecurity concerns but also raises important constitutional issues. The misuse of AI-generated content can violate an individual’s right to privacy, dignity, reputation, and personal identity, which are protected under Article 21 of the Constitution of India. In the landmark case of Justice K. S. Puttaswamy v. Union of India, the Supreme Court recognized privacy as a fundamental right and emphasized the protection of personal information and identity. Deepfakes that manipulate a person’s image, voice, or likeness without consent can seriously harm these rights. At the same time, any regulation of
deepfakes must balance the freedom of speech and expression guaranteed under Article 19(1)(a).
Conclusion
Deepfake technology has become a major challenge in the digital era. While it offers several benefits in fields such as education, healthcare, and entertainment, its misuse can lead to serious issues including identity theft, financial fraud, misinformation, and privacy violations. The increasing use of AI-generated content highlights the need for stronger legal safeguards. Although existing laws such as the Information Technology Act, 2000 and the Bharatiya Nyaya Sanhita, 2023 provide some protection, they are not sufficient to address all deepfake-related concerns. Therefore, India needs a dedicated legal framework, supported by technological solutions and public awareness, to ensure the responsible use of artificial intelligence.
References
Statutes:-
- Information Technology Act, 2000.
- Bharatiya Nyaya Sanhita, 2023.
- Constitution of India, 1950.
Case Laws
- Justice K.S. Puttaswamy v. Union of India, (2017) 10 SCC 1.
- Anil Kapoor Personality Rights Case.
News Reports (for Case Studies)
- Reports relating to the Rashmika Mandanna Deepfake Incident (2023).
- Reports relating to the Deepfake Video of Volodymyr Zelenskyy (2022).
- News coverage of the Anil Kapoor Personality Rights Judgment (2023).
Web sources
https://www.indiacode.nic.in/bitstream/123456789/13116/1/it_act_2000_updated.pdf https://www.mha.gov.in/sites/default/files/250883_english_01042024.pdf https://indianexpress.com/article/cities/delhi/delhi-police-cognisance-rashmika-mandannas-d eepfa ke-video-probe-9022585/?utm_source=chatgpt.com https://www.newindianexpress.com/entertainment/hindi/2023/Sep/20/delhi-high-court-restrai ns-misuse-of-personality-attributes-of-actor-anil-kapoor-2616642.html?utm_source=chatgpt. com https://docs.google.com/document/d/1NVKCQAugpHtX93IAVHDKonkQr7sRAUYMlgieyh yva4 Y/edit?tab=t.0#heading=h.dx2e23y7a7wz
https://indiankanoon.org/doc/1199182/ https://indiankanoon.org/doc/127517806/
