European Commission proposes criminalizing AI-powered child abuse

The European Commission has announced plans to update laws by considering the criminalization of artificial intelligence (AI)-generated imagery and deepfakes depicting child sexual abuse (CSA), in response to technological advancements.

Key Proposals:

Introduction of New Criminal Offenses: The proposal includes creating a new criminal offense targeting the live-streaming of child sexual abuse and aims to criminalize the possession and exchange of “pedophile manuals.” It also addresses concerns related to AI chatbots used for child abuse.

Updates to Existing Rules: The commission seeks to update 2011 regulations, suggesting changes to mandatory reporting of offenses. These measures are part of a broader package aimed at preventing child sexual abuse, increasing online risk awareness, facilitating crime reporting for victims, and providing support, including financial compensation.

Focus on Technological Developments: The commission’s impact assessment highlighted the role of increased online presence and advancements in technology in facilitating child sexual abuse. The proposal encourages member states to invest in awareness-raising efforts to address online safety risks for children.

Decision Making: The final form of the proposals will be determined through the ordinary legislative procedure involving the European Parliament and the European Council. Upon agreement on amending the current directive on combating CSA, the changes would come into effect 20 days after publication in the Official Journal of the EU.

Complementary Measures: The current proposal aligns with additional legislation proposed in May 2022, focusing on digital services’ obligations to detect and report CSAM and identify grooming activity targeting children.

Increasing Awareness and Concerns:

Growing Concerns: There has been a significant increase in awareness of the dangers posed by deepfakes and AI-generated images in less than two years since the introduction of the private message scanning proposal.

The European Commission’s proposals reflect efforts to address emerging challenges related to child sexual abuse facilitated by technological advancements. By criminalizing AI-generated imagery and deepfakes depicting CSA, the commission aims to enhance protection measures for children and strengthen responses to online exploitation.