AI Act: safer AI and an end to mass surveillance?

In 2024, the European Parliament adopted the AI Act, the world’s first law to regulate artificial intelligence. AI poses numerous risks to citizens, such as bias or automated discrimination. As Renew’s lead negotiator on the AI Act in the Legal Affairs committee, I fought hard to protect citizens’ fundamental rights. The AI Act is the world’s first transversal law on Artificial Intelligence, and it will likely inspire similar legislation around the world. 

An end to mass surveillance?

The Commission’s original proposal included a ban on biometric mass surveillance, a technique that scans citizens’ faces to track them, but it was riddled with loopholes that allowed governments to exploit it. We took a stand and closed these loopholes, ensuring that governments and police must have a mandate before using tracking, and cannot use it indiscriminately to spy on all citizens. This is a significant step in protecting citizens’ privacy and rights.

A right to an explanation and to recourse

Another key aspect of the AI Act is the creation of new rights for citizens. These include the right to an explanation of AI-powered decisions, the right to be informed about the use of AI, and the right to complain and seek recourse either as an individual or as a group. These rights are designed to empower citizens affected by AI decisions, giving them the opportunity to understand and challenge these decisions, and thereby uphold their rights.

A ban on dangerous practices

I also campaigned heavily to ban dangerous AI practices, such as predictive policing and purposefully manipulative AI, as well as pseudo-scientific practices like emotional recognition and AI used to categorise people on the basis of race, political opinions, trade union membership, religious or philosophical beliefs, sex life or sexual orientation.