Tackling Deepfakes in the new AI Legislative Framework
- Project team:
Jahnel, Jutta (Project leader); Linda Nierling, Leonhard Hennen
- Funding:
STOA (The Science Technology Options Assessment Panel of the European Parliament)
- Start date:
2020
- End date:
2021
- Project partners:
Rathenau Instituut (coordinator), Fraunhofer Institute for Systems and Innovation Research (ISI), Technology Centre CAS
- Research group:
Project description
The term “deepfake” is a combination of the terms “deep learning” and “fake” and refers to seemingly realistic media content (photo, audio, and video) which is altered and/or falsified by artificial intelligence techniques. The manipulation of media is not a new phenomenon in itself, but deepfakes use methods of machine learning and artificial neural networks to create fakes largely autonomously. Furthermore, easy-to-use and inexpensive software and apps support the spread of such products and services. In addition, the increasingly visual-based media consumption and the digital penetration of everyday life are leading to an intensification of this new phenomenon.
While there are certainly useful applications of deepfakes in the fields of education, art, and medicine, there are a number of risks, especially in the field of public opinion formation: These are not only on the individual level, but can also have an impact on society as a whole due to the potential disinformation and influence on democratic processes.
The project will conduct a literature review and expert interviews to examine deepfake techniques, future application scenarios, and their economic, social, ethical, and legal implications. Based on the results, it will then develop a set of policy options that are relevant to the committees of the European Parliament, including the new Special Committee on Artificial Intelligence in a Digital Age (AIDA), and relate to the current activities of the European Commission. In its White Paper, the European Commission has presented a framework for a future legislative proposal to tackle the risks posed by artificial intelligence.
Based on expert interviews with relevant stakeholders from academia, NGOs, and companies, the ITAS team will focus on the social, ethical, and legal aspects of deepfake technologies. It will analyze impacts on individuals, on important sectors and areas such as social media, but also consequences for society as a whole in terms of erosion of trust in information. In addition, ITAS will address the social and ethical dimensions of deepfakes and related policy options.
The results of this project will also feed into another project of the University of Graz in cooperation with ITAS: “How disinformation is shaking up democracy”. The project aims to communicate which strategies the EU is pursuing against fake news and disinformation and what we can all do against the spread of false news. In addition, a discussion forum with citizens from Graz and Karlsruhe will be offered.
- Fake News & Democracy - Citizens' Forum | Facebook (Facebook group for the debates of the Citizens' Forum)
- Fake News & Democracy - Citizens Forum | Facebook (Facebook event for the opening event on Monday 31.05.21)
Publications
KI in der Digitalen Kommunikation
2022. Medien Triennale Südwest "KI & Medien gemeinsam gestalten" (#MTSW 2022), Saarbrücken, Germany, October 12, 2022
Deepfakes & Co: Digital misinformation as a challenge for democratic societies
2022. 5th European Technology Assessment Conference "Digital Future(s). TA in and for a Changing World" (ETAC 2022), Karlsruhe, Germany, July 25–27, 2022
Über die Folgen von perfekten Täuschungen und die Herausforderungen für eine multidimensionale Regulierung
2022. "Wie viel Wahrheit vertragen wir?" - Ringvorlesung / Universität Köln (2022), Online, June 28, 2022
Deepfakes: die Kehrseite der Kommunikationsfreiheit
2022. Gastvortrag Universität Graz, Siebente Fakultät (2022), Online, June 1, 2022
Deepfakes in the context of digital disinformation – actors, risks and a case for AI-regulation in Europe
2022. Flame-University, Centre for Economics and Public Policy (2022), Pune, India, March 14, 2022
Tackling deepfakes in European policy
2021. European Parliament Think Tank
Herausforderungen bei der Regulierung von Deepfakes
2021. Fachkonferenz „Vertrauen im Zeitalter KI-gestützter Bots und Fakes: Herausforderungen und mögliche Lösungen“ (2021), Online, November 4, 2021
Fakten, Fakes, Deep fakes? Die Rolle von KI in der öffentlichen Meinungsbildung
2021. KIT-Alumni Talk (2021), Online, November 16, 2021
Deepfakes im Kontext digitaler Desinformation – Akteure, Folgen und Handlungsoptionen
2021. Künstliche Intelligenz und Governance (2021), Online, November 4–5, 2021
Contact
Karlsruhe Institute of Technology (KIT)
Institute for Technology Assessment and Systems Analysis (ITAS)
P.O. Box 3640
76021 Karlsruhe
Germany
Tel.: +49 721 608-26133
E-mail