Governance of and by Algorithms (GOAL)

  • Project team:

    Grunwald, Armin (Project spokesperson ITAS); Carsten Orwat (Project leader ITAS); Christian Wadephul; Anja Folberth; Jascha Bareis

  • Funding:

    Federal Ministry of Education and Research

  • Start date:

    2019

  • End date:

    2021

  • Project partners:

    Westfälische Wilhelms-Universität Münster, Institut für Informations-, Telekommunikations- und Medienrecht – Zivilrechtliche Abteilung (Institute for Information, Telecommunications and Media Law – Civil Law Department); Universität Hamburg, Fakultät für Mathematik, Informatik und Naturwissenschaften, Lehrstuhl für Ethik in der Informationstechnologie (Faculty of Mathematics, Informatics and Natural Sciences, Chair of Ethics in Information Technology); Ruhr-Universität Bochum, Fakultät für Wirtschaftswissenschaft, Lehrstuhl für Makroökonomik (Faculty of Economics, Chair of Macroeconomics); Technische Universität Kaiserslautern, Department of Computer Science, Algorithmic Accountability Lab

  • Research group:

    Digital Technologies and Societal Change

Project description

Algorithms are no longer used only for automated data processing and information and knowledge generation, but are also increasingly becoming core elements of systems for automated decision support and execution of decisions. This includes decisions that have a significant influence on people’s way of living and their opportunities for free personal development and – as decisions on differentiation of individuals – raise questions of justice and equal treatment. Likewise, algorithms or the software systems containing them are used for behavioral control and thus themselves have a regulatory effect, a development which is discussed under the keywords “algorithmic regulation” or “governance by algorithms.”

The project aims to investigate possible needs for and approaches to governance, options for action or forms of regulation relating to the consequences of the use of algorithms, especially artificial intelligence. The options for actions are derived from the analysis of the risks to the realization of social values arising from the use of algorithms, such as the threat to informational self-determination, discrimination risks, and thus questions of justice and equal treatment or the threat to the rule of law. Further foundations are provided by investigations on different application types of algorithms that are considered particularly risky, as well as on the possibilities of realizing social values in the development and application of algorithms. In addition, existing governance structures are reviewed with respect to gaps in protection or regulatory problems.

The project’s work focuses on the further development of complex governance structures and on the functioning interaction of different areas, instruments, and forms of regulation as well as on the legitimacy and capability of development of the emerging governance structures. The study of algorithm- and data-based instruments for behavioral control will also examine in more detail the potential opportunities and limitations of governance through technology within complex institutional arrangements.

Project website: https://goal-projekt.de

Publications


2024
Journal Articles
Orwat, C.; Bareis, J.; Folberth, A.; Jahnel, J.; Wadephul, C.
Normative Challenges of Risk Regulation of Artificial Intelligence
2024. NanoEthics, 18 (2), Art.-Nr.: 11. doi:10.1007/s11569-024-00454-9 Full textFull text of the publication as PDF document 
2022
Book Chapters
Grunwald, A.
Verantwortliche Gestaltung von KI-Systemen: Ethik, Recht und Technikfolgenabschätzung
2022. Künstliche Intelligenz – Ethik und Recht.. Hrsg. von Thomas Hoeren, Stefan Pinelli, 45–66, Verlag C.H.Beck 
Orwat, C.; Bareis, J.; Folberth, A.; Jahnel, J.; Wadephul, C.
Risikoregulierung von künstlicher Intelligenz und automatisierten Entscheidungen
2022. Künstliche Intelligenz - Ethik und Recht. Hrsg. von Thomas Hoeren, Stefan Pinelli, 255–287, Verlag C.H.Beck 
Reports/Preprints
Folberth, A.; Jahnel, J.; Bareis, J.; Orwat, C.; Wadephul, C.
Tackling problems, harvesting benefits: A systematic review of the regulatory debate around AI
2022. Karlsruher Institut für Technologie (KIT). doi:10.5445/IR/1000150432 Full textFull text of the publication as PDF document 
2021
Presentations
Bareis, J.; Folberth, A.
Looking for justice in fairness. Filling the normative gaps in the regulatory discussion of algorithmic decision-making systems
2021. CEPE/IACAP Joint Conference (2021), Online, July 5–9, 2021 
Folberth, A.
Grundrechtliche und datenschutzrechtliche Aspekte der KI-basierten Videoüberwachung
2021. Videoüberwachung mit KI Unterstützung - funktioniert Sicherheit durch Überwachung? (2021), Online, February 13, 2021 
Orwat, C.
Diskriminierungsrisiken durch Verwendung von Algorithmen
2021. Demokratie im Gespräch: „Computer sagt Nein“? Diskriminierungsrisiken durch algorithmische Entscheidungssysteme (2021), Online, July 21, 2021 
Orwat, C.
Risk Regulation of Artificial Intelligence and Automated Decision-Making Systems
2021. KI und Governance - Workshop Tongji University/KIT (2021), Online, November 4–5, 2021 
Orwat, C.
Diskriminierungsrisiken durch Algorithmen
2021. Summer School "Governance von und durch Algorithmen" (GOAL 2021), Online, June 23–24, 2021 
Orwat, C.; Bareis, J.; Folberth, A.; Jahnel, J.; Wadephul, C.
Risk Regulation of Artificial Intelligence and Automated Decision-Making Systems
2021. International Workshop “Governance of and by Algorithms" (GOAL 2021), Online, April 9, 2021 
2020
Presentations
Bareis, J.
Militärische KI: Sprachspiele der Autonomie und ihre politischen Folgen [Military AI: Language games of autonomy and their political consequences]
2020. Philosophie der KI - Darmstädter Workshop (2020), Darmstadt, Germany, February 21, 2020 
Bareis, J.; Bächle, T. C.
Sociotechnical weapons: AI myths as national power play
2020. Locating and Timing Matters: Significance and agency of STS in emerging worlds (EASST/4S 2020), Online, August 18–21, 2020 
Folberth, A.; Bareis, J.; Orwat, C.; Wadephul, C.; Jahnel, J.
Normative Entscheidungen in der risiko-basierten Regulierung von KI und AES: Eine Erweiterung algorithmischer Fairness in der Risikodebatte
2020. Summer School des Projekts "Governance von und durch Algorithmen" (GOAL 2020), Online, June 23–24, 2020 
Orwat, C.
Die Macht der Algorithmen - Ethische Grenzen, Schutz vor Diskriminierung und Datenschutz? Impulsvortrag und Diskussion
2020. 9., Teil II Was bringt die Zukunft? Glokale Trends des 21. Jahrhunderts : Mensch und Technik (2020), Online, December 2, 2020 
Orwat, C.
Diskriminierungsrisiken durch Verwendung von Algorithmen
2020. Summer School des Projekts "Governance von und durch Algorithmen" (GOAL 2020), Online, June 23–24, 2020 

Contact

Dr. Carsten Orwat
Karlsruhe Institute of Technology (KIT)
Institute for Technology Assessment and Systems Analysis (ITAS)
P.O. Box 3640
76021 Karlsruhe
Germany

Tel.: +49 721 608-26116
E-mail