Risks of discrimination by algorithms
- Project team:
Orwat, Carsten (Project leader); Reinhard Heil, Oliver Siemoneit
- Funding:
Federal Anti-Discrimination Agency
- Start date:
2018
- End date:
2018
- Research group:
Project description
Nowadays, digital information and communication technologies permeate almost all areas of life and generate extensive volumes of data, which could also be applied for automated decision making about individuals using advanced methods of data processing and analysis.
In this context, rules for social interactions, behavioral steering, and decision making are increasingly embedded in software, automatically enforced, and technically implemented. On the one hand, this may contribute to preventing human errors and biases in decision making. On the other hand, it may increase the risks of discrimination of protected groups and new types of discriminations may emerge.
The research project collected and analyzed cases where discrimination has become known involving algorithms, data sets, operators or users in order to identify causes, contexts, types and dimensions of discrimination and discrimination risks. This included questions relating to self-determination, justice, fairness, responsibility or data protection.
Based on this, options for action were derived and discussed, inter alia in comparison with existing legal frameworks. The project was funded by the Federal Anti-Discrimination Agency for a period of one year.
Publications
Algorithmische Differenzierung und Diskriminierung aus Sicht der Menschenwürde
2024. Künstliche Intelligenz und ethische Verantwortung. Hrsg.: M. Reder, 141–166, transcript Verlag. doi:10.14361/9783839469057-009
Künstliche Intelligenz, Diskriminierungsrisiken und Auswirkungen auf die Menschenwürde
2024. KIT Gründerschmiede Community Congress (2024), Karlsruhe, Germany, March 21, 2024
Risks of Discrimination through the Use of Algorithms. A study compiled with a grant from the Federal Anti-Discrimination Agency
2020. Federal Anti-Discrimination Agency. doi:10.5445/IR/1000123477
Diskriminierungsrisiken durch Verwendung von Algorithmen
2020. Fachgespräch "Diskriminierungsrisiken durch Verwendung von Algorithmen – Interventionsmöglichkeiten, Schutzlücken sowie die Rolle von Antidiskriminierungsstellen" der Antidiskriminierungsstelle des Bundes (2019), Berlin, Germany, September 16, 2019
Diskriminierungsrisiken durch Verwendung von Algorithmen : Eine Studie erstellt mit einer Zuwendung der Antidiskriminierungsstelle des Bundes
2019. Nomos Verlagsgesellschaft
Dürfen Algorithmen über Leben und Tod entscheiden?
2019. DIGITAL X (2019), Cologne, Germany, October 29–30, 2019
Contact
Karlsruhe Institute of Technology (KIT)
Institute for Technology Assessment and Systems Analysis (ITAS)
P.O. Box 3640
76021 Karlsruhe
Germany
Tel.: +49 721 608-26116
E-mail