Algorithmic discrimination and the intensification of structural racism: scoping review
DOI:
https://doi.org/10.59464/2359-4632.2024.3233Keywords:
Algorithmic Discrimination, Algorithmic Racism, Structural RacismAbstract
Objective: To map the status of scientific production of the relationship between discriminatory algorithms and human behavior for the intensification of structural racism. Methods: A scoping review was conducted using Scopus, Embase, PubMed, and Periodicals of Capes databases between September and October 2023. The descriptors "algorithmic discrimination," "racist algorithms," and "behavior" were used. Initially, 254 articles were identified, but only 6 were selected to compose the final sample. Results: The majority were theoretical articles, all developed by/or in collaboration with authors from the United States of America, published in English between 2019 and 2023, and belonged to the fields of Philosophy, Law, Health, Economics, and Informatics. In the analysis of the articles, six relevant topics of the problem discussion were identified: (1) The importance of adopting an anti-racist stance in the development and implementation of algorithms. (2) Racial algorithmic discrimination on the typing autocorrection feature. (3) Racial algorithmic discrimination in the financial sector. (4) Racial algorithmic discrimination in the judiciary system. (5) Racial algorithmic discrimination in health. Conclusion: The majority of studies addressing this theme are in the field of law, with a predominance of North American studies, highlighting the need to expand scientific production to other areas of knowledge and promote greater cultural and geographical representativity in scientific debate.
References
Almeida, S. Racismo estrutural. Pólen Produção Editorial LTDA, 2022.
Ambrose BW, Conklin JN, Lopez LA. Does borrower and broker race affect the cost of mortgage credit? The Review of Financial Studies. 2021;34(2):790–826. https://doi.org/10.1093/rfs/hhaa087
Bhutta N, Hizmo A. Do minorities pay more for mortgages? The Review of Financial Studies. 2021;34(2):763–789. https://doi.org/10.1093/rfs/hhaa047
Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006; 3(2):77-101. DOI: 10.1191/1478088706qp063oa
Cassino, J. F. O sul global e os desafios pós-coloniais na era digital. em Cassino J F, Silveira S A, organizadores. Colonialismo de dados: como opera a trincheira algorítmica na guerra neoliberal. São Paulo: Autonomia Literária. 2021. p. 13-32.
Dillbary JS, Edwards G. An empirical analysis of sexual orientation discrimination. The University of Chicago Law Review. 2019;86(1):1–76. Disponível em: https://www.jstor.org/stable/26554392
Dyal-Chand R. Autocorrecting for Whiteness. BUL Rev. 2021;101:191. Disponível em: https://heinonline.org/HOL/LandingPage?handle=he in.journals/bulr101&div=7&id=&page=
Fountain JE. The moon, the ghetto and artificial intelligence: Reducing systemic racism in computational algorithms. Government Information Quarterly. 2022;39(2):101645. https://doi.org/10.1016/j.giq.2021.101645.
Garcia ACB, Garcia MGP, Rigobon R. Algorithmic discrimination in the credit domain: what do we know about it? AI & SOCIETY. 2023;1-40. https://doi.org/10.1007/s00146-023-01676-3.
Graham S, Depp C, Lee EE, Nebeker C, Tu X, Kim HC, Jeste DV. Artificial intelligence for mental health and mental illnesses: an overview. Current psychiatry reports. 2019;21:1-18. https://doi.org/10.1007/s11920-019-1094-0.
Huq AZ. Racial equity in algorithmic criminal justice. Duke LJ. 2018;68:1043. Disponível em: https://scholarship.law.duke.edu/dlj/vol68/iss6/1/.
Jain A, Brooks JR, Alford CC, Chang CS, Mueller NM, Umscheid CA, Bierman AS. Awareness of Racial and Ethnic Bias and Potential Solutions to Address Bias With Use of Health Care Algorithms. JAMA Health Forum. 2023;4(6):e231197. doi:10.1001/jamahealthforum.2023.1197.
Kassam A, Marino P. Algorithmic Racial Discrimination: A Social Impact Approach. Feminist Philosophy Quarterly. 2022;8(3/4). Disponível em: https://ojs.lib.uwo.ca/index.php/fpq/article/view/14 275
Lawson SG, Lowder EM. Differential Prediction by Race in IRAS-PAT Assessments: An Application of Debiasing Strategies. Justice Quarterly. 2023;40(4):451-477. https://doi.org/10.1080/07418825.2022.2086481.
Lima, BEM, Lima, C. F. Racismo algorítmico: vivências e percepções de influenciadores (as) digitais negros (as). Revista África e Africanidades. 2023; ed. 47-48. Disponível em: https://africaeafricanidades.com.br/documentos/AR TLIV03_ed.47-48.pdf
Loya J. Racial stratification among latinos in the mortgage market. Race Soc Probl. 2022;14(1):39–52. https://doi.org/10.1007/s12552-021-09326-3
Noble, SU. Algoritmos da opressão: Como os mecanismos de busca reforçam o racismo. Editora Rua do Sabão, 2022.
Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Systematic reviews. 2016; 5:1- 10.5:210, DOI: 10.1186/s13643-016-0384-4.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., & Moher, D. A declaração PRISMA 2020: diretriz atualizada para relatar revisões sistemáticas. Pan American Journal of Public Health, 2022; 46(12), 9. http://dx.doi.org/10.1590/s1679-49742022000200033
Sánchez EAT. El desafío de la Inteligencia Artificial a la vigencia de los derechos fundamentales. Cuadernos Electrónicos de Filosofía del Derecho. 2023. https://doi.org/10.7203/CEFD.48.25863.
Schwab K. The fourth industrial revolution. First. New York, NY: Currency. 2017.
Schwarting R, Ulbricht L. Why Organization Matters in “Algorithmic Discrimination”. KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie. 2022;74(Suppl 1):307-330. https://doi.org/10.1007/s11577-022-00838-3
Silveira, SAD. A hipótese do colonialismo de dados e o neoliberalismo. em Cassino J F, Silveira S A, organizadores. Colonialismo de dados: como opera a trincheira algorítmica na guerra neoliberal. São Paulo: Autonomia Literária, 2021. p. 33-52
Vincent GM, Viljoen JL. Racist algorithms or systemic problems? Risk assessments and racial disparities. Criminal Justice and Behavior. 2020;47(12):1576–1584. https://doi.org/10.1177/0093854820954501.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Revista Científica Integrada
This work is licensed under a Creative Commons Attribution 4.0 International License.
