Automation, Algorithms, and Politics | When the Algorithm Itself is a Racist: Diagnosing Ethical Harm in the Basic Components of Software

Authors

  • Christian Sandvig University of Michigan
  • Kevin Hamilton University of Illinois, Urbana-Champaign
  • Karrie Karahalios University of Illinois, Urbana-Champaign
  • Cedric Langbort University of Illinois, Urbana-Champaign

Keywords:

applied ethics, information and communication technologies (ICT), science and technology studies (STS), Internet studies, algorithms

Abstract

Computer algorithms organize and select information across a wide range of applications and industries, from search results to social media. Abuses of power by Internet platforms have led to calls for algorithm transparency and regulation. Algorithms have a particularly problematic history of processing information about race. Yet some analysts have warned that foundational computer algorithms are not useful subjects for ethical or normative analysis due to complexity, secrecy, technical character, or generality. We respond by investigating what it is an analyst needs to know to determine whether the algorithm in a computer system is improper, unethical, or illegal in itself. We argue that an “algorithmic ethics” can analyze a particular published algorithm. We explain the importance of developing a practical algorithmic ethics that addresses virtues, consequences, and norms: We increasingly delegate authority to algorithms, and they are fast becoming obscure but important elements of social structure.

Author Biographies

Christian Sandvig, University of Michigan

Associate Professor

Kevin Hamilton, University of Illinois, Urbana-Champaign

Professor

Karrie Karahalios, University of Illinois, Urbana-Champaign

Associate Professor

Cedric Langbort, University of Illinois, Urbana-Champaign

Associate Professor

Downloads

Published

2016-10-12

Issue

Section

Special Sections