Biased by Design? Case Managers' Multidimensional Preferences Toward the Design of Algorithmic Decision Support Systems

Original

Biased by Design? Case Managers' Multidimensional Preferences Toward the Design of Algorithmic Decision Support Systems

Martin Dietz, Christopher Osiander, Mareike Sirman‐Winkler, Markus Tepe

Abstract

ABSTRACT This study examines whether street‐level bureaucrats' preferences toward algorithmic decision support (ADS) induce a unilateral shift of technology‐related risks onto clients of the public employment service. Expanding on public value theory and research on moral agency in public service work, we argue that case managers' choices of ADS designs are shaped by a plurality of professional, service, and efficiency values. To test this argument, we conducted a conjoint experiment on a representative sample of German Federal Employment Agency case managers. Respondents compared pairs of hypothetical ADS systems that differed in their design features, reflecting varying degrees of the realization of public values. The empirical results indicate that case managers' choices do not result in biased design. Instead, case managers balance design features reflecting professional and service values while maintaining administrative efficiency. Case managers appreciate ADS support but firmly reject the mandatory use of such advice.