Are We Asking the Right Questions?: Designing for Community Stakeholders’ Interactions with AI in Policing

要旨

Research into recidivism risk prediction in the criminal justice system has garnered significant attention from HCI, critical algorithm studies, and the emerging field of human-AI decision-making. This study focuses on algorithmic crime mapping, a prevalent yet underexplored form of algorithmic decision support (ADS) in this context. We conducted experiments and follow-up interviews with 60 participants, including community members, technical experts, and law enforcement agents (LEAs), to explore how lived experiences, technical knowledge, and domain expertise shape interactions with the ADS, impacting human-AI decision-making. Surprisingly, we found that domain experts (LEAs) often exhibited anchoring bias, readily accepting and engaging with the first crime map presented to them. Conversely, community members and technical experts were more inclined to engage with the tool, adjust controls, and generate different maps. Our findings highlight that all three stakeholders were able to provide critical feedback regarding AI design and use - community members questioned the core motivation of the tool, technical experts drew attention to the elastic nature of data science practice, and LEAs suggested redesign pathways such that the tool could complement their domain expertise.

著者
Md Romael Haque
Marquette University, Milwaukee, Wisconsin, United States
Devansh Saxena
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Katy Weathington
University of Colorado Boulder, Boulder, Colorado, United States
Joseph Chudzik
University of Chicago, Chicago, Illinois, United States
Shion Guha
University of Toronto, Toronto, Ontario, Canada
論文URL

doi.org/10.1145/3613904.3642738

動画

会議: CHI 2024

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2024.acm.org/)

セッション: Evaluating AI Technologies A

321
5 件の発表
2024-05-15 01:00:00
2024-05-15 02:20:00