Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithms

要旨

Across the United States, a growing number of school districts are turning to matching algorithms to assign students to public schools. The designers of these algorithms aimed to promote values such as transparency, equity, and community in the process. However, school districts have encountered practical challenges in their deployment. In fact, San Francisco Unified School District voted to stop using and completely redesign their student assignment algorithm because it was frustrating for families and it was not promoting educational equity in practice. We analyze this system using a Value Sensitive Design approach and find that one reason values are not met in practice is that the system relies on modeling assumptions about families’ priorities, constraints, and goals that clash with the real world. These assumptions overlook the complex barriers to ideal participation that many families face, particularly because of socioeconomic inequalities. We argue that direct, ongoing engagement with stakeholders is central to aligning algorithmic values with real world conditions. In doing so we must broaden how we evaluate algorithms while recognizing the limitations of purely algorithmic solutions in addressing complex socio-political problems.

著者
Samantha Robertson
University of California, Berkeley, Berkeley, California, United States
Tonya Nguyen
UC, Berkeley, Berkeley, California, United States
Niloufar Salehi
UC, Berkeley, Berkeley, California, United States
DOI

10.1145/3411764.3445748

論文URL

https://doi.org/10.1145/3411764.3445748

動画

会議: CHI 2021

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2021.acm.org/)

セッション: Justice / Critical Reflections on the Field / The Art of Making

[A] Paper Room 03, 2021-05-12 17:00:00~2021-05-12 19:00:00 / [B] Paper Room 03, 2021-05-13 01:00:00~2021-05-13 03:00:00 / [C] Paper Room 03, 2021-05-13 09:00:00~2021-05-13 11:00:00
Paper Room 03
12 件の発表
2021-05-12 17:00:00
2021-05-12 19:00:00
日本語まとめ
読み込み中…