AI said, She said - How Users Perceive Consumer Scoring in Practice
| dc.contributor.author | Recki, Lena | |
| dc.contributor.author | Esau-Held, Margarita | |
| dc.contributor.author | Lawo, Dennis | |
| dc.contributor.author | Stevens, Gunnar | |
| dc.contributor.editor | Stolze, Markus | |
| dc.contributor.editor | Loch, Frieder | |
| dc.contributor.editor | Baldauf, Matthias | |
| dc.contributor.editor | Alt, Florian | |
| dc.contributor.editor | Schneegass, Christina | |
| dc.contributor.editor | Kosch, Thomas | |
| dc.contributor.editor | Hirzle, Teresa | |
| dc.contributor.editor | Sadeghian, Shadan | |
| dc.contributor.editor | Draxler, Fiona | |
| dc.contributor.editor | Bektas, Kenan | |
| dc.contributor.editor | Lohan, Katrin | |
| dc.contributor.editor | Knierim, Pascal | |
| dc.date.accessioned | 2023-08-24T05:29:11Z | |
| dc.date.available | 2023-08-24T05:29:11Z | |
| dc.date.issued | 2023 | |
| dc.description.abstract | As digitization continues, consumers are increasingly exposed to AI’s scoring decisions. However, we lack a thorough understanding of how users' misjudgments lead to a rejection of the system. Therefore, we must investigate the appropriation of such socio-technical systems in practice and how users describe their experience with algorithm-based scoring. To address this issue, we evaluated 1003 user reviews of an app of car insurance that calculates its premium based on the consumers' individual driving behavior. We find evidence that users develop their own folk theories to explain the algorithms with the help of situation-related experiences and that insufficient explanations lead to power asymmetries between consumers, the system, and the company. In particular, we uncover a fundamental conflict between computational risk assessment and the perceived agency to influence the score as a result of the different needs of the stakeholders involved. | en |
| dc.description.uri | "https://dl.acm.org/doi/"&R14 | en |
| dc.identifier.doi | 10.1145/3603555.3603562 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/41979 | |
| dc.language.iso | en | |
| dc.publisher | ACM | |
| dc.relation.ispartof | Mensch und Computer 2023 - Tagungsband | |
| dc.relation.ispartofseries | Mensch und Computer | |
| dc.subject | Algorithmic Decision Making | |
| dc.subject | Fairness | |
| dc.subject | Perception | |
| dc.subject | Empirical study | |
| dc.subject | Explainable AI | |
| dc.title | AI said, She said - How Users Perceive Consumer Scoring in Practice | en |
| dc.type | Text/Conference Paper | |
| gi.citation.publisherPlace | New York | |
| gi.citation.startPage | 149-160 | |
| gi.conference.date | 3.-6. September 2023 | |
| gi.conference.location | Rapperswil | |
| gi.conference.sessiontitle | MCI-SE04: Security, Safety & Ethics |