Logo des Repositoriums

Auflistung nach Autor:in "Recki, Lena"

1 - 2 von 2
  • Workshopbeitrag
    A Qualitative Exploration of User-Perceived Risks of AI to Inform Design and Policy
    (Mensch und Computer 2023 - Workshopband, 2023) Recki, Lena; Lawo, Dennis; Krauss, Veronika; Pins, Dominik
    AI systems pose unknown challenges for designers, policymakers, and users which aggravates the assessment of potential harms and outcomes. Although understanding risks is a requirement for building trust in technology, users are often excluded from legal assessments and explanations of AI hazards. To address this issue we conducted three focus groups with 18 participants in total and discussed the European proposal for a legal framework for AI. Based on this, we aim to build a (conceptual) model that guides policymakers, designers, and researchers in understanding users’ risk perception of AI systems. In this paper, we provide selected examples based on our preliminary results. Moreover, we argue for the benefits of such a perspective.
  • Konferenzbeitrag
    AI said, She said - How Users Perceive Consumer Scoring in Practice
    (Mensch und Computer 2023 - Tagungsband, 2023) Recki, Lena; Esau-Held, Margarita; Lawo, Dennis; Stevens, Gunnar
    As digitization continues, consumers are increasingly exposed to AI’s scoring decisions. However, we lack a thorough understanding of how users' misjudgments lead to a rejection of the system. Therefore, we must investigate the appropriation of such socio-technical systems in practice and how users describe their experience with algorithm-based scoring. To address this issue, we evaluated 1003 user reviews of an app of car insurance that calculates its premium based on the consumers' individual driving behavior. We find evidence that users develop their own folk theories to explain the algorithms with the help of situation-related experiences and that insufficient explanations lead to power asymmetries between consumers, the system, and the company. In particular, we uncover a fundamental conflict between computational risk assessment and the perceived agency to influence the score as a result of the different needs of the stakeholders involved.