Logo des Repositoriums
 

User-Centered Evaluation of Machine Learning vs. Human Decisions – Identifying Emotional Highlights in Reality TV Formats

Kurzanzeige
dc.contributor.authorRossner, Alexander
dc.contributor.authorPagel, Sven
dc.contributor.authorDörner, Ralf
dc.date.accessioned2023-08-24T06:24:30Z
dc.date.available2023-08-24T06:24:30Z
dc.date.issued2023
dc.description.abstractThis research paper examines a user-centered evaluation approach of artificial intelligence (AI) systems in the context of identifying emotional highlight scenes in reality TV formats. The study investigates the accuracy and reliability of AI compared to humans in identifying these highlights and explores viewers’ ability to distinct human versus AI-assisted decisions. Internal user tests with media company employees (enterprise users) demonstrate that the AI algorithm developed in the AI4MediaData research project achieves a high level of accuracy, closely aligning with human editors’ assessments. External user tests with viewers (consumers) reveal that participants are unable to distinguish whether highlight clips were identified by humans or by an AI. These findings emphasize the importance of user-centered evaluations that go beyond algorithm-centered evaluations to ensure useful AI-based systems. The research contributes to the advancement of Human-Centered Artificial Intelligence (HCAI) by considering both cognitive and emotional elements in AI-assisted decision-making.en
dc.identifier.doi10.18420/muc2023-mci-ws16-393
dc.identifier.urihttps://dl.gi.de/handle/20.500.12116/42145
dc.publisherGI
dc.relation.ispartofMensch und Computer 2023 - Workshopband
dc.relation.ispartofseriesMensch und Computer
dc.titleUser-Centered Evaluation of Machine Learning vs. Human Decisions – Identifying Emotional Highlights in Reality TV Formatsen
dc.typeText/Workshop Paper
gi.conference.date3.-6. September 2023
gi.conference.locationRapperswil
gi.conference.sessiontitleMCI-WS16 - UCAI 2023: Workshop on User-Centered Artificial Intelligence

Dateien

Originalbündel
1 - 1 von 1
Vorschaubild
Name:
muc23-mci-ws16-393.pdf
Größe:
408.76 KB
Format:
Adobe Portable Document Format
Herunterladen

Sammlungen

Workshopband MuC 2023