Logo des Repositoriums
 

Increasing Large Language Models Context Awareness through Nonverbal Cues

Kurzanzeige
dc.contributor.authorSchmidmaier, Matthias
dc.contributor.authorHarrich, Cedrik
dc.contributor.authorMayer, Sven
dc.date.accessioned2024-08-21T11:08:38Z
dc.date.available2024-08-21T11:08:38Z
dc.date.issued2024
dc.description.abstractToday, interaction with LLM-based agents is mainly based on text or voice interaction. Currently, we explore how nonverbal cues and affective information can augment this interaction in order to create empathic, context-aware agents. For that, we extend user prompts with input from different modalities and varying levels of abstraction. In detail, we investigate the potential of extending the input into LLMs beyond text or voice, similar to human-human interaction in which humans not only rely on the simple text that was uttered by a conversion partner but also on nonverbal cues. As a result, we envision that cameras can pick up facial expressions from the user, which can then be fed into the LLM communication as an additional input channel fostering context awareness. In this work we introduce our application ideas and implementations, preliminary findings, and discuss arising challenges.en
dc.identifier.doi10.18420/muc2024-mci-ws09-190
dc.identifier.urihttps://dl.gi.de/handle/20.500.12116/44317
dc.language.isoen
dc.publisherGesellschaft für Informatik e.V.
dc.relation.ispartofMensch und Computer 2024 - Workshopband
dc.relation.ispartofseriesMensch und Computer
dc.rightshttps://creativecommons.org/licenses/by/4.0/
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleIncreasing Large Language Models Context Awareness through Nonverbal Cuesen
dc.typeText/Workshop Paper
gi.conference.date1.-4. September 2024
gi.conference.locationKarlsruhe
gi.conference.sessiontitleMCI-WS09: Workshop on Generative Artificial Intelligence in Interactive Systems: Experiences from the Community

Dateien

Originalbündel
1 - 1 von 1
Vorschaubild
Name:
muc2024-mci-ws09-190.pdf
Größe:
489.8 KB
Format:
Adobe Portable Document Format
Herunterladen

Sammlungen

Workshopband MuC 2024