Logo des Repositoriums
 

Online Exams in the Era of ChatGPT

Kurzanzeige
dc.contributor.authorBuchmann, Erik
dc.contributor.authorThor, Andreas
dc.contributor.editorRöpke, René
dc.contributor.editorSchroeder, Ulrik
dc.date.accessioned2023-08-30T09:09:41Z
dc.date.available2023-08-30T09:09:41Z
dc.date.issued2023
dc.description.abstractRecent versions of ChatGPT demonstrate an amazing ability to answer difficult questions in natural languages on a wide range of topics. This puts homeworks or online exams at risk, where a student can simply forward a question to the chatbot and copy its answers. We have tested ChatGPT with three of our exams, to find out which kinds of exam questions are still difficult for a generative AI. Therefore, we categorized exam questions according to a knowledge taxonomy, and we analyze the wrong answers in each category. To our surprise, ChatGPT even performed well with procedural knowledge, and it earned a grade of 2.7 (B-) in the IT Security exam. However, we also observed five options to formulate questions that ChatGPT struggles with.en
dc.identifier.doi10.18420/delfi2023-15
dc.identifier.isbn978-3-88579-732-6
dc.identifier.pissn1617-5468
dc.identifier.urihttps://dl.gi.de/handle/20.500.12116/42240
dc.language.isoen
dc.publisherGesellschaft für Informatik e.V.
dc.relation.ispartof21. Fachtagung Bildungstechnologien (DELFI)
dc.relation.ispartofseriesLecture Notes in Informatics (LNI) - Proceedings, Volume P-322
dc.subjectOnline Exams
dc.subjectChatGPT
dc.titleOnline Exams in the Era of ChatGPTen
dc.typeText/Conference Paper
gi.citation.endPage84
gi.citation.publisherPlaceBonn
gi.citation.startPage79
gi.conference.date11.-13. September 2023
gi.conference.locationAachen
gi.conference.reviewfull
gi.conference.sessiontitleE-Assessment und Feedback

Dateien

Originalbündel
1 - 1 von 1
Vorschaubild nicht verfügbar
Name:
15.pdf
Größe:
490.77 KB
Format:
Adobe Portable Document Format
Herunterladen

Sammlungen

P338 - DELFI 2023 - Die 21. Fachtagung Bildungstechnologien
DELFI 2023