Thimm, HeikoWohlgemuth, VolkerKranzlmüller, DieterHöb, Maximilian2023-12-152023-12-152023978-3-88579-736-4https://dl.gi.de/handle/20.500.12116/43334In multiple research disciplines use cases built on Large Language Models in particular ChatGPT are at the centre of today’s discussions. For example, in various ongoing projects of the LegalTech area ChatGPT is evaluated in terms of its potential to replace routine work of lawyers. In a recently started project we are investigating the use of ChatGPT for a specific corporate compliance management task. In particular, based on a real-world test data set ChatGPT is prompted to assess the relevance of environmental regulations. The ChatGPT output is compared to the respective judgements of the human experts in order to obtain a first indication of the assessment power of ChatGPT in the compliance management domain. This research in progress article gives an overview of the evaluation approach and presents first results of a set of 142 test cases covering regulations from four different areas of environmental legislation.enEnvironmental LegislationCorporate Environmental Compliance ManagementGenerative Artificial IntelligenceLarge Language ModelsText/Conference Paper10.18420/env2023-0141617-5468