Engineering A Reliable Prompt For Generating Unit Tests - Prompt engineering for QA & QA for prompt engineering
| dc.contributor.author | Faragó, David | |
| dc.contributor.editor | Herrmann, Andrea | |
| dc.date.accessioned | 2024-02-05T10:39:26Z | |
| dc.date.available | 2024-02-05T10:39:26Z | |
| dc.date.issued | 2023 | |
| dc.description.abstract | This paper demonstrates Prompt Engineering (PE) on a running example: generating unit test cases for a given function. By iter atively adding further prompt patterns and measuring the robustness, correctness, and comprehensiveness of the AI’s output, multiple prompt patterns and their purpose and strength are investigated. We conclude that high robustness, correctness, and comprehensiveness is hard to achieve, and many prompt patterns (single prompt as well as patterns that span over a conversation) are necessary. More generally, quality assurance is a dominant part of PE and closely intertwined with the development part of PE. Thus traditional testing processes and stages do not adequately apply to QA for PE, and we suggest a PE process that covers the development and quality assurance of prompts as alternative. | en |
| dc.identifier.issn | 0720-8928 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/43480 | |
| dc.language.iso | en | |
| dc.pubPlace | Bonn | |
| dc.publisher | Gesellschaft für Informatik e.V. | |
| dc.relation.ispartof | Softwaretechnik-Trends Band 43, Heft 3 | |
| dc.relation.ispartofseries | Softwaretechnik-Trends | |
| dc.subject | prompt engineering | |
| dc.subject | test generation | |
| dc.subject | Large Language Models | |
| dc.subject | quality | |
| dc.title | Engineering A Reliable Prompt For Generating Unit Tests - Prompt engineering for QA & QA for prompt engineering | en |
| dc.type | Text/Conference Paper | |
| mci.conference.date | 15.-16.06.2023 | |
| mci.conference.location | Paderborn, Germany | |
| mci.conference.sessiontitle | Treffen der GI-Fachgruppe Test, Analyse und Verifikation von Software (TAV 48) | |
| mci.reference.pages | 10-14 |
Dateien
Originalbündel
1 - 1 von 1