Show simple item record

dc.contributor.authorTichy, Walter F.
dc.contributor.authorLandhäußer, Mathias
dc.contributor.authorKörner, Sven J.
dc.contributor.editorAßmann, Uwe
dc.contributor.editorDemuth, Birgit
dc.contributor.editorSpitta, Thorsten
dc.contributor.editorPüschel, Georg
dc.contributor.editorKaiser, Ronny
dc.date.accessioned2017-06-30T20:56:18Z
dc.date.available2017-06-30T20:56:18Z
dc.date.issued2015
dc.identifier.isbn978-3-88579-633-6
dc.identifier.issn1617-5468
dc.description.abstractWe present nlrpBENCH: a new platform and framework to improve software engineering research as well as teaching with focus on requirements engineering during the software engineering process. It is available on http://nlrp.ipd. kit.edu. Recent advances in natural language processing have made it possible to process textual software requirements automatically, for example checking them for flaws or translating them into software artifacts. This development is particularly fortunate, as the majority of requirements is written in unrestricted natural language. However, many of the tools in in this young area of research have been evaluated only on limited sets of examples, because there is no accepted benchmark that could be used to assess and compare these tools. To improve comparability and thereby accelerate progress, we have begun to assemble nlrpBENCH, a collection of requirements specifications meant both as a challenge for tools and a yardstick for comparison. We have gathered over 50 requirement texts of varying length and difficulty and organized them in benchmark sets. At present, there are two task types: model extraction (e.g., generating UML models) and text correction (e.g., eliminating ambiguities). Each text is accompanied by the expected result and metrics for scoring results. This paper describes the composition of the benchmark and the sources. Due to the brevity of this paper, we omit example tools comparisons which are also available.en
dc.language.isoen
dc.publisherGesellschaft für Informatik e.V.
dc.relation.ispartofSoftware-engineering and management 2015
dc.relation.ispartofseriesLecture Notes in Informatics (LNI) - Proceedings, Volume P-239
dc.titleNlrpbench: A benchmark for natural language requirements processingen
dc.typeText/Conference Paper
dc.pubPlaceBonn
mci.reference.pages159-164
mci.conference.locationDresden
mci.conference.date17.-20. März 2015


Files in this item

Thumbnail

Show simple item record