Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration
| dc.contributor.author | Spieker, Helge | |
| dc.contributor.author | Gotlieb, Arnaud | |
| dc.contributor.author | Marijan, Dusica | |
| dc.contributor.author | Mossige, Morten | |
| dc.contributor.editor | Tichy, Matthias | |
| dc.contributor.editor | Bodden, Eric | |
| dc.contributor.editor | Kuhrmann, Marco | |
| dc.contributor.editor | Wagner, Stefan | |
| dc.contributor.editor | Steghöfer, Jan-Philipp | |
| dc.date.accessioned | 2019-03-29T10:24:03Z | |
| dc.date.available | 2019-03-29T10:24:03Z | |
| dc.date.issued | 2018 | |
| dc.description.abstract | The paper appeared at the International Symposium on Software Testing and Analysis (ISSTA 2017). It is part of a project on test case prioritization, selection, and execution in Continuous Integration (CI). Selecting the most promising test cases to detect bugs is hard if there are uncertainties on the impact of committed code changes or if traceability links between code and tests are not available. This paper introduces Retecs, a new method for automatically learning test case selection and prioritization in CI with the goal to minimize the round-trip time between code commits and developer feedback on failed test cases. Retecs uses reinforcement learning to select and prioritize test cases according to their duration, previous last execution and failure history. In a constantly changing environment, where new test cases are created and obsolete test cases are deleted, the Retecs method learns to prioritize error-prone test cases higher under the guidance of a reward function and by observing previous CI cycles. By application on three industrial case studies, we show for the first time that reinforcement learning enables fruitful automatic adaptive test case selection and prioritization in CI and regression testing. | en |
| dc.identifier.isbn | 978-3-88579-673-2 | |
| dc.identifier.pissn | 1617-5468 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/21127 | |
| dc.language.iso | en | |
| dc.publisher | Gesellschaft für Informatik | |
| dc.relation.ispartof | Software Engineering und Software Management 2018 | |
| dc.relation.ispartofseries | Lecture Notes in Informatics (LNI) - Proceedings, Volume P-279 | |
| dc.subject | Software testing | |
| dc.subject | Machine learning | |
| dc.subject | Continuous Integration | |
| dc.title | Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration | en |
| dc.type | Text/Conference Paper | |
| gi.citation.endPage | 76 | |
| gi.citation.publisherPlace | Bonn | |
| gi.citation.startPage | 75 | |
| gi.conference.date | 5.-9. März 2018 | |
| gi.conference.location | Ulm | |
| gi.conference.sessiontitle | Software Engineering 2018 - Wissenschaftliches Hauptprogramm |
Dateien
Originalbündel
1 - 1 von 1