Overhead Measurement Noise in Different Runtime Environments
| dc.contributor.author | Reichelt, David Georg | |
| dc.contributor.author | Jung, Reiner | |
| dc.contributor.author | van Hoorn, André | |
| dc.contributor.editor | Herrmann, Andrea | |
| dc.date.accessioned | 2025-01-08T13:31:08Z | |
| dc.date.available | 2025-01-08T13:31:08Z | |
| dc.date.issued | 2024 | |
| dc.description.abstract | In order to detect performance changes, measurements are performed with the same execution environment. In cloud environments, the noise from different processes running on the same cluster nodes might change measurement results and thereby make performance changes hard to measure. The benchmark MooBench determines the overhead of different observability tools and is executed continuously. In this study, we compare the suitability of different execution environments to benchmark the observability overhead using MooBench. To do so, we compare the execution times and standard deviation of MooBench in a cloud execution environment to three bare-metal execution environments. We find that bare metal servers have lower runtime and standard deviation for multi-threaded MooBench execution. Nevertheless, we see that performance changes up to 4.41 % are detectable by GitHub actions, as long as only sequential workloads are examined. | en |
| dc.identifier.issn | 0720-8928 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/45556 | |
| dc.language.iso | en | |
| dc.pubPlace | Bonn | |
| dc.publisher | Gesellschaft für Informatik e.V. | |
| dc.relation.ispartof | Softwaretechnik-Trends Band 44, Heft 4 | |
| dc.relation.ispartofseries | Softwaretechnik-Trends | |
| dc.subject | performance | |
| dc.subject | measurement | |
| dc.subject | cloud | |
| dc.subject | benchmark | |
| dc.subject | MooBench | |
| dc.title | Overhead Measurement Noise in Different Runtime Environments | en |
| dc.type | Text/Conference Paper | |
| mci.conference.date | November 6-7, 2024 | |
| mci.conference.location | Linz, Austria | |
| mci.conference.sessiontitle | 15th Symposium on Software Performance 2024 | |
| mci.reference.pages | 12-14 |
Dateien
Originalbündel
1 - 1 von 1
Lade...
- Name:
- SSP24_03_camera-ready_7783.pdf
- Größe:
- 265.65 KB
- Format:
- Adobe Portable Document Format