Logo des Repositoriums

Auflistung nach Schlagwort "experiment"

1 - 10 von 11
  • Konferenzbeitrag
    Adapting Kubernetes to IIoT and Industry 4.0 protocols - An initial performance analysis
    (Softwaretechnik-Trends Band 43, Heft 1, 2023) Alamoush, Ahmad; Eichelberger, Holger
    Kubernetes (K8s) is one of the most frequently used container orchestration tools offering, as it offers a rich set of functions to manage containerized applications, it is customizable and extensible. Container virtualization of applications and their orchestration on heterogeneous resources including edge devices is a recent trend in Industrial Internet of Things (IIoT)/Industry 4.0, where K8s is also applied. However, IIoT/Industry 4.0 is a domain with high standardization requirements. Besides equipment standards, e.g., for electrical control cabinets, there are also demands to standardize network protocols, data formats or information models. Such standards can foster interoperability and reduce complexity or deployment/integration costs. Here, the proprietary communication protocol of K8s and similar orchestrators can be an obstacle for adoption. To explore this situation from an interoperability and integration perspective, we present in this paper an approach to replace the communication protocol of K8s without modifying its code base. We show by an experiment that applying our approach with three current forms of IIoT communication, namely Message Queuing Telemetry Transport (MQTT), Ad vanced Message Queuing Protocol (AMQP), and Asset Administration Shell (AAS), does not significantly affect the validity and the performance of K8s.
  • Konferenzbeitrag
    Benchmarking Function Hook Latency in Cloud-Native Environments
    (Softwaretechnik-Trends Band 43, Heft 4, 2023) Kahlhofer, Mario; Kern, Patrick; Henning, Sören; Rass, Stefan
    Researchers and engineers are increasingly adopting cloud-native technologies for application development and performance evaluation. While this has improved the reproducibility of benchmarks in the cloud, the complexity of cloud-native environments makes it difficult to run benchmarks reliably. Cloud-native applications are often instrumented or altered at runtime, by dynamically patching or hooking them, which introduces a significant performance overhead. Our work discusses the benchmarking-related pitfalls of the dominant cloud-native technology, Kubernetes, and how they affect performance measurements of dy namically patched or hooked applications. We present recommendations to mitigate these risks and demonstrate how an improper experimental setup can negatively impact latency measurements.
  • Konferenzbeitrag
    Benchmarking Stream Processing Frameworks for Large Scale Data Shuffling
    (Softwaretechnik-Trends Band 43, Heft 4, 2023) Henning, Sören; Vogel, Adriano; Leichtfried, Michael; Ertl, Otmar; Rabiser, Rick
    Distributed stream processing frameworks help building scalable and reliable applications that perform transformations and aggregations on continuous data streams. We outline our ongoing research on designing a new benchmark for distributed stream processing frameworks. In contrast to other benchmarks, it focuses on use cases where stream processing frameworks are mainly used for redistributing data records to perform state-local aggregations, while the actual aggregation logic is considered as black-box software components. We describe our benchmark architecture based on a real-world use case, show how we imple mented it with four state-of-the-art frameworks, and give an overview of initial experimental results.
  • Konferenzbeitrag
    Graph-Based Performance Analysis at System- and Application-Level
    (Softwaretechnik-Trends Band 40, Heft 3, 2020) Müller, Richard; Strempel, Tom
    The Kieker plugin for jQAssistant transforms monitored log data into graphs to support software engineers with performance analysis. In this paper, we describe how we have extended and improved this plugin to support performance analysis at system- and application-level and how we have evaluated its correctness and scalability using data from recent experiments. This is a first step to replicate complete experiments in the field of performance analysis using graphs.
  • Textdokument
    Investigating the impact of representation features on decision model comprehension (Extended Abstract)
    (EMISA 2024, 2024) Djurica, Djordje; Kummer, Tyge F.; Mendling, Jan; Figl, Kathrin
    Decision models play a crucial role in the development of information systems for tasks such as system analysis and design, as well as compliance management. The effective presentation of these models is essential to ensure their accuracy and completeness. Existing research on their cognitive effectiveness remains inconclusive. Our study advances understanding by examining the detailed representation features of decision models, including type (tree versus table), structure (expanded versus frugal), and design (monochromatic versus colored). We demonstrate that the use of color can improve model-task fit, and that structural features can enhance comprehension. Utilizing eye-tracking, we analyzed the underlying mechanisms of these effects. Our findings provide valuable insights for cognitive information systems research and practical applications, offering guidance for both users and developers of decision models.
  • Konferenzbeitrag
    Performance Evaluation of BaSyx based Asset Administration Shells for Industry 4.0 Applications
    (Softwaretechnik-Trends Band 43, Heft 1, 2023) Sauer, Christian; Eichelberger, Holger
    The Asset Administration Shell (AAS) is an upcoming information model standard, which aims at interoperable modeling of “assets”, i.e., products, machines, services or digital twins in IIoT/Industry 4.0. Currently, a number of IIoT-platforms use proprietary information models similar to AAS, but not a common standard, which affects interoperability. A key question for a broad uptake is if AAS can be applied in a performant and scalable manner. In this paper, we examine this question for the open source Eclipse BaSyx middleware. To explore capabilities and possible performance limitations, we present four experiments measuring the performance of experimental AAS in BaSyx and, within the context set by our experiments, i.e., 10-1000 AAS instances, can conclude good scalability.
  • Konferenzbeitrag
    The Awareness-/Coordination-Support-System Paradox
    (Mensch & Computer 2014 - Tagungsband, 2014) Oemig, Christoph; Gross, Tom
    Coordination and awareness have been topics in the area of Computer-Supported Cooperative Work (CSCW) starting from day one. Effortless coordination has been a major goal ever since. However, while awareness research became quite popular, coordination got increasingly out of focus. Its concepts stayed rather theoretical lacking concrete steps towards the original goal due to the absence of appropriate measurement techniques and tools. There is even an on-going general dispute if discount usability techniques deliver valid results as compared to real-world field studies. This paper supports their validity and demonstrates how the Standardized Coordination Task Assessment (SCTA) technique is used to extend the mechanics of collaboration, a framework for discount usability evaluations, allowing awareness and coordination effort assessments. The results appeared not only to be reasonable but the experiment revealed an effect we named the awareness-/coordination-support system paradox.
  • Konferenzbeitrag
    Tool-Supported Experiments for Continuously Collecting Data of Subjective Video Quality Assessments During Video Playback
    (Softwaretechnik-Trends Band 40, Heft 1, 2020) Karras, Oliver; Klünder, Jil; Schneider, Kurt
    In our research project ViViReq, we aspire to research what constitutes a good video in the context of requirements communication. As part of our research plan, we develop a quality model for videos to define and evaluate the quality of videos as RE artifacts. In addition to evaluating videos, this quality model can be used by software professionals as guidance for producing and using videos. Based on our quality model, we want to analyze how specific implementations of single video characteristics, e.g., pleasure, exactly affect the viewers’ quality assessment. In this research preview, we propose to support the conduct of experiments for subjective video quality assessments with a software tool which allows continuously collecting the assessment data for generic video characteristics during video playback. The proposed solution consists of five key concepts which are briefly explained in this article.
  • Konferenzbeitrag
    Understanding comprehension of iterative and recursive programs with eye tracking
    (Softwaretechnik-Trends Band 40, Heft 2, 2020) Aqeel, Arooba; Peitek, Norman; Siegmund, Janet
    To increase the understanding of program comprehension, we will conduct an eye-tracking experiment to evaluate whether iterative and recursive source code elicit different eye movement patterns. This would indicate that they have different underlying cognitive processes.
  • Report
    Using Audio for Detecting Covered Users in Front of Public Displays
    (2022) Foldenauer, Katarina; Plischke, Tobias; Strauß, Luca; Viehmann, Eike; Koch, Michael
    Public displays have become more and more ubiquitous in recent years. Both for managing public display networks and for doing research in this field it is an important issue to automatically detect what is happening in front of these screens. This often is done with the help of depth cameras. However, measurement errors can occur due to occlusion or underexposure. In our research we looked into the idea to support the detection of concealed persons using audio information. A se-ries of laboratory experiments showed that audio recordings can be used to detect concealed per-sons. This can be used in existing installations to minimize occlusion error in visual recordings.