Logo des Repositoriums

Auflistung nach Schlagwort "measurement"

1 - 8 von 8
  • Konferenzbeitrag
    ATI-S -- An Ultra-Short Scale for Assessing Affinity for Technology Interaction in User Studies
    (Mensch und Computer 2019 - Tagungsband, 2019) Wessel, Daniel; Attig, Christiane; Franke, Thomas
    In research and development in general, and in user-centered design (UCD) in particular, participants of studies have to be representative for the target audience. However, given the voluntary participation in user studies and an ensuing self-selection bias, participants of user studies likely prefer to engage with technology more strongly than the target audience in general (i.e., they have a higher affinity for technology interaction, ATI). Unchecked, this potential bias might lead to products that neglect important user groups or miss valuable market niches. At the same time, participants’ time is limited, so assessment of ATI must be economical. Thus, we propose an ultra-short ATI scale derived from the ATI scale by [10]. ATI-S was developed using theoretical considerations and empirical analyses. It provides a sufficiently reliable and valid assessment of ATI in conditions with strict time-constraints, in which the full ATI scale cannot be used.
  • Konferenzbeitrag
    Benchmarking Function Hook Latency in Cloud-Native Environments
    (Softwaretechnik-Trends Band 43, Heft 4, 2023) Kahlhofer, Mario; Kern, Patrick; Henning, Sören; Rass, Stefan
    Researchers and engineers are increasingly adopting cloud-native technologies for application development and performance evaluation. While this has improved the reproducibility of benchmarks in the cloud, the complexity of cloud-native environments makes it difficult to run benchmarks reliably. Cloud-native applications are often instrumented or altered at runtime, by dynamically patching or hooking them, which introduces a significant performance overhead. Our work discusses the benchmarking-related pitfalls of the dominant cloud-native technology, Kubernetes, and how they affect performance measurements of dy namically patched or hooked applications. We present recommendations to mitigate these risks and demonstrate how an improper experimental setup can negatively impact latency measurements.
  • Konferenzbeitrag
    Construction of UEQ+ scales for voice quality: measuring user experience quality of voice interaction
    (Mensch und Computer 2020 - Tagungsband, 2020) Klein, Andreas M.; Hinderks, Andreas; Schrepp, Martin; Thomaschewski, Jörg
    The UEQ+ is a modular framework for the construction of UX questionnaires. The researcher can pick those scales that fit his or her research question from a list of 16 available UX scales. Currently, no UEQ+ scales are available to allow measuring the quality of voice interactions. Given that this type of interaction is increasingly essential for the usage of digital products, this is a severe limitation of the possible products and usage scenarios that can be evaluated using the UEQ+. We describe in this paper the construction of three specific scales to measure the UX of voice interactions. Besides, we discuss how these new scales can be combined with existing UEQ+ scales in evaluation projects.
  • Konferenzbeitrag
    Generic Performance Measurement in CI: The GeoMap Case Study
    (Softwaretechnik-Trends Band 43, Heft 1, 2023) Reichelt, David Georg; Krauß, Hannes; Kühne, Stefan; Hasselbring, Wilhelm
    Continuously developed industry projects with medium budget often focus on functional correctness, but not on optimal performance. This is partially caused by the lack of easily available approaches and tooling that check for performance changes. The tool Peass-CI examines performance changes by measurement and analysis of the duration of unit tests. We present a case study of establishing a continuous performance engineering process in GeoMap, a Spring based tool that allows to analyze the real estate market for real estate service and market experts. In the continuous performance engineering process, we monitored performance changes that happened during six months and derived performance improvements by code reviews and load test execution. We found that (1) continuous performance measurement gives detailed insights into performance changes and (2) performance improvements by source code changes are reproducible using performance measurement of unit tests in Peass-CI.
  • Konferenzbeitrag
    Monitoring Electrical Power Consumption with Kieker
    (Softwaretechnik-Trends Band 39, Heft 3, 2019) Henning, Sören
    Detailed knowledge about the electrical power consumption is a prerequisite for reducing it in manufacturing enterprises. Therefore, a continuous monitoring and analysis of the power usage of the overall business as well as of its individual devices, machines, and production plants is demanded. In this paper, we present an approach for such a monitoring infrastructure. It facilitates the integration of different types of sensors in order to make their measurements comparable. Automatically and in real time, it analyzes and visualizes recorded data in a number of ways. Supported by patterns and technologies for scalable, big data processing systems, this approach utilizes the software performance monitoring framework Kieker in large parts. We implement a prototype of this approach and inspect the power consumption of servers in a medium-sized enterprise.
  • Konferenzbeitrag
    Performance comparison of TwinCat ADS for Python and Java
    (Softwaretechnik-Trends Band 43, Heft 4, 2023) Weber, Alexander; Eichelberger, Holger; Schreiber, Per; Wienrich, Svenja
    Real-time and in-process measurements are important in the manufacturing domain, e.g., for real-time process monitoring. For performance reasons, such data is often processed in virtualized environments on edge devices, as e.g., provided by the company Beckhoff. For exploring modern AI methods, integration with high-level languages such as Python or even with Industry 4.0 platforms for advanced data flows is needed. In this paper, we analyze the read/write perfor mance of a Beckhoff device integrated via Python or Java. For our experiments, we use a simulation on a PC as well as a networked setup with a Beckhoff device. We show that the Java-based solution is faster than the Python one by 2-3 times. We also show that small arrays can be read as fast as a single value, that there is no difference between operations for small or big data types and that there is no difference between reading and writing data.
  • Konferenzbeitrag
    Vision of Continuously Assuring Performance
    (Softwaretechnik-Trends Band 40, Heft 3, 2020) Reichelt, David Georg; Kühne, Stefan; Hasselbring, Wilhelm
    When assuring performance, small performance differences at code level are difficult to measure at application level. Current approaches aimed at performance assurance are capable of identifying hotspots and major performance bugs. Apart from their inability to detect small regressions, they require manual effort for specification and execution. In this paper, we present the vision of continuously assuring performance by using functional unit tests. Utilizing small tests allows developers to detect small performance differences. Additionally, they do not have to define workloads manually if they use functional unit tests, since these are present in most projects. To achieve this, we propose integrating performance measurements in the continuous integration (CI) process, accelerating root cause analysis and creating parallel tests capable of identifying regressions that arise with parallel use.
  • Konferenzbeitrag
    What you see isn't necessarily what you get: testing the influence of polygon count on physical and self-presence in virtual environments
    (Mensch und Computer 2020 - Tagungsband, 2020) Volkmann, Torben; Wessel, Daniel; Caliebe, Tim Ole; Jochems, Nicole
    A key characteristic for the effectiveness of Virtual Reality Environments is a high sense of presence -- the feeling of being in that virtual place, even though being physically in another location. For a more differentiated perspective on presence, the term can be defined by subtypes, such as physical, social and self-presence. The Multimodal Presence Scale (MPS) by Makransky and colleagues deals with these dimensions, was translated into German, and evaluated regarding the sensitivity and specificity of the social presence subscale. The results raise the question how well differences in physical and self-presence can be detected by the scale. We conducted an experiment by constructing two virtual worlds, manipulating the polygon count of objects in each world, and measuring presence. Additionally, we assessed the correlation of the MPS with the Igroup Presence Questionnaire (IPQ). No significant differences in physical or self-presence were found. However, when examining an item that closely matches the manipulation of the self-presence world (the user's virtual hands), a statistically significant difference was found. We provide three possible explanations for these results: 1) an insufficient impact of the abstraction levels, e.g., due to insufficient time and attention to the manipulation, or too little difference between the abstraction levels, 2) a lack of sensitivity of the used MPS and IPQ, or 3) the polygon count not being important for physical or self-presence. We conclude that high polygon count might not be that crucial for presence and provide suggestions for future research.