Logo des Repositoriums

Auflistung nach Schlagwort "reproducibility"

1 - 3 von 3
  • Konferenzbeitrag
    Experiences from Building the Open Database Performance Ranking with benchANT
    (Softwaretechnik-Trends Band 43, Heft 1, 2023) Seybold, Daniel; Domaschka, Jörg
    Benchmarking is an important method to advance database management systems (DBMS) from the industry and research perspective. Ensuring transparent and reproducible results is a key requirement to ensure the acceptance and credibility of benchmarking. To advance the research towards transparent and reproducible benchmark data, we report on building an open DBMS performance ranking with 130 benchmark configurations and ensuring comparability, transparency and reproducibility. We derive the required data on cloud, resource, DBMS and benchmark level to enable transparency and reproducibility and demonstrate the generation of such data sets with benchANT. Building upon such data, we outline future research directions for DBMS performance modelling, DBMS auto-tuning and decision support.
  • Textdokument
    Including Data Management in Research Culture Increases the Reproducibility of Scientific Results
    (INFORMATIK 2022, 2022) Riedel,Christian; Geßner,Hendrik; Seegebrecht,Anja; Ayon,Safial Islam; Chowdhury,Shafayet Hossen; Engbert,Ralf; Lucke,Ulrike
    Reproducible research results are among the pillars of sustainable science, and considerable progress has been achieved in this direction recently. However, there is much room for improvement across the research communities. Here we analyze the reproducibility of 108 publications from an interdisciplinary Collaborative Research Center on applied mathematics in various scientific fields. Based on a previous reproducibility study in hydrology, we identify the rate of reproducible scientific results and why reproducibility fails. We identify the main problems that hinder reproducible results and relate them to previous interventions targeting the research culture of reproducible scientific findings. Thus, the success of our measures can be estimated, and specific recommendations for future work can be derived. In our study, the number of publications that allow for at least partly reproducible research results increased over time. However, we see an ongoing need for directives and support in research data management among research communities since issues concerning data accessibility and quality limit the reproducibility of scientific results. We argue that our results are representative of other interdisciplinary research areas.
  • Textdokument
    Intrinsic Limitations of Fingerprint Orientation Estimation
    (BIOSIG 2017, 2017) Schuch,Patrick; Schulz,Simon-Daniel; Busch,Christoph
    Estimation of orientation field is a crucial issue when processing fingerprint samples. Many subsequent fingerprint processing steps depend on reliable and accurate estimations. Algorithms for such estimations are usually evaluated against ground truth data. As true ground truth is usually not available, human experts need to mark-up ground truth manually. However, the accuracy and the reliability of such mark-ups for orientation fields have not been investigated yet. Mark-ups produced by six humans allowed insights into both aspects. A Root Mean Squared Error of about 7 against true ground truth can be achieved. Reproducibility between two mark-ups of a single dactyloscopic expert is at the same precision. We concluded that the accuracy of human experts is competitive to the best algorithms evaluated at FVC-ongoing.