Logo des Repositoriums

Auflistung nach Autor:in "Enke, Harry"

1 - 2 von 2
  • Zeitschriftenartikel
    Handling Big Data in Astronomy and Astrophysics: Rich Structured Queries on Replicated Cloud Data with XtreemFS
    (Datenbank-Spektrum: Vol. 12, No. 3, 2012) Enke, Harry; Partl, Adrian; Reinefeld, Alexander; Schintke, Florian
    With recent observational instruments and survey campaigns in astrophysics, efficient analysis of big structured data becomes more and more relevant. While providing good query expressiveness and data analysis capabilities through SQL, off-the-shelf RDBMS are yet not well prepared to handle high volume scientific data distributed across several nodes, neither for fast data ingest nor for fast spatial queries. Our SQL query parser and job manager performs query reformulation to spread queries to data nodes, gathering outputs on a head node and providing them again to the shards for subsequent processing steps. We combine this data analysis architecture with the cloud data storage component XtreemFS for automatic data replication to improve the availability and access latency. With our solution we perform rich structured data analysis expressed using SQL on large amounts of structured astrophysical data distributed across numerous storage nodes in parallel. The cloud storage virtualization with XtreemFS provides elasticity and reproducibility of scientific analysis tasks through its snapshot capability.
  • Konferenzbeitrag
    A life cycle model für collaborative research environments
    (7. DFN-Forum - Kommunikationstechnologien, 2014) Buddenbohm, Stefan; Enke, Harry; Hofmann, Matthias; Klar, Jochen; Neuroth, Heike; Schwiegelshohn, Uwe
    Virtual or Collaborative Research Environments are important pillars of modern research in many scientific disciplines. Therefore, the development and particularly the sustained operation of these environments has become an important challenge in the area of modern research infrastructures. In order to support communities in dealing with this challenge including design and evaluation, we have developed a life cycle model for Collaborative Research Environments. Based on this life cycle model, we identify common pitfalls and suggest a generic catalog of criteria to be used by developers, operators, and funding agencies. To consider the heterogeneity of Collaborative Research Environments, additional discipline specific criteria can be incorporated.