GI LogoGI Logo
  • Login
Digital Library
    • All of DSpace

      • Communities & Collections
      • Titles
      • Authors
      • By Issue Date
      • Subjects
    • This Collection

      • Titles
      • Authors
      • By Issue Date
      • Subjects
Digital Library Gesellschaft für Informatik e.V.
GI-DL
    • English
    • Deutsch
  • English 
    • English
    • Deutsch
View Item 
  •   DSpace Home
  • Lecture Notes in Informatics
  • Proceedings
  • BTW - Datenbanksysteme für Business, Technologie und Web
  • P290 - BTW2019 - Datenbanksysteme für Business, Technologie und Web - Workshopband
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.
  •   DSpace Home
  • Lecture Notes in Informatics
  • Proceedings
  • BTW - Datenbanksysteme für Business, Technologie und Web
  • P290 - BTW2019 - Datenbanksysteme für Business, Technologie und Web - Workshopband
  • View Item

Skew-resilient Query Processing for Fast Networks

Author:
Ziegler, Tobias [DBLP] ;
Binnig, Carsten [DBLP] ;
Röhm, Uwe [DBLP]
Abstract
Motivation: Scalable distributed in-memory databases are at the core of data-intensive computation. Although scaling-out solutions help to handle large amounts of data, more nodes do not necessarily lead to improved query performance. In fact, recent papers have shown that performance can even degrade when scaling out due to higher communication overhead (e.g., shuffling data across nodes) and limited bandwidth [Rö15]. Thus, current distributed database systems are built with the assumption that the network is the major bottleneck [BH13] and should be avoided at all costs. In recent years, high-speed networks (e.g., InfiniBand (IB)) with a bandwidth close to the local memory bus [Bi16] have become economically viable. These network technologies provide Remote Direct Memory Access (RDMA) to allow direct memory access to a remote host and also reduce the latency of data transfer through bypassing the remote’s CPU [In17, Gr10]. Therefore, the assumption that the network is the bottleneck no longer holds. Consequently, recent research has focused on integrating RDMA-enabled high-speed networks into existing database systems designed along a Shared-Nothing Architecture (SN) [Rö16, LYB17]. This architecture co-locates computation and data to reduce the communication overhead in a cluster. Although combining a SN with IB’s higher network bandwidth enables scalability to a certain extent, this approach fails if the data or workload is skewed and cannot be evenly partitioned. The root cause is that classical query execution schemes assume that each partition is processed by one node. Since nodes with larger partitions must process more data, they may become a bottleneck and hinder the overall scalability. In consequence, only utilizing the higher bandwidth without adapting the database architecture and query execution, does not automatically lead to improved scalability [Bi16]. Contributions: In this paper, we present a new approach to execute distributed queries on fast networks with RDMA. Our main contribution is a novel execution strategy, which enables collaborative query processing by remote work stealing to mitigate skew, as this is a common issues that hinders scalable query execution [WDJ91, Ly88]. Moreover, we implement this execution strategy in our prototype engine I-Store and show that it introduces almost no overhead to handle skew.
  • Citation
  • BibTeX
Ziegler, T., Binnig, C. & Röhm, U., (2019). Skew-resilient Query Processing for Fast Networks. In: Meyer, H., Ritter, N., Thor, A., Nicklas, D., Heuer, A. & Klettke, M. (Hrsg.), BTW 2019 – Workshopband. Gesellschaft für Informatik, Bonn. (S. 81-85). DOI: 10.18420/btw2019-ws-06
@inproceedings{mci/Ziegler2019,
author = {Ziegler, Tobias AND Binnig, Carsten AND Röhm, Uwe},
title = {Skew-resilient Query Processing for Fast Networks},
booktitle = {BTW 2019 – Workshopband},
year = {2019},
editor = {Meyer, Holger AND Ritter, Norbert AND Thor, Andreas AND Nicklas, Daniela AND Heuer, Andreas AND Klettke, Meike} ,
pages = { 81-85 } ,
doi = { 10.18420/btw2019-ws-06 },
publisher = {Gesellschaft für Informatik, Bonn},
address = {}
}
DateienGroesseFormatAnzeige
A3-4.pdf260.5Kb PDF View/Open

Sollte hier kein Volltext (PDF) verlinkt sein, dann kann es sein, dass dieser aus verschiedenen Gruenden (z.B. Lizenzen oder Copyright) nur in einer anderen Digital Library verfuegbar ist. Versuchen Sie in diesem Fall einen Zugriff ueber die verlinkte DOI: 10.18420/btw2019-ws-06

Haben Sie fehlerhafte Angaben entdeckt? Sagen Sie uns Bescheid: Send Feedback

More Info

DOI: 10.18420/btw2019-ws-06
ISBN: 978-3-88579-684-8
ISSN: 1617-5468
xmlui.MetaDataDisplay.field.date: 2019
Language: en (en)
Collections
  • P290 - BTW2019 - Datenbanksysteme für Business, Technologie und Web - Workshopband [36]

Show full item record


About uns | FAQ | Help | Imprint | Datenschutz

Gesellschaft für Informatik e.V. (GI), Kontakt: Geschäftsstelle der GI
Diese Digital Library basiert auf DSpace.

 

 


About uns | FAQ | Help | Imprint | Datenschutz

Gesellschaft für Informatik e.V. (GI), Kontakt: Geschäftsstelle der GI
Diese Digital Library basiert auf DSpace.