Lock-free Data Structures for Data Stream Processing
Author:
Abstract
The ever-growing amounts of data in the digital world require more and more computing power to meet the requirements. Especially in the area of social media, sensor data processing or Internet of Things, the data need to be handled on the fly during its creation. A common way to handle these data, in form of endless data streams, is the data stream processing technology. The key requirements for data stream processing are high throughput and low latency. These requirements can be accomplished with the parallelization of operators and multithreading. However, in order to realize a higher degree of parallelism, the efficient synchronization of threads is a necessity. This work examines the design principles of lock-free data structures and how this synchronization method can improve the performance of algorithms in data stream processing. For this purpose, lock-free data structures are implemented for the data stream processing engine Pipefabric and compared with current implementations. The result is an improvement for the tuple exchanging between threads and a significant improvement for the symmetric hash join algorithm based on lock-free hash maps.
- Citation
- BibTeX
Baumstark, A.,
(2019).
Lock-free Data Structures for Data Stream Processing.
In:
Meyer, H., Ritter, N., Thor, A., Nicklas, D., Heuer, A. & Klettke, M.
(Hrsg.),
BTW 2019 – Workshopband.
Gesellschaft für Informatik, Bonn.
(S. 215-224).
DOI: 10.18420/btw2019-ws-22
@inproceedings{mci/Baumstark2019,
author = {Baumstark, Alexander},
title = {Lock-free Data Structures for Data Stream Processing},
booktitle = {BTW 2019 – Workshopband},
year = {2019},
editor = {Meyer, Holger AND Ritter, Norbert AND Thor, Andreas AND Nicklas, Daniela AND Heuer, Andreas AND Klettke, Meike} ,
pages = { 215-224 } ,
doi = { 10.18420/btw2019-ws-22 },
publisher = {Gesellschaft für Informatik, Bonn},
address = {}
}
author = {Baumstark, Alexander},
title = {Lock-free Data Structures for Data Stream Processing},
booktitle = {BTW 2019 – Workshopband},
year = {2019},
editor = {Meyer, Holger AND Ritter, Norbert AND Thor, Andreas AND Nicklas, Daniela AND Heuer, Andreas AND Klettke, Meike} ,
pages = { 215-224 } ,
doi = { 10.18420/btw2019-ws-22 },
publisher = {Gesellschaft für Informatik, Bonn},
address = {}
}
Sollte hier kein Volltext (PDF) verlinkt sein, dann kann es sein, dass dieser aus verschiedenen Gruenden (z.B. Lizenzen oder Copyright) nur in einer anderen Digital Library verfuegbar ist. Versuchen Sie in diesem Fall einen Zugriff ueber die verlinkte DOI: 10.18420/btw2019-ws-22
Haben Sie fehlerhafte Angaben entdeckt? Sagen Sie uns Bescheid: Send Feedback
More Info
ISBN: 978-3-88579-684-8
ISSN: 1617-5468
xmlui.MetaDataDisplay.field.date: 2019
Language:
(en)
