Towards Resilient Data Management for the Internet of Moving Things
| dc.contributor.author | Paz, Elena Beatriz Ouro | |
| dc.contributor.author | Zacharatou, Eleni Tzirita | |
| dc.contributor.author | Markl, Volker | |
| dc.contributor.editor | Kai-Uwe Sattler | |
| dc.contributor.editor | Melanie Herschel | |
| dc.contributor.editor | Wolfgang Lehner | |
| dc.date.accessioned | 2021-03-16T07:57:10Z | |
| dc.date.available | 2021-03-16T07:57:10Z | |
| dc.date.issued | 2021 | |
| dc.description.abstract | Mobile devices have become ubiquitous; smartphones, tablets and wearables are essential commodities for many people. The ubiquity of mobile devices combined with their ever increasing capabilities, open new possibilities for Internet-of-Things (IoT) applications where mobile devices act as both data generators as well as processing nodes. However, deploying a stream processing system (SPS) over mobile devices is particularly challenging as mobile devices change their position within the network very frequently and are notoriously prone to transient disconnections. To deal with faults arising from disconnections and mobility, existing fault tolerance strategies in SPS are either checkpointing-based or replication-based. Checkpointing-based strategies are too heavyweight for mobile devices, as they save and broadcast state periodically, even when there are no failures. On the other hand, replication-based strategies cannot provide fault tolerance at the level of the data source, as the data source itself cannot be always replicated. Finally, existing systems exclude mobile devices from data processing upon a disconnection even when the duration of the disconnection is very short, thus failing to exploit the computing capabilities of the offline devices. This paper proposes a buffering-based reactive fault tolerance strategy to handle transient disconnections of mobile devices that both generate and process data, even in cases where the devices move through the network during the disconnection. The main components of our strategy are: (a) a circular buffer that stores the data which are generated and processed locally during a device disconnection, (b) a query-aware buffer replacement policy, and (c) a query restart process that ensures the correct forwarding of the buffered data upon re-connection, taking into account the new network topology. We integrate our fault tolerance strategy with NebulaStream, a novel stream processing system specifically designed for the IoT. We evaluate our strategy using a custom benchmark based on real data, exhibiting reduction in data loss and query runtime compared to the baseline NebulaStream. | en |
| dc.identifier.doi | 10.18420/btw2021-14 | |
| dc.identifier.isbn | 978-3-88579-705-0 | |
| dc.identifier.pissn | 1617-5468 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/35797 | |
| dc.language.iso | en | |
| dc.publisher | Gesellschaft für Informatik, Bonn | |
| dc.relation.ispartof | BTW 2021 | |
| dc.relation.ispartofseries | Lecture Notes in Informatics (LNI) - Proceedings, Volume P-311 | |
| dc.subject | Mobile Stream Processing | |
| dc.subject | Internet-of-Things | |
| dc.subject | Fault Tolerance | |
| dc.subject | Buffering | |
| dc.title | Towards Resilient Data Management for the Internet of Moving Things | en |
| gi.citation.endPage | 301 | |
| gi.citation.startPage | 279 | |
| gi.conference.date | 13.-17. September 2021 | |
| gi.conference.location | Dresden | |
| gi.conference.sessiontitle | Data Integration, Semantic Data Management, Streaming |
Dateien
Originalbündel
1 - 1 von 1