MLProvLab: Provenance Management for Data Science Notebooks
| dc.contributor.author | Kerzel, Dominik | |
| dc.contributor.author | König-Ries, Birgitta | |
| dc.contributor.author | Sheeba, Samuel | |
| dc.contributor.editor | König-Ries, Birgitta | |
| dc.contributor.editor | Scherzinger, Stefanie | |
| dc.contributor.editor | Lehner, Wolfgang | |
| dc.contributor.editor | Vossen, Gottfried | |
| dc.date.accessioned | 2023-02-23T14:00:15Z | |
| dc.date.available | 2023-02-23T14:00:15Z | |
| dc.date.issued | 2023 | |
| dc.description.abstract | Computational notebooks are a form of computational narrative fostering reproducibility.They provide an interactive computing environment where users can run and modify code, and repeat the exploration, providing an iterative communication between data scientists and code. While the ability to execute notebooks non-linearly benefits data scientists for exploration, the drawback is, that it is possible to lose control over the datasets, variables, and methods defined in the notebook and their dependencies.Thus, in this process of user interaction and exploration, there can be a loss of execution history information. To prevent this, a possibility is needed to maintain provenance information. Provenance plays a significant role in data science, especially facilitating the reproducibility of results.To this end, we developed a provenance management tool to help data scientists track, capture, compare, and visualize provenance information in notebook code environments.We conducted an evaluation with data scientists, where participants were asked to find specific provenance information from the execution history of a machine learning Jupyter notebook.The results from the performance and user evaluation show promising aspects of provenance management features of the tool.The resulting system, MLProvLab, is available as an open-source extension for JupyterLab. | en |
| dc.identifier.doi | 10.18420/BTW2023-66 | |
| dc.identifier.isbn | 978-3-88579-725-8 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/40375 | |
| dc.language.iso | en | |
| dc.publisher | Gesellschaft für Informatik e.V. | |
| dc.relation.ispartof | BTW 2023 | |
| dc.relation.ispartofseries | Lecture Notes in Informatics (LNI) - Proceedings, Volume P-331 | |
| dc.subject | Data Science | |
| dc.subject | Information Extraction | |
| dc.subject | Provenance | |
| dc.subject | Jupyter Notebook | |
| dc.subject | Reproducibility | |
| dc.title | MLProvLab: Provenance Management for Data Science Notebooks | en |
| dc.type | Text/Conference Paper | |
| gi.citation.endPage | 980 | |
| gi.citation.publisherPlace | Bonn | |
| gi.citation.startPage | 965 | |
| gi.conference.date | 06.-10. März 2023 | |
| gi.conference.location | Dresden, Germany |
Dateien
Originalbündel
1 - 1 von 1
Vorschaubild nicht verfügbar
- Name:
- C3-06.pdf
- Größe:
- 997.33 KB
- Format:
- Adobe Portable Document Format