Approaches for Automated Data Quality Analysis: Syntactic and Semantic Assessment
| dc.contributor.author | Ahiagble,Agbodzea Pascal | |
| dc.contributor.author | Stein,Hannah | |
| dc.contributor.editor | Demmler, Daniel | |
| dc.contributor.editor | Krupka, Daniel | |
| dc.contributor.editor | Federrath, Hannes | |
| dc.date.accessioned | 2022-09-28T17:10:57Z | |
| dc.date.available | 2022-09-28T17:10:57Z | |
| dc.date.issued | 2022 | |
| dc.description.abstract | Data quality significantly influences data usability and plays an important role in data trading. This paper presents a data quality analysis (DQA) of data tables on two levels. The first, the so-called syntactic level, concerns the structure of the elements within the database and the second, the so-called semantic level, concerns the relationship between the elements in the database and the "real world". Based on a literature review the most relevant data quality criteria and corresponding metrics were derived. Subsequently, based on heuristics, a data-centric approach and an unsupervised machine learning clustering algorithm DBSCAN, a service for automated DQA, is designed and implemented (syntactic DQA). In the next step, an automated semantic DQA service as well. The approach is used to examine data tables for example for missing relevant columns (i.e., semantic completeness). A data quality index represents the services’ output, which is derived from the automated analysis of various data quality criteria. This enables the assessment of data quality, as well as the detection of potentials for improving quality and thus increasing the value of tradeable data. | en |
| dc.identifier.doi | 10.18420/inf2022_85 | |
| dc.identifier.isbn | 978-3-88579-720-3 | |
| dc.identifier.pissn | 1617-5468 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/39592 | |
| dc.language.iso | en | |
| dc.publisher | Gesellschaft für Informatik, Bonn | |
| dc.relation.ispartof | INFORMATIK 2022 | |
| dc.relation.ispartofseries | Lecture Notes in Informatics (LNI) - Proceedings, Volume P-326 | |
| dc.subject | Data quality assessment | |
| dc.subject | data quality metrics | |
| dc.subject | automated assessment services | |
| dc.title | Approaches for Automated Data Quality Analysis: Syntactic and Semantic Assessment | en |
| gi.citation.endPage | 1036 | |
| gi.citation.startPage | 1023 | |
| gi.conference.date | 26.-30. September 2022 | |
| gi.conference.location | Hamburg | |
| gi.conference.sessiontitle | Datenqualität und Qualitätsmetriken in der Datenwirtschaft (DQ) |
Dateien
Originalbündel
1 - 1 von 1
Vorschaubild nicht verfügbar
- Name:
- dq_02.pdf
- Größe:
- 323.15 KB
- Format:
- Adobe Portable Document Format