Fairness and Privacy in Voice Biometrics: A Study of Gender Influences Using wav2vec 2.0
| dc.contributor.author | Oubaida Chouchane, Michele Panariello | |
| dc.contributor.editor | Damer, Naser | |
| dc.contributor.editor | Gomez-Barrero, Marta | |
| dc.contributor.editor | Raja, Kiran | |
| dc.contributor.editor | Rathgeb, Christian | |
| dc.contributor.editor | Sequeira, Ana F. | |
| dc.contributor.editor | Todisco, Massimiliano | |
| dc.contributor.editor | Uhl, Andreas | |
| dc.date.accessioned | 2023-12-12T10:46:49Z | |
| dc.date.available | 2023-12-12T10:46:49Z | |
| dc.date.issued | 2023 | |
| dc.description.abstract | This study investigates the impact of gender information on utility, privacy, and fairness in voice biometric systems, guided by the General Data Protection Regulation (GDPR) mandates, which underscore the need for minimizing the processing and storage of private and sensitive data, and ensuring fairness in automated decision-making systems. We adopt an approach that involves the fine-tuning of the wav2vec 2.0 model for speaker verification tasks, evaluating potential gender-related privacy vulnerabilities in the process. An adversarial technique is implemented during the fine-tuning process to obscure gender information within the speaker embeddings, thus bolstering privacy. Results from VoxCeleb datasets indicate our adversarial model increases privacy against uninformed attacks (AUC of 46.80\%), yet slightly diminishes speaker verification performance (EER of 3.89\%) compared to the non-adversarial model (EER of 2.37\%). The model's efficacy reduces against informed attacks (AUC of 96.27\%). Preliminary analysis of system performance is conducted to identify potential gender bias, thus highlighting the need for continued research to understand and enhance fairness, and the delicate interplay between utility, privacy, and fairness in voice biometric systems. | en |
| dc.identifier.isbn | 978-3-88579-733-3 | |
| dc.identifier.issn | 1617-5468 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/43290 | |
| dc.language.iso | en | |
| dc.pubPlace | Bonn | |
| dc.publisher | Gesellschaft für Informatik e.V. | |
| dc.relation.ispartof | BIOSIG 2023 | |
| dc.relation.ispartofseries | Lecture Notes in Informatics (LNI) - Proceedings, Volume P-339 | |
| dc.subject | Soft biometric privacy | |
| dc.subject | Demographic bias | |
| dc.subject | Fairness | |
| dc.subject | Speech and speaker recognition | |
| dc.title | Fairness and Privacy in Voice Biometrics: A Study of Gender Influences Using wav2vec 2.0 | en |
| dc.type | Text/Conference Paper | |
| mci.conference.date | 20.-22. September 2023 | |
| mci.conference.location | Darmstadt | |
| mci.conference.sessiontitle | Regular Research Papers | |
| mci.reference.pages | 101-112 |
Dateien
Originalbündel
1 - 1 von 1