Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction
| dc.contributor.author | Meier, Peter | |
| dc.contributor.author | Schwär, Simon | |
| dc.contributor.author | Krump, Gerhard | |
| dc.contributor.author | Müller, Meinard | |
| dc.contributor.editor | Klein, Maike | |
| dc.contributor.editor | Krupka, Daniel | |
| dc.contributor.editor | Winter, Cornelia | |
| dc.contributor.editor | Wohlgemuth, Volker | |
| dc.date.accessioned | 2023-11-29T14:50:36Z | |
| dc.date.available | 2023-11-29T14:50:36Z | |
| dc.date.issued | 2023 | |
| dc.description.abstract | Music-based games are an important genre in the gaming community and have become increasingly popular with games like SingStar and Guitar Hero. These types of games are usually based on reactive game mechanics, where the player must hit a certain note at a certain time in order to score points. In this contribution, we present a game prototype that goes beyond purely music-reactive game mechanics and focuses more on the creative aspect of making music in games. In particular, we developed a jump-and-run game that can be controlled with a gaming controller but also uses the player’s singing voice to interact with the game world. To this end, we estimate the pitch of a microphone signal in real time and use it as a creative input to the game. This input can be used to control parts of the game world, for instance by singing and adding stair-like elements that allow the player to overcome obstacles and reach the end of a game level. With our game prototype, we demonstrate how game designers can incorporate musical challenges into a well-known game environment while motivating musicians to creatively explore and practice their musical skills. Furthermore, motivated by our game prototype, we evaluate different real-time pitch estimation algorithms using common MIR metrics on a publicly available dataset to analyse what works best for our gaming scenario. | en |
| dc.identifier.doi | 10.18420/inf2023_97 | |
| dc.identifier.isbn | 978-3-88579-731-9 | |
| dc.identifier.pissn | 1617-5468 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/43222 | |
| dc.language.iso | en | |
| dc.publisher | Gesellschaft für Informatik e.V. | |
| dc.relation.ispartof | INFORMATIK 2023 - Designing Futures: Zukünfte gestalten | |
| dc.relation.ispartofseries | Lecture Notes in Informatics (LNI) - Proceedings, Volume P-337 | |
| dc.subject | Evaluation | |
| dc.subject | Real-Time | |
| dc.subject | Pitch | |
| dc.subject | Estimation | |
| dc.subject | Algorithm | |
| dc.subject | Creative | |
| dc.subject | Music | |
| dc.subject | Game | |
| dc.subject | Interaction | |
| dc.title | Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction | en |
| dc.type | Text/Conference Paper | |
| gi.citation.endPage | 882 | |
| gi.citation.publisherPlace | Bonn | |
| gi.citation.startPage | 873 | |
| gi.conference.date | 26.-29. September 2023 | |
| gi.conference.location | Berlin | |
| gi.conference.sessiontitle | Kultur & Design - Digital Cultures Cultural Analytics (InfDH 2023) |
Dateien
Originalbündel
1 - 1 von 1