Logo des Repositoriums

Auflistung nach Schlagwort "Game"

1 - 2 von 2
  • Konferenzbeitrag
    Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction
    (INFORMATIK 2023 - Designing Futures: Zukünfte gestalten, 2023) Meier, Peter; Schwär, Simon; Krump, Gerhard; Müller, Meinard
    Music-based games are an important genre in the gaming community and have become increasingly popular with games like SingStar and Guitar Hero. These types of games are usually based on reactive game mechanics, where the player must hit a certain note at a certain time in order to score points. In this contribution, we present a game prototype that goes beyond purely music-reactive game mechanics and focuses more on the creative aspect of making music in games. In particular, we developed a jump-and-run game that can be controlled with a gaming controller but also uses the player’s singing voice to interact with the game world. To this end, we estimate the pitch of a microphone signal in real time and use it as a creative input to the game. This input can be used to control parts of the game world, for instance by singing and adding stair-like elements that allow the player to overcome obstacles and reach the end of a game level. With our game prototype, we demonstrate how game designers can incorporate musical challenges into a well-known game environment while motivating musicians to creatively explore and practice their musical skills. Furthermore, motivated by our game prototype, we evaluate different real-time pitch estimation algorithms using common MIR metrics on a publicly available dataset to analyse what works best for our gaming scenario.
  • Workshopbeitrag
    Real-Time MIR Algorithms for Music-Reactive Game World Generation
    (Mensch und Computer 2022 - Workshopband, 2022) Meier, Peter; Schwär, Simon; Rosenzweig, Sebastian; Müller, Meinard
    In music education, an important learning objective is to acquire a sense of rhythm and melody, e.g., by tapping or singing along to a musical performance. In this context, music games are becoming increasingly popular due to their accessibility and interactivity. However, existing games are often tailored to a specific musical repertoire. In this paper, we will explore the potential of music information retrieval (MIR) algorithms for generating dynamic game worlds that are reactive to musical input in real-time, e.g., to music from a stereo system or a live performance. Such games may be used to explore musical performances in an interactive and playful way. As a case study, we therefore developed a jump-andrun game prototype that challenges players to tap along the beat of the music in their environment. Its music-reactive game world relies on past and predicted beat positions estimated by a real-time beat tracking algorithm.