At the beginning, I found it difficult to choose a topic and come up with a suitable idea. Eventually, I decided to focus on a new issue in my immediate environment. This led to the idea of a singing aid for choir rehearsals. My final prototype combines the visual preparation of existing technology in a new application area. I enjoyed experimenting and seeing how I could convey my idea without extensive technical know-how while also making it interactively adjustable. Now, I am looking forward to seeing if I receive feedback from my choirmaster and can continue to work on it, or how things will progress in general.
In my last blog entry, I experimented with whether the vibration of the larynx alone could be used to read the pitch. Since this worked and I know that this technique is the basis for the concept, I have continued to work on the visualisation.
For my prototype I used Touchdesigner to compare my singing with the pure tone frequency and to see whether the information from the tuner was correct. As a result, you could hear that it worked.
The next step was to build a 3D model that visually represents my prototype. Part one is a small device that is placed close to the larynx to measure the vibration frequency. The analysed frequency is transferred to either a wristband or a clipper on the notebook and tells you if you have sung too high or too low.
With a simple interactive visualisation I show how the whole thing could work. The sung note is first compared with the pure frequency. If both match, the blue light in the centre lights up and if, as in my recording, the pitch was too low, the lower sphere lights up red. If the pitch is too high, the upper light lights up red.
The final part of my prototype is an app prototype with the idea to upload the choir score digitally qnd connect it to the vibration sensor. The sung notes are compared with the sheet music, and any inaccuracies are highlighted with a blue or red line, indicating where you are in the song and whether the pitch and timing are correct. I aim to keep the visualisation in the app simple, yet professional enough to provide a detailed vocal analysis.
Problem
One problem I had was reaching my choirmaster. Since I couldn’t go to rehearsals after the test and didn’t receive any feedback on my emails, I unfortunately couldn’t get any deeper insights to be able to use them in time to push the prototype forward.
I tested the string tuner I had bought by singing at different pitches and trying to find the best possible position where the vibration could be read most easily.
Test Result
The frequency meter should be positioned close to the centre of the larynx, as this is where the vibrations are strongest. This means that the device does not have to be pressed so hard against the neck.
Functionality: Detection by vibration basically works, but there are strong fluctuations in the display. Tone change: When the position of the device was changed, different tones were displayed at different points, although the same pitch was maintained. Half-tones are also recognised.
Sensitivity: The device needs to be more sensitive for smooth use in order to provide more precise results.
Current use: The device is currently used for string and side instruments.
To prototype my idea of a singing aid for choir rehearsals, I researched existing tools for recording and analysing singing.
Tuning Apps
An easy option is tuning apps like GuitarTuna. These apps use the microphone to capture the tones, analyse them, and display whether the pitch is correct in a simple visual format.
Clip-on Tuners
Another option is clip-on tuners, which are typically attached to an instrument. They analyse the frequency through the instrument’s vibrations. The advantage is that they focus solely on the instrument they’re attached to, unaffected by ambient noise. This is particularly useful when tuning multiple instruments simultaneously.
KORG Vocal Trainer
The Korg Vocal Trainer is a professional tool for singers. It detects the pitch of the sung note and displays it on a staff with either a G or F clef. Red LEDs indicate if the note is too high or too low, and a blue light in the centre shows when the note is correct. This trainer is excellent for improving intonation but requires a quiet environment, making it difficult to use during a choir rehearsal. A potential improvement could be integrating vibration feedback to allow intonation checks and adjustments during practice sessions.
Features:
Display with staff notation
‚Sound Out‘ function with reference tone output
‚Sound Back‘ function for outputting the correct tone
Octave function for different vocal ranges
Korg Clip-on Tuner:
Another device from Korg for instruments uses a clip-on system. Like the Vocal Trainer, it can output a reference tone via optional headphones or speakers and includes a metronome. This device could also be useful in a choir setting, utilising vibration and frequency analysis.
Visualisation of Intonation
Singing games like SingStar employ a simple concept for visualising whether a note is hit and the rhythm is maintained. Bars indicate how long a note should be held and its pitch relative to the target. This works well in environments where precise half-tones and four-part harmonies are not required. It provides a general sense of whether you’re singing correctly without needing to read music, which is crucial for developing a good ear.
Conclusion
Existing technology offers many possibilities but is still somewhat cumbersome for direct use in choir rehearsals. I aim to explore how these tools can be made more user-friendly and tailored to my specific idea. Balancing a simple representation of vocal performance relative to the notes with detailed error display is essential for developing a good ear and improving singing.
Prototyp preparation
For my initial attempt, I purchased a clip-on tuner typically used for string instruments. Nevertheless, I want to experiment to see if it works just as well when measuring the vibration of the vocal cords instead of the instrument body. This will be my first test to determine if it works at all.
During my exploration of digitalisation in theatre, I noticed that I was not making progress and had difficulties in developing concrete solutions. In our other project „Projection Mapping“, where we create stage visualisations, our group places great emphasis on real-time visualisation and audio reactivity. Therefore, my thoughts often revolved around sound, music, audio, and real-time feedback. This made me aware of an issue in my everyday life that, while not directly related to theatre, is still artistically relevant.
At the beginning of the semester, I decided to join a choir and start singing again. I quickly realised that little remained of my past choral experience and my voice was equally rusty. During rehearsals, I had great difficulty hearing myself to determine if I was hitting the notes and the rhythm, especially in four-part singing. It is enormously difficult to hit the correct note precisely after a long break. I often wished to receive direct feedback during rehearsal to understand if my self-perception matched the actual singing and to adjust the pitch immediately.
I have developed a small prototype of how I envision such assistance. Initially, it was important to determine which aspects make up singing and where direct feedback is useful:
Pitch
Beat rhythm
Melodic rhythm
Volume
Emphasis, pronunciation
For the prototype, I focused on feedback regarding pitch and melodic rhythm.
Idea
My idea is based on a small device that provides direct feedback through vibration about correct and incorrect intonation. If sung too high or too low, it gives corresponding vibration feedback. An extension of this tool could also relay the rhythm of the piece through vibration feedback.
Concept
The tool consists of a small microphone and a vibration motor. This device can be clipped near the mouth on one’s clothing, capturing the individual’s singing and vibrating if sung incorrectly.
Another type of silent feedback could be sending a small light signal. With this approach, it would be possible to connect a small type of clip with the microphone that can be attached to the music score. This too would signal errors by lighting up if the singing is too high or too low.
Since analysing mistakes after rehearsal is also crucial, an AR app would be a possible implementation to display errors directly on the music score. If the score is also available digitally, this could be directly entered in the app. This allows for preparation for the next rehearsal.
