by bensu.kaya -

→ Impulse_08 | Feedback on my Thesis Topic & Next steps

For my last Impulse, I want to talk about the feedbacks I gather from 3 different experts. This week I had to chance to talk about my thesis expose with Ursula Lagger, Mr. Horst Hörtner from Ars Electronica Futurelab, and Mr. Kaltenbrunner from the University of Art and Design in Linz.

Ms. Lagger focused on my methods and the clarity of my exposé. She advised me to decide whether interviews are necessary and to refine my research focus. Her feedback reminded me of the importance of making my approach as clear as possible.

Mr. Hörtner gave me advice on presenting my work. After showing him my projects and portfolio, he suggested highlighting only three main projects that I want to pursue in the future. This helped me think about how to present my research in a more structured and impactful way.

Mr. Kaltenbrunner provided useful resources for my research and emphasized the importance of planning my installation. He suggested creating a draft, either in 3D or as a sketch, to clarify my concept. Since I already have experience with conceptual design, he encouraged me to refine my idea before moving into the production phase.

What I Learned

From these discussions, I learned that having a clear and focused exposé is crucial for my thesis. I also realized the importance of structuring my future projects and visually planning my installation before execution. These insights will help me stay organized and make my work more effective.

Conclusion

This feedback helped me see my next steps more clearly. Now, I will refine my thesis exposé, and start planning my thesis installation in a more structured way. Now, I feel more confident about how to move forward. These conversations really showed me the importance of balancing research with practical application!

by bensu.kaya -

→ Impulse_07 | Universal Project Template – Bertrand de Becque (Summit Montréal 2019)

For the 7th Impulse, I came across the TouchDesigner YouTube channel, found Bertrand de Becque’s talk about the Universal Project Template. It was fascinating to watch how he managed to achieve so much using TouchDesigner.

Seeing his workflow made me realize just how wide and flexible TouchDesigner is as a program. It’s exciting to think about all the possibilities, but it also reminded me that mastering such a tool takes a lot of time and practice :‘)

What stood out to me most was how he created a reusable template. Rather than starting from scratch with every new project, he built a structure that could be adapted for different purposes. This approach seemed so smart and efficient. It made me think about my own thesis and how valuable it would be if I could create something similar. For example, if I manage to design a template in TouchDesigner that I can use for visualizing how languages “look” or sound differently, it could save me so much time. It would allow me to focus on experimenting and refining the ideas instead of repeatedly building everything from the ground up.

It was also very interesting to see how organized and well-structured his work was. This level of preparation gave him the flexibility to adapt his template for various scenarios, and I realized how much planning can make a difference in any creative or technical process.

What I Learned

This talk taught me that creating templates is not only possible but also extremely helpful, especially when working on projects as complex as my thesis. It’s something I want to explore for myself, even though it might take time to figure out how to structure it properly. The way he approached TouchDesigner inspired me to think about my workflow and how I can improve it.

I also learned that TouchDesigner is a very broad and powerful tool, offering endless possibilities. This is both exciting and overwhelming because there’s so much to learn and explore. It made me realize that while I’m excited to use it for my thesis, I need to be patient and allow myself the time to become more familiar with it.

Conclusion

Overall, this talk was very motivating. It opened my eyes to new ways of working smarter, and it gave me ideas for making my thesis more efficient and creative.

→ Watch the Talk: Universal Project Template – Bertrand de Becque

by bensu.kaya -

→ Impulse_06 | Tutorial (TouchDesigner)

For my sixth Impulse, I wanted to try something online. I was hoping to join a free TouchDesigner workshop, but I couldn’t find one that worked with my schedule. Instead, I decided to follow a tutorial to help me with the voice interaction I’m working on for my thesis.

I chose the Abstract Speech Visualisation tutorial by Bileam Tschepe (Elekktronaut). His explanations were easy to follow, and the way he set up the audio interaction was really inspiring. He broke everything down step by step, which made it much easier to understand, especially for someone like me who’s still learning.

I then followed the tutorial and recreated the patch in TouchDesigner. I played around with some of the parameters and experimented with the settings to see how small changes could affect the visuals. It was interesting to see how different audio inputs created various effects, and I had fun testing different combinations. Below is a recording of my experiment with the patch.

What I Learned

  • Audio Analysis in TouchDesigner – The tutorial showed how to break down audio into frequencies and amplitudes. This was very useful for understanding how sound can control visual elements.
  • Creating Dynamic Visuals: I learned how to use particle systems and shapes to make visuals that respond directly to sound.
  • Visualizing a language in a new way, like the Heptapod logograms, can make us question our usual way of thinking about communication.

Conclusion

So this tutorial helped me to practice TouchDesigner to create visuals that react to voice and sound better. Also, it is very important for my thesis, as I’m trying to visualize the unique characteristics of different languages.

→ Watch the Tutorial: Abstract Speech Visualisation by Bileam Tschepe
→ Learn more about TouchDesigner: TouchDesigner Official Website

by bensu.kaya -

→ Impulse_03 | Podcast (Visual Cast)

For my third impulse, I watched a podcast episode from Visual Cast featuring Jascha Suess, a very talented VJ who has worked on many projects with well-known DJs. I follow his work on Instagram, so I was curious to hear about the process and stories behind it.

Even though the podcast focused on VJing, it gave me new ideas for my own project about language visualizations. Jascha shared how he uses TouchDesigner to create visuals and build interactive systems. Hearing this made me realize again how powerful TouchDesigner is, and it inspired me to explore it even more.

About TouchDesigner

One thing that stood out to me was how Jascha builds entire UIs and patches in TouchDesigner. He talked about how flexible and creative the software is, which is something I’ve started to experience in my own experiments. It’s exciting to see someone use it at such a high level, and it motivates me to keep learning.

Jascha mentioned that he isn’t a programmer and doesn’t write much code, but he loves working with TouchDesigner’s node-based interface. He finds it easier and more intuitive than traditional coding, and he said it allows him to focus more on creativity. This made me feel more confident because I also don’t have strong coding skills, but I can still create complex systems using nodes.

What I Learned

While the podcast was about VJing, it gave me fresh ideas for visualizing languages. Jascha explained how he connects inputs like music or motion to create visuals that react in real-time. This made me think about how I could make my project more interactive. For example, instead of static visuals, I could create a setup where users speak into a microphone, and the visuals change based on the sounds of their voice.

He also talked about organizing projects into smaller steps. He starts with simple patches to test ideas and then builds on them. This approach feels very practical, and I plan to try it in my own workflow.

Conclusion

Watching this podcast helped me see new possibilities in my work. Jascha’s approach to using TouchDesigner is creative and inspiring, and I want to dive deeper into what the software can do. I also learned that even without coding expertise, it’s possible to create complex and meaningful projects by focusing on the tools and workflows that work best for me.

→ Link of the podcast: https://www.youtube.com/watch?v=MWsk_JaCiew&t=2s

by mert.altinoez -

18 | New Visuals 🌱

Since the last blog post, I’ve spent some time on various platforms like Instagram, YouTube, and Pinterest, drawing inspiration. As a result, I developed two new visualizations using TouchDesigner for the prototype. I would like to introduce them to you now.

Plasmasphere

The idea behind this visualization was to create a sphere that changes with the values. The more negative the values, the more chaotic the representation should be, and vice versa. To achieve this, I followed a YouTube tutorial by Bileam Tschepe. This visualization is built on the ParticlesGPU component and has been enhanced with various settings. Additionally, I programmed the controller using Python scripts. By rotating the controller, you can change the values, and with the button function, you can change the values without affecting the visualization in real time or reset them to their original state. The screenshot below shows the TouchDesigner project.

Flowers

The concept behind this visualization is that flowers wilt when they are not properly cared for, much like how our Earth deteriorates if we do nothing about the global climate crisis. Therefore, I used various photos and AI-generated images of white flowers and applied the pixel sorting method to simulate wilting. The more negative the data, the faster and more intense the wilting becomes. This is the first visualization that somewhat relates to the subject matter being addressed. The TouchDesigner project is shown below.

by bensu.kaya -

🟦 09_Learnings & Next Steps

From exploring audio-reactive visuals in TouchDesigner to conceptualizing and designing a simple app prototype in Figma, it was so much fun! It all began with a curiosity about how different languages visually manifest through sound, leading me to experiment with various tools and techniques.

I am so happy that I dived into TouchDesigner a bit more I learned a lot about creating and manipulating visuals, especially making them respond to audio inputs which was very fun to learn. Also Along the way, I listened to the German alphabet countless times, which was unexpectedly useful (and quite amusing🤭)

Transitioning to Figma, I designed a mini prototype for a pronunciation visualizer app. This app allows users to select their native language and a language they wish to learn, providing real-time visual feedback on pronunciation patterns. The thing is, I had so many ideas for using the visuals in a practical application. Ultimately, I focused on perfecting the visuals, which was both challenging and rewarding.

Next Step

Looking ahead, I see a lot of potential for expanding this project. For example a Language Learning Kit with developing a comprehensive language learning kit using these types of visuals could make learning more engaging. Different visuals for different languages might be interesting. Or in the testing phase, it would be interesting to test the visuals with deaf individuals to see if they can detect patterns in each language. This could open up new ways of understanding and teaching languages. So I’m excited about the possibilities and let’s see if I will work on more on this project in the future!

by bensu.kaya -

🟦 08_Prototype

After analyzing the audio-reactive visuals, I wondered how I could apply these outcomes practically. While creating an app might seem like an easy route, I wanted to explore how it would look and function in this context.

App Prototype

I designed a demo app prototype using Figma:

  1. Home Screen: Native Language Selection
    • Users start by selecting their native language.
  2. Language Learning Selection
    • Next, users choose the language they want to learn. This screen ensures that the app tailors the visualizations and pronunciation guides to the selected language.
  3. Start Pronunciation Practice
    • The final page displays the data visualized video that I made in TouchDesigner. There is a simple prompt: „Hold to Pronounce.“ This allows users to practice pronunciation and see the visual feedback in real-time.

I made a quick prototype because for me the process and learnings from TouchDesigner was more challenging and interesting.

Next Step

I plan to write about my learnings and reflect on the overall process.

by bensu.kaya -

🟦 07_Analysis of Outcome

After experimenting with AI voices and creating audio-reactive visuals for different languages, the next step is to analyze the outcomes in detail. Here’s how I approached the analysis and what I discovered.

Collecting and Comparing Data

First, I recorded of the visuals for each language and phrase under consistent conditions. By placing these visuals side by side, I could directly compare them. I looked for patterns, shapes, and movements unique to each language, paying special attention to how the visuals reacted to specific sounds, particularly vowels and consonants.

Observations and Differences

During my analysis, I noted some differences:

  • German and English: Both languages produced clear, structured lines. However, German visuals had slightly more detailed patterns.
  • Turkish: Turkish visuals showed more fluid and continuous lines, reflecting its smooth flow and connected structure.
  • Russian: Russian visuals had a mix of sharp and smooth lines, showing its varied sounds and pronunciation.
  • Hindi: Hindi visuals displayed intricate and dense patterns, likely due to its mix of different sounds.
  • Chinese: Chinese visuals featured rhythmic, wave-like patterns, capturing the tones and unique structure of the language.

Here are some examples of the outcomes for „hello“ and „how are you?“:

  • German: „Hallo, wie geht’s?“ – Clear and structured lines with some complexity.
  • English: „Hello, how are you?“ – Similar to German but slightly less complex.
  • Turkish: „Merhaba, nasılsın?“ – Fluid lines, continuous patterns.
  • Russian: „Привет, как дела?“ – Mix of sharp and smooth lines.
  • Hindi: „नमस्ते, आप कैसे हैं?“ – Dense, intricate patterns.
  • Chinese: „你好, 你好吗?“ – Rhythmic, undulating patterns.

Next Step

Analyzing the audio-reactive visuals revealed subtle yet fascinating differences between languages. Each language’s phonetic characteristics influenced the visuals in unique ways. Moving forward, I want to gather some feedback from people around me where these visuals can be used and what they think about the visuals so far.

by bensu.kaya -

🟦 06_First Testing with AI

After making the visuals audio-reactive with alphabet audios, I used AI to see if there were any noticeable changes when it comes to words and sentences.

I wanted to test phrases like „hello“ and „how are you?“ in various languages like: German, English, Turkish, Russian, Hindi, and Chinese. Unfortunately, the AI tools I found were either not free or had limited trials, so I didn’t have many options. I chose one AI voice tool and one voice actor for each sentence in the different languages.

Prompts for AI

  • English: „Hello, how are you?“
  • German: „Hallo, wie geht’s?“
  • Turkish: „Merhaba, nasılsın?“
  • Russian: „Привет, как дела?“ (Privet, kak dela?)
  • Chinese (Mandarin): 你好，你好吗？(Nǐ hǎo, nǐ hǎo ma?)
  • Hindi: „नमस्ते, आप कैसे हैं?“ (Namaste, aap kaise hain?)

And here are few examples of visualization „Hello, how are you?“ :

Turkish: „Merhaba, nasılsın?“
German: „Hallo, wie geht’s?“
Chinese (Mandarin): 你好，你好吗？(Nǐ hǎo, nǐ hǎo ma?)

It was kind of hard to realize the differences between languages just by looking at the visuals. However, the process was very interesting for me. I could see subtle variations in the patterns and reactions of the visuals to different sounds.

Next Step

In the next steps, I will analyze the outcomes in more detail. I want to see if I can pinpoint specific differences and understand how each language influences the visuals.