by david.lasslberger -

#14 Gamification in Therapy

In this blog post, I want to explore the existing approaches to gamification in the field of physical therapy. The goal is to identify current methods, examine the problems they solve, and determine the contexts in which they are most effective.

Additionally, I wish to investigate the question: “What kinds of data can be tracked and utilized in creating a gamified experience?” Depending on the technology used, a diverse array of factors can be monitored, including:

  • Steps, GPS location, distance traveled
  • Heart rate
  • Calories burned
  • Altimeter (vertical distance)
  • Active minutes per day
  • Specific exercises/activities
  • Sleep time/quality
  • Gesture detection
  • Movement detection (x/y/z axis)
  • Accelerometer

Some specialized hardware can track even more specific metrics, such as:

  • Skin temperature
  • Breathing rate
  • Heat loss
  • Sun exposure (UV light)

All these different types of data can be used to create various applications. Here are some examples related to the healthcare industry. But first, a quick definition of „gamification“ is in order. To paraphrase, gamification is the use of game-design elements in a non-gaming context with the goal of enhancing a service by incorporating game-related features that support and enhance the user’s overall experience . Here are some services I found, listed in no particular order:

  • PreOperative Diet App (tracking of food intake)
  • Immersive VR games
    • Football goalie game
    • Catching coconuts that fall from above
    • Laundry sorting
  • Smartphone Apps
    • MySugr Junior app: An app for children and parents to track blood sugar levels for children with diabetes
  • Wii Fit: The Wii Fit Board has been used for several healthcare applications
  • ADHD video game treatment

Also this video is very interesting: Gamified smartphone app helps diabetes patients | mySugr develops amazing, gamified applications to help patients with diabetes manage their treatment. | By The Medical FuturistFacebook | Facebook

Another novel form of gamification, though not perfectly aligned with traditional academic/health settings, is the use of pedometers and step counters by Game Freak and the Pokémon Company. Over the years, there have been many attempts to capture the sense of exploration from the Pokémon games and bring it into the real world. They have created extra devices to enhance the normal Pokémon game experience. For every seven steps you take, you generate one Watt. These Watts can be used to improve your friendship with your virtual companion, similar to a Tamagotchi, or to exchange for in-game items. The first of these devices dates back to 1998 with the release of “Pokémon Pikachu.” Later iterations included mini-games and a deeper connection to the main game. In 2016, Pokémon GO was released, which became hugely popular. While more of a game than a gamified app, it nonetheless encouraged physical activity.

While researching for this blog post, I gained several interesting insights:

It seems there are two (or more accurately three) approaches to gamified therapy. One could create:

  • Something to be used during training sessions
  • Something to be used at home
  • A holistic approach spanning both therapy sessions and exercise outside of a medical setting

Additionally, one can make the act of therapy rewarding by creating game-like applications for the exercises, or focus on the process as a whole and motivate users by showing them their progress through statistics, visuals, etc., and rewarding prolonged positive behavior.

Lastly, I want to discuss potential obstacles or problems with a gamified approach to therapy. One common problem is longevity—the need to be motivating over a long period. In the context of physical therapy, it can be hard to predict how long treatment will last as it depends on the type of injury. Estimates can range from 2 weeks to 12 weeks or longer. Physiotherapy sessions typically last 30 minutes to 1 hour. Another aspect to consider is creating the right product for the target group. Children and teenagers are generally more open to a playful, game-like approach, while adults or elderly people may find these applications strange or childish. Additionally, if there is a need to store data externally on a cloud, privacy and ethical concerns are important. For example, BetterHelp had to pay $7.8 million for selling sensitive mental health information to Facebook and other marketing companies.

At this point, I could delve further into detail, but I think this is a good place to conclude for now. Designing a gamified experience, especially in healthcare, requires careful consideration. As designers, we need to be aware of these considerations to create the best possible product that can truly help people.

Sources:

by bensu.kaya -

🟦 07_Analysis of Outcome

After experimenting with AI voices and creating audio-reactive visuals for different languages, the next step is to analyze the outcomes in detail. Here’s how I approached the analysis and what I discovered.

Collecting and Comparing Data

First, I recorded of the visuals for each language and phrase under consistent conditions. By placing these visuals side by side, I could directly compare them. I looked for patterns, shapes, and movements unique to each language, paying special attention to how the visuals reacted to specific sounds, particularly vowels and consonants.

Observations and Differences

During my analysis, I noted some differences:

  • German and English: Both languages produced clear, structured lines. However, German visuals had slightly more detailed patterns.
  • Turkish: Turkish visuals showed more fluid and continuous lines, reflecting its smooth flow and connected structure.
  • Russian: Russian visuals had a mix of sharp and smooth lines, showing its varied sounds and pronunciation.
  • Hindi: Hindi visuals displayed intricate and dense patterns, likely due to its mix of different sounds.
  • Chinese: Chinese visuals featured rhythmic, wave-like patterns, capturing the tones and unique structure of the language.

Here are some examples of the outcomes for „hello“ and „how are you?“:

  • German: „Hallo, wie geht’s?“ – Clear and structured lines with some complexity.
  • English: „Hello, how are you?“ – Similar to German but slightly less complex.
  • Turkish: „Merhaba, nasılsın?“ – Fluid lines, continuous patterns.
  • Russian: „Привет, как дела?“ – Mix of sharp and smooth lines.
  • Hindi: „नमस्ते, आप कैसे हैं?“ – Dense, intricate patterns.
  • Chinese: „你好, 你好吗?“ – Rhythmic, undulating patterns.

Next Step

Analyzing the audio-reactive visuals revealed subtle yet fascinating differences between languages. Each language’s phonetic characteristics influenced the visuals in unique ways. Moving forward, I want to gather some feedback from people around me where these visuals can be used and what they think about the visuals so far.

by dragana.maksimovic -

Interactive Learning Table Prototype

In this starting phase I decided to focus on a simple math exercise. Following the exercise from start to finish, I tried to simulate what a lesson using a tool like this would look like.

Step-by-Step Breakdown of the Math Exercise

Upon starting the session, students are greeted with a welcome screen that prompts them to select a subject. This screen features four main subjects: Math, Reading, Writing, and Let’s Play.

Why? According to educational research, offering a choice increases student motivation and a sense of control over their learning. The visual representation of each subject helps young learners easily navigate and select their preferred activity.

Finding the Help Button

On every screen, there’s a little question mark (?) in the corner. When you click on it, a helpful message pops up to explain what you need to do next.

Why? Sometimes, we all get a bit confused or forget what to do. The question mark is like a friendly helper that’s always there when you need it.

Math Subject Selection

When the student selects „Math,“ they are taken to a new screen with six lessons, each represented by a numbered tile.

Why? Breaking down the curriculum into individual lessons helps in setting clear, achievable goals. Research shows that structured learning paths contribute to better knowledge retention.

Visual and Interactive Elements

The use of bright colors and large icons is based on research indicating that young children respond better to visually appealing and easily recognizable graphics. This enhances their ability to navigate the interface independently.

User Engagement

The interactive nature of the prototype encourages active participation rather than passive learning. Studies have shown that interactive learning can significantly improve student engagement and retention of material.

Conclusion

The first phase of the interactive learning table prototype for math exercises represents an integration of educational research and user-centered design. By focusing on interactivity, visual appeal, and structured learning, I wish to create a tool that not only supports academic growth but also fosters a love for learning among young students with cognitive disabilities. As I move forward, I will continue to refine and expand the functionality based on user feedback and ongoing research in educational technology.

by lea.haas -

Episode #8 from the series: New things I learned this semester – Behind the Scenes

Creating a behind-the-scenes video involves capturing the essence of what goes into making it come to life. It’s about showcasing the teamwork, creativity, and meticulous planning that happen behind the scenes.

Firstly, it’s essential to highlight the atmosphere of collaboration. From the director and producers to the camera operators and set designers, each person contributes their expertise to achieve a common vision. Capturing candid moments of brainstorming sessions, rehearsals, and discussions helps viewers appreciate the dedication and passion that drives the team.

Detailing the technical aspects is crucial. This includes showcasing the equipment used, such as cameras, lighting rigs, and sound setups. Explaining how each piece of technology contributes to the overall production quality gives viewers insight into the craftsmanship behind the scenes.

Additionally, focusing on the creative decisions enriches the narrative. Interviewing key personnel, such as the director, cinematographer, and actors, provides perspectives on their artistic choices. Whether discussing character development, visual aesthetics, or thematic elements, these insights give depth to the behind-the-scenes story.

Highlighting challenges and solutions adds authenticity. Every production faces obstacles, whether it’s adjusting to unforeseen circumstances, solving technical glitches, or refining a scene’s choreography. Documenting how the team collaborates to overcome these challenges demonstrates resilience and problem-solving skills.

Celebrating moments of camaraderie and support among the crew is equally important. Behind-the-scenes footage often captures laughter, encouragement, and shared victories, showcasing the bonds that develop during intensive projects. These human moments resonate with viewers, fostering a sense of connection and appreciation for the team’s efforts.

Lastly, presenting the final outcome ties everything together. Showing snippets of the actual footage being shot alongside the behind-the-scenes process illustrates how meticulous planning and creative choices translate into the finished product. This juxtaposition allows viewers to see the transformation from concept to execution, highlighting the magic of filmmaking.

In essence, creating a compelling behind-the-scenes video involves capturing the technical expertise, creative collaboration, challenges, and triumphs that make each production unique. It’s about telling a cohesive narrative that not only informs but also inspires viewers to appreciate the artistry and dedication involved in bringing stories to life.

by lea.haas -

Episode #7 from the series: New things I learned this semester – Regie Assistenz

In the bustling world of film, television, and theater production, every successful project relies on a team of dedicated professionals working behind the scenes. Among these roles, the Regie Assistenz (Director’s Assistant) plays a crucial and multifaceted part, ensuring that everything runs smoothly from pre-production to the final wrap.

Supporting the Director’s Vision

At its core, the role of a Regie Assistenz is to support the director in realizing their creative vision. This involves a wide range of tasks, from organizing schedules and coordinating logistics to liaising with cast and crew. Acting as a bridge between departments, the Regie Assistenz helps maintain clear communication and ensures that everyone is aligned with the director’s objectives.

From Pre-Production to Post-Production

The responsibilities of a Regie Assistenz begin long before the cameras start rolling. During pre-production, they assist in script analysis, scheduling rehearsals, and scouting locations. They are instrumental in assembling the production team, negotiating contracts, and securing necessary permits. Their meticulous planning and attention to detail set the stage for a smooth production process.

Once filming begins, the Regie Assistenz becomes the director’s right hand on set. They oversee the daily schedule, making sure scenes are shot on time and within budget. This involves coordinating actors and crew members, managing extras, and troubleshooting any unexpected challenges that arise.

In post-production, the Regie Assistenz continues to play a vital role by organizing editing sessions, reviewing footage, and ensuring that the director’s vision is maintained throughout the editing process. They collaborate closely with editors, sound designers, and visual effects artists to bring the project to its final form.

The Heartbeat of Production

Beyond the logistical aspects, being a Regie Assistenz requires adaptability, quick thinking, and a strong sense of teamwork. They must thrive in a fast-paced environment where priorities can shift rapidly. Their ability to anticipate needs and solve problems efficiently contributes directly to the success of the production.

Conclusion

In conclusion, the role of a Regie Assistenz I took over at our Studio Shoot (Nimmergrün) was an interesting experience. Behind every memorable film, captivating television show, or awe-inspiring theatrical production, there is a team of dedicated professionals like the Regie Assistenz working tirelessly to ensure its success. Their passion, expertise, and unwavering commitment make them indispensable in the collaborative art of storytelling.

by bensu.kaya -

🟦 06_First Testing with AI

After making the visuals audio-reactive with alphabet audios, I used AI to see if there were any noticeable changes when it comes to words and sentences.

I wanted to test phrases like „hello“ and „how are you?“ in various languages like: German, English, Turkish, Russian, Hindi, and Chinese. Unfortunately, the AI tools I found were either not free or had limited trials, so I didn’t have many options. I chose one AI voice tool and one voice actor for each sentence in the different languages.

Prompts for AI

  • English: „Hello, how are you?“
  • German: „Hallo, wie geht’s?“
  • Turkish: „Merhaba, nasılsın?“
  • Russian: „Привет, как дела?“ (Privet, kak dela?)
  • Chinese (Mandarin): 你好，你好吗？(Nǐ hǎo, nǐ hǎo ma?)
  • Hindi: „नमस्ते, आप कैसे हैं?“ (Namaste, aap kaise hain?)

And here are few examples of visualization „Hello, how are you?“ :

Turkish: „Merhaba, nasılsın?“
German: „Hallo, wie geht’s?“
Chinese (Mandarin): 你好，你好吗？(Nǐ hǎo, nǐ hǎo ma?)

It was kind of hard to realize the differences between languages just by looking at the visuals. However, the process was very interesting for me. I could see subtle variations in the patterns and reactions of the visuals to different sounds.

Next Step

In the next steps, I will analyze the outcomes in more detail. I want to see if I can pinpoint specific differences and understand how each language influences the visuals.

by bensu.kaya -

🟦 05_Audio Reactivity

I am still experimenting the visuals but now, I will share how I made them audio-reactive in TouchDesigner.

I followed a tutorial and then downloaded Turkish and German alphabet audios to see how the visuals change with different letters. By working with individual letters, I can easily extend this to words and sentences later.

First Visual – Audio Reactive

I tried to make the first visual audio-reactive. I think this one fits best because it looks like an audio wave and a weird mouth. The lines are clear, so I can record or take screenshots of each letter. This clarity can help in analyzing it.

Applying Audio Reactivity to Other Visuals

After figuring out how to make the first visual audio-reactive, I applied the same process to the other visuals. Here are the results:

Next Step

I think I will go with the mirrored first visual. My next step is to use an AI voice and see how it looks with words and sentences. I’m excited to see how these visuals evolve and become more refined as I continue experimenting.

by bensu.kaya -

🟦 04_Visualization Samples

After creating my first visual, I wanted to experiment more with TouchDesigner and come up with different visuals.

Mirror Effect on the First Visual

First, I changed the initial visual by applying a mirror effect. I aimed to create clear lines that resemble an audio wave. I liked that it looks like a mouth, and I am happy with the result. However, I wanted to try more variations.

Second Visual with Particles

For the second visual, I followed a tutorial on working with particles. While I enjoyed this process, the result felt too random for my project. I realized that I need more control over the particle movements to fit my theme better.

Mirror Effect on the Second Visual

Lastly, I mirrored the second visual. This resulted in too many mirrored sections and small particles. Despite this, I loved the outcomes and really enjoyed experimenting with TouchDesigner.

Next Step

In next step, I plan to make all of these visuals audio-reactive and then choose the one that fits my project best. I am having a lot of fun experimenting with TouchDesigner, I love itttt!

by lea.haas -

Episode #6 from the series: New things I learned this semester – 360 GoPro HDR

Creating HDR images using a GoPro Max 360 camera can significantly elevate the lighting quality in Blender projects, enhancing realism and immersion. The GoPro Max, known for its ability to capture panoramic views, allows you to create HDR images by taking multiple bracketed photos at different exposure levels.

To start, set up your GoPro Max on a stable tripod in the desired location. Unlike some cameras, the GoPro Max doesn’t have a built-in HDR bracketing mode, so you’ll need to manually adjust exposure settings. Take a series of photos varying from underexposed to overexposed, ensuring you capture the full range of light in your scene.

Once you’ve captured your bracketed photos, transfer them to your computer for processing. Use HDR software such as Adobe Photoshop, Photomatix, or Luminance HDR to merge these photos into a single HDR image. This process involves aligning the photos to compensate for any slight movement during the capture, then merging them to retain details across both the darkest shadows and brightest highlights.

After merging, adjust the tone mapping settings in your HDR software to fine-tune the appearance of the HDR image. This step ensures that your HDR image looks natural and realistic, maintaining a balance between light and dark areas.

Save the final HDR image in a format compatible with Blender, such as .hdr or .exr, to preserve its high dynamic range properties. In Blender, use the HDR image as an environment texture in the World settings. This allows the HDR to influence the lighting and reflections in your 3D scenes, enhancing their visual fidelity and realism.

By utilizing HDR images captured with a GoPro Max 360 camera, you can achieve sophisticated lighting effects in Blender, making your renders more dynamic and true-to-life.