10 | Auditory and visual storytelling – a case study on different anime and video games

What this blogpost is all about

As my final entry, I wanted to continue looking into immersion and what may cause it.
As an avid anime and video game fan myself, I have always been fascinated by how some of my favourite pieces of media managed to catch the audience and deepen immersion by not only having a compelling story, but also mange to make use of various different auditory and visual storytelling elements to underline it. This lead to this blog-post, where I want to explore some of my favourite recent examples and explore some ideas, on what makes them work. By looking into these examples, analysing them and learning from their respective examples, I hope to also gain insight into how to make my own work more immersive.
Also, while I will try to keep my entry as spoiler-free as possible, there may be some spoilers for the analysed media, you have been warned!

Screenshots from the first 6 episodes of the anime:
Sousou no Frieren’s backdrops (top) and frequent wide-angle have an almost pittoresque quality to them, inviting the viewer to stop and gaze, slowing down the pace, without appearing boring
The fight scenes (bottom), however, are usually much more dynamic, the art style changes, it features clear focus points, harsher lines, dynamic movement.

American composer Evan Call composed most of the Original Soundtrack of Sousou no Frieren, and already released part of it as a pre-release on Youtube. The full soundtrack is set to release in April

Time Flows Ever Onward – a slower piece

Fear Brought Me This Far – an uplifting battle theme, that ends in a crescendo

For 1000 Years – a slow piece, with an almost epheral quality to it, that is a play on the passage of time

Zoltraak – a name, that describes the offensive spell both Frieren and Fern use during their journey, that has still, due to stroy progression, become Fern’s theme, with Frieren’s being very similar

Japanese composer Keiichi Okabe is founder and chief executive officer of music production company MONACA, which provided the Original Soundtrack for NieR: Automata

意味/無 – meaning/nothing, which could also be read as meaningless when put together, is just the first of 119 tracks the composer has uploaded to Youtube. And the name already hints at one of the games hidden messages

A review by Skill Up, that encapsulates, what maakes the game so special, aptly titled „The Masterpiece You (Probably) Won’t Play“, due to the multiple playthroughs the player has to complete first

Weight of the world – the first ending’s song, in English

„壊レタ世界ノ歌“ (Kowareta Sekkai no Uta, lit.: „Song of a broken world“) – the second ending’s song, in Japanese

Nouveau – another ending song in French

the End of YoRHa – the final track in the soundtrack, combining all previous experiences, before presenting the player with the ultimate choice

Composer Steven Grove composed the final soundtrack / boss – theme for both Lone Trail and Under Tides

The official trailer of Arknights – Lone trail already hints at its theme

An analysis of the Visual Design that make up the Lone Trail event in Arknights

Steven Grove – Control’s Wishes are both the first and final piece of music the player hears when experiencing the story of Lone Trail

Professionally trained opera singer and voice actor MarcoMeatball reacts to Control’s Wishes and analyses the main elements of the song

The official trailer of Arknights – Under Tide features many of the aquatic elements – both visually and aurally

Steven Grove – Under Tides is a boss battle theme, that has a slight twist to it

Voice actor and opera singer MarcoMeatball also analysed the musical elements of Under Tides, revealing the true meaning, that the player is exposed to, without having played the event himself

1. Kanehito, Yamada: Sousou no Frieren, Japan 2023-2024, Anime by: Studio Madhouse, Episodes 1 – 6, streamed at: https://www.crunchyroll.com/de/series/GG5H5XQX4/frieren-beyond-journeys-end, in: https://www.crunchyroll.com/de/ [22.02.2024].
2. Evan Call – Topic: Frieren: Beyond Journey’s End – Original Series Soundtrack EP, https://www.youtube.com/playlist?list=OLAK5uy_n9086XIv_nf3_qDXrEYnUm_dwW1KGxyrE [22.02.2024].
3. n.a.: Evan Call, https://anilist.co/staff/119999/Evan-Call, online in: https://anilist.co/ [22.02.2024].
4. Saba, Michael: How NieR: Automata Tells the Ultimate Humanist Fable, https://www.youtube.com/watch?v=63PzQIbTrM8 [22.02.2024].
5. n.a.: Keiichi Okabe, https://myanimelist.net/people/42543/Keiichi_Okabe, online in: https://myanimelist.net/ [22.02.2024].
6. Keiichi Okabe – Topic: NieR: Automata complete OST, https://youtube.com/playlist?list=PLdR7m7PFLzQ7RqOVfxk2Fr2F-a7iWzovn&si=90M0GsB9J6ZDHFt2 [22.02.2024].
7. Skill Up: Nier: Automate | The Masterpiece You (Probably) Won’t Play, https://www.youtube.com/watch?v=-NiyfG8Ctbo [22.02.2024].
8. Grove, Steven: Steven Grove Music, https://www.stevengrove.com/ [22.02.2024].
9. Arknights Official – Yostar: Arknights Official Trailer – Lone Trail, https://youtu.be/U_laI-G21fo [22.02.2024].
10. HalfACupOfRice: The Visual Design of Arknights Lone Trail, https://www.youtube.com/watch?v=aS8nnjrMlQc [22.02.2024].
11. 塞壬唱片-MSR – Topic: Control’s Wishes, https://www.youtube.com/watch?v=KKhEwcWMH9M [22.02.2024].
12. MarcoMeatball: Arknights – Lone Trail: Control’s Wishes || MUSIC REACTION, https://www.youtube.com/watch?v=s7NdkeSQcjI [22.02.2024].
13. Arknights Official – Yostar: Arknights Official Trailer – Under Tides, https://www.youtube.com/watch?v=0hqKmICjh0g [22.02.2024].
14. 塞壬唱片-MSR – Topic: Under Tides, https://www.youtube.com/watch?v=4uTMR6vZqFM [22.02.2024].
15. MarcoMeatball: Opera Singer Reacts To The Music of Arknights, https://www.youtube.com/watch?v=4l7nivLqz4Q [22.02.2024].

09 | More than just buttons – Interactions and interfaces in VR, AR and MR experiences

What this blogpost is all about

Building upon my previous blogpost on immersive level design, this post also aims to explore the topic of immersion and interaction within VR, MR and AR a bit more by looking into different interface and interactivity solutions currently available, some previously mentioned already, some new, that may increase intuitiveness and engagement from the user. While also still covering AR and MR solutions, the main focus of this blog post will be on VR, as it is more in line with my future plans and planned research.

Different headsets, different controllers – HTC Vive Pro, Meta Quest 3 Pro, PS Move and Valve Index Pro (left to right)

Ultraleap’s 3Di, a small tracking camera for handtracking, comes with its own intergrated interface

Ultraleap Leap Motion Controller 2, a gesture tracking controller with a wide variety of applications

teslasuit – a full body haptic feeback suit, that also tracks movement and can be used for motion capture

Virtuix Omni One – a Omnidirectional treadmil developed for gaming in VR

  • Look further into different VR and MR solutions and their respective issues
  • Research essential tools for creating immersive virtual environments as well as different game engines and their advantages and disadvantages
  • Check methods of engagement and interaction within these digital environments
  • Look into accessibility and how to ensure it
  • Research into immersion and storytelling

1. Springer / Gabler.: Virtuelle Realität, in: Gabler Wirtschaftslexikon, n.y.,
https://wirtschaftslexikon.gabler.de/definition/virtuelle-realitaet-54243/ online in: https://wirtschaftslexikon.gabler.de/ [08.02.2024].
2. n.A.: Was ist Augmented Reality?, in: Omnia360, 2020, https://omnia360.de/blog/was-ist-augmented-reality/, online in: https://omnia360.de/ [08.02.2024].
3. n.A.: Mixed Reality: Wenn sich Reales und Virtuelles vermischt, in: Omnia360, 2023, https://omnia360.de/blog/mixed-reality/, online in: https://omnia360.de/ [08.02.2024].
4. n.a.: Extended Reality, in: RyteWiki, n.y., https://de.ryte.com/wiki/Extended_Reality, online in: https://de.ryte.com/wiki/Hauptseite [08.02.2024].
5. Hayden, S.: Vision Pro Teardown Shows Balancing Act Between Cutting Edge Tech & Weighty Design, in: ROADTOVR, 2024, https://www.roadtovr.com/apple-vision-pro-teardown-ifixit/, online in: https://www.roadtovr.com/ [08.02.2024].
6. Hayden, S.: Quest 3 Teardown Shows Just How Slim the Headset Really Is, in: ROADTOVR, 2023, https://www.roadtovr.com/meta-quest-3-teardown-ifixit-repair/, online in: https://www.roadtovr.com/ [08.02.2024].
7. Hayden, S.: Vive Ultimate Tracker Gets Beta Support for Third-Party PC VR Headsets, in: ROADTOVR, 2024, https://www.roadtovr.com/vive-ultimate-tracker-quest-index-pico/, online in: https://www.roadtovr.com/ [08.02.2024].
8. n.a.: What to Watch: February 2024 Highlights, n: Meta Quest-Blog, 2024, https://www.meta.com/de-de/blog/quest/what-to-watch-free-meta-quest-tv-vr-film, online in: https://www.meta.com/at/ [08.02.2024].
9. CGV Channel: TU Graz Virtual Reality Cave, https://www.youtube.com/watch?v=aeTHlAZtlAI [08.02.2024].