I have been reading the paper “Cyclops: Designing an eye-controlled instrument for accessibility and flexible use” which is written by William C Payne, Ann Paradiso, and Shaun Kane. In this blog post I will write about the paper and my reflections on the topic.
The Cyclops is an eye-gaze controlled instrument designed for live performances and improvisation. It is specially motivated by a need for expressive musical instruments that is accessible for people that rely on eye tracking for computer access, such as people diagnosed with amyotrophic lateral sclerosis (ALS). The instrument contains a synthesizer and sequencer, and is displayed as a 2D canvas on a screen and controlled with eye-tracking.
CHALLENGES
There are multiple challenges of varying size when it comes to eye-tracking being the only controller and interaction method.
Precision: Targets need careful placement, spread out from each other and made bigger. Because of this, the amount of input elements that can be displayed on one screen is reduced.
Timing: Getting to a target on screen means keeping your gaze fixed in one spot, and it’s difficult to difficult to control the timing or rhythm of inputs.
Midas touch: A design challenge when creating responsive gaze-only interfaces is when the user is activating controls accidentally when dwell time is reduced. The dwell time varys widely, depending on what kind of task it is, and it is therefore important that different tasks have different dwell time that is matching the task. The dwell time might also vary from person to person, and that might be more difficult to design for.
Other challenges: Varying accuracy and precision across users, trackers and lightning conditions. Usually more accurate around the center of the screen and less accurate around the edges.
From the users perspective, I think it can be challenging to get used to using such interfaces where the only interaction is eye-tracking. On the other hand, the project aims to help out people who are already used to eye-tracking for computer access, and they are probably already used to this way of interaction. I can imagine that one have to stay extremely focused while interacting, because when not focused and thinking on other things the eyes tend to move around. At the same time, it is like learning any instrument – you’ll need practice to be able to master the instrument. It is still important that the instrument ‘helps’ you along the way, by having different dwelling times depending on the interaction and what is the most natural.
THE INTERFACE
The interface is created with some of these challenges in mind. The musical control is split across three screens which reduces cognitive load and possible unintended interactions. There is a section of the screen that is non-selectable representation of the pitch sequence that can be fixated upon without affecting the output in any way. There is room to grow – there are different screens that the user can select depending on their experience
REFERENCES
- William C Payne, Ann Paradiso, and Shaun Kane. 2020. Cyclops: Designing an eye-controlled instrument for accessibility and flexible use. Proceedings of the International Conference on New Interfaces for Musical Expression.
