eye-tracking based entertainment suite for patients with Locked-In Syndrome
DURATION: Sept 2014 - Dec 2014
ROLE: UX / UI / Interaction Designer
TOOLS: Adobe Creative Suite, Wireframing, Prototyping, User Stories/ Scenarios, NodeJS, HTML/CSS
COLLABORATORS: Alex Yang, Andrew Wang, Danny Zhang, Kane Chong, Luke Kim, Sam Suen, Sean Burke, Pavan Kumar
Meet Bob Veillette: a man who has Locked-in Syndrome (LIS) which leaves him completely paralyzed except for his eyes.
Loved ones usually only have a one-way communication with people with LIS. LIS patients also have communicated that they feel trapped in a limiting body, because they can still hear and be cognizant of the world around them, and their ability to think has not been damaged. Our main goals for MyePlay are for Bob's life to be enriched by relieving his boredom when he is alone, socially interacting with his loved ones, and enlightening his mind through videos.
Designing for people with LIS calls for designers to rethink interactions with technology, making it more difficult and specialized.
How can we explore the depth of problems LIS patients have beyond communication and enrich their lives?
our approach and process
I first started by looking at papers to understand the motivations and struggles of LIS patients.
I also read different papers on how eyes have been used as a way for input and its challenges.
From these papers, I got a glimpse into the daily life of someone with LIS-- constantly being bored and having someone take care of them, which is why we decided to go with an entertainment suite. However, better user research could have been done by seeing how Bob, or another LIS patient, lives and what they struggle with.
1) Bob gets bored easily without his caretaker
Media player with his favorite jazz and piano pieces
2) Bob needs to bond with his loved ones
2 player games that can be played with the eyes and hands
3) Bob has problems looking horizontally
4) Constraints of cheaper eye trackers
continuous vertical menu
We feel privileged to have designed something to improve and enrich Bob's life, and to have redefined the eye's purpose and function as not just a passive way to indicate attention, but as an active decision maker. I created a demo video using Adobe Illustrator that highlights the UI and interactions to show our investors at the Moxie Center.
How can a complex interactive system work with the constraints from Bob of a lack of horizontal eye movement and the technical constraints of a cheaper eye tracker?
our approach and process
We decided to have only a vertical spiral design to prevent errors easily made by the system by showing only one option at a time, and to suit Bob's constraints better.
This demo is of our final design and project, and here is a complete detailed description of our designs and the reasoning behind all the design choices.
Having the chance to design for our users has created new possibilities for interfaces, user experiences, interactions, and even new discoveries to what is intuitive specifically to these users. This project opened up new possibilities to rethink already existing functions and purposes of the different parts of the people's bodies , because people with LIS must learn to use their eyes for more purposes than people without LIS usually need to.