eye-tracking based entertainment suite for patients with Locked-In Syndrome

DURATION: Sept 2014 - Dec 2014

ROLE: UX / UI / Interaction Designer

TOOLS: Adobe Creative Suite, Wireframing, Prototyping, User Stories/ Scenarios, NodeJS, HTML/CSS

COLLABORATORS: Alex Yang, Andrew Wang, Danny Zhang, Kane Chong, Luke Kim, Sam Suen, Sean Burke, Pavan Kumar

DELIVERABLES: Website   |    GitHub    |    Design : Detailed Description    |    User Story    |    Final Presentation

Meet Bob Veillette: a man who has Locked-in Syndrome (LIS) which leaves him completely paralyzed except for his eyes.

How can we help facilitate a better sense of life and social interaction for those with locked-in syndrome?

Loved ones usually only have a one-way communication with people with LIS. LIS patients also have communicated that they feel trapped in a limiting body, because they can still hear and be cognizant of the world around them, and their ability to think has not been damaged. Our main goals for MyePlay are for Bob's life to be enriched by relieving his boredom when he is alone, socially interacting with his loved ones, and enlightening his mind through videos.

Designing for LIS: First Prototype

the challenge

Designing for people with LIS calls for designers to rethink interactions with technology, making it more difficult and specialized.

How can we explore the depth of problems LIS patients have beyond communication and enrich their lives?

our approach and process

Literature Review [1] [2] [3] [4], Wireframing, High Fidelity Prototyping, User Story

I first started by looking at papers to understand the motivations and struggles of LIS patients.

I also read different papers on how eyes have been used as a way for input and its challenges.

From these papers, I got a glimpse into the daily life of someone with LIS-- constantly being bored and having someone take care of them, which is why we decided to go with an entertainment suite. However, better user research could have been done by seeing how Bob, or another LIS patient, lives and what they struggle with.

the outcome

User Needs + Design Solutions

1) Bob gets bored easily without his caretaker

Media player with his favorite jazz and piano pieces

2) Bob needs to bond with his loved ones

2 player games that can be played with the eyes and hands

3) Bob has problems looking horizontally

vertical menu

4) Constraints of cheaper eye trackers

continuous vertical menu

We feel privileged to have designed something to improve and enrich Bob's life, and to have redefined the eye's purpose and function as not just a passive way to indicate attention, but as an active decision maker. I created a demo video using Adobe Illustrator that highlights the UI and interactions to show our investors at the Moxie Center.

Entertainment Suite: Final Working Prototype

the challenge

How can a complex interactive system work with the constraints from Bob of a lack of horizontal eye movement and the technical constraints of a cheaper eye tracker?

our approach and process

We decided to have only a vertical spiral design to prevent errors easily made by the system by showing only one option at a time, and to suit Bob's constraints better.

This demo is of our final design and project, and here is a complete detailed description of our designs and the reasoning behind all the design choices.

the outcome

Hearing from Brilliant minds in HCI Research

Having the chance to design for our users has created new possibilities for interfaces, user experiences, interactions, and even new discoveries to what is intuitive specifically to these users. This project opened up new possibilities to rethink already existing functions and purposes of the different parts of the people's bodies , because people with LIS must learn to use their eyes for more purposes than people without LIS usually need to.

  back to work