Signwave: An Assistive, Gesture-based Interface

In 2010, William Jennings, Erica Newman, and Becky Kazansky worked with an individual with vision, motion and speech constraints to design a simple gesture-based interface.

We prototyped a simple piece of software that, with the use of a web cam, allows a user to open browser targets with a swipe of the hand across two regions on a screen.

By April,2011, we created a rudimentary gesture interface for the Kinect that allows the user to open and scroll through itunes and NPR using an alphabet of hand motions.