EE Interactive Displays with Kinect for Windows

In September 2012, I developed a Kinect based touchless interactive display for EE, the UK’s first 4G/LTE network. The display features user outline tracking and various particle systems which display fonts, icons and user interaction feedback. I was a lead developer on the build, along with the awesome Michael Lawrence and Jonathon Curtis. Publicis Chemistry agency creatives were David Prideaux (ECD), Paul Westmooreland (AD) and Neame Ingram (CW).

The passer-by user’s skeleton and outline is tracked by a kinect sensor, mapped to particle repulsors and then used to influence the movement of a sprung particle grid. There is also some gesture recognition going on, which we developed from scratch. We used the cinder Kinect windows SDK in conjunction with openCV, and made heavy use of Cinder’s Timeline classes, and built a few custom animation classes to make our particles easier to manage and control.

Our main challenges were :
– Aggressive timescales (approx 10 weeks from concept to deployment)
– Complex branding guidelines determining the behaviour of the particles, as set out by Wolff Olins.
– The project was to be simultaneously deployed in 20 different locations, all of which needed custom installations
– Gesture recognition was a central part of the brief

I’d like to mention my gratitude to Stephen Schieberl for publishing his work on the Kinect SDK cinderblock, which this project relied upon heavily. Thanks dude! You rule!

Also thanks to Andrew Bell for his tireless work on Cinder and his very helpful responses to my various questions.

The project was commissioned by EE, and produced by London based agency Publicis Chemistry.