This was an installation at the Museum of Contemporary Art in Sydney for the Vivid Festival 2011 where the public could use hand gestures to paint the facade of the building. Developed for Spinifex for Events NSW.

Using a Kinect camera with the open source OpenNI drivers and OpenFrameworks, skeleton tracking was used to isolate people’s hands and track their gestures. The software automatically guided them them through the calibration process and assigned them a paint colour, which they could change by clapping their hands. Ribbons would randomly unfurl, their shadows helping to highlight mapping used to work with the 3D details of the architecture, their shadows dipping in and out of the grooves in the building.