RenderHeads worked with Imagination to create an innovative interactive installation which made it's debut at the Detroit motor show in early 2011. We worked closely with Imagination to realise their design and vision.

This project is a simple shuffled tile puzzle game where the player has to move the tiles into the correct positions in as few moves as possible. A photo of the player is initially captured using the Microsoft Kinect camera and our algorithm replaces the background (typically a busy motor show environment) with a video sequence of a natural environment. This allows the player to be brought directly into the experience.

• The tile game was developed for Microsoft Windows in C# using the .NET framework and XNA 4.0.
• It is completely configurable via XML so it could be easily modified for use at other events.
• Features support for mult-touch screens.
• Supports tiles from images, videos (QuickTime and AVI) and webcam.
• We used Microsoft Kinect camera to segment the user from the background and replace the background with a looping video sequence.
• Our own algorithm was used for the "chroma keying" of the background and used both the depth and colour information provided by the Kinect camera.
• All image processing operations ran completely on the GPU.

Technologies used:

Please visit this page to read more about the technique used to achieve background replacement.