Prototyping 2014-01-20 (Lens Based Media)

Kinect Introduction

• MicroSoft Xbox device

Technical Specs

• 1 RGB camera
• 1 Infrared camera
• 1 Infrared emitter
• Microphone array (4) for voice commands

[explanation video]

3 important Kinect techniques

• Point Cloud Data - Depth points of the IR-camera to re-create a 3d scene
• Blob detection - Recognising a moving shape (body figures)
• Skeleton detection

https://code.google.com/p/simple-openni

Demos

• How does it work
• How kinect works with infrared:
• http://en.wikipedia.org/wiki/Kinect

• http://donaldclarkplanb.blogspot.com/2011/01/kinect­from­mr­kinect­himself.html Technical explanation

gameplay

• dance central
• kinectimals
• the gunstringer:

pointcloud / particle

• 3d reconstruction ­ kinectfusion
• kinectigrams ­ stereoscopic video
• interactive kinect particle system
• Moullinex ­ Catalina video clip
• 3d facial performance
• combining with projection mapping ?? :D



Blob Detection

• Interactive Window
• Interactive Mainstage
• Gimp Interface (voice recognition + hand detection)
• box2d handtracking
• Forest
• hand gesture detection

Skeleton Tracking / Motion Capture

• bhv motion capture
• [1]
• Realtime skeleton Unity 3D
• Realtime skeleton Animata
• Interactive Puppet
• Control the Humanoid Robot by Kinect
• parametric xmas­tree
• spider web
• Gesture recognition
• National Geographics ­ mall UK
• Comic kinect
• kinect ultra



• spooooof
• Kinect Hacks