Prototyping 2014-01-20 (Lens Based Media)

Kinect Introduction

• MicroSoft Xbox device

Technical Specs

• 1 RGB camera
• 1 Infrared camera
• 1 Infrared emitter
• Microphone array (4) for voice commands

[explanation video]

3 important Kinect techniques

• Point Cloud Data - Depth points of the IR-camera to re-create a 3d scene
• Blob detection - Recognising a moving shape (body figures)
• Skeleton detection

Demos

• How does it work
• How kinect works with infrared:
• http://en.wikipedia.org/wiki/Kinect

• http://donaldclarkplanb.blogspot.com/2011/01/kinect­from­mr­kinect­himself.html Technical explanation

gameplay

• dance central
• kinectimals
• the gunstringer:

pointcloud / particle

• 3d reconstruction ­ kinectfusion
• kinectigrams ­ stereoscopic video
• interactive kinect particle system
• Moullinex ­ Catalina video clip
• 3d facial performance
• combining with projection mapping ?? :D



Blob Detection

• Interactive Window
• Interactive Mainstage
• Gimp Interface (voice recognition + hand detection)
• box2d handtracking

Forest http://achimkern.de/touchdesigner/forest/ hand gesture detection http://www.youtube.com/watch?feature=player_embedded&v=NeHX5jzHFM4 Skeleton Tracking / Motion Capture bhv motion capture http://www.brekel.com/?page_id=155 http://www.evolutie.org/movies/kinect_bhv_sl_test_2.mov Realtime skeleton Unity 3D http://vimeo.com/21330589 Realtime skeleton Animata http://www.youtube.com/watch?v=acOKVi­BNJA Interactive Puppet: http://vimeo.com/16985224 Control the Humanoid Robot by Kinect http://www.youtube.com/watch?v=w8BmgtMKFbY parametric xmas­tree http://www.dyvikdesign.com/site/ spider web http://vimeo.com/20129604 Gesture recognition http://vimeo.com/24086286 National Geographics ­ mall UK http://www.youtube.com/watch?v=TL62txWNFMY&feature=autoplay&list=FLsEO­mDeqS1JOQ Comic kinect http://www.youtube.com/watch?v=9QQW_sPzNNM kinect ultra http://www.youtube.com/watch?v=RUG­Uvq­J­w  spooooof http://www.youtube.com/watch?v=UAlcTnvbBS0 Kinect Hacks http://kinect.dashhacks.com/