Prototyping 2014-01-20 (Lens Based Media)

Kinect Introduction

• MicroSoft Xbox device

Technical Specs

• 1 RGB camera
• 1 Infrared camera
• 1 Infrared emitter
• Microphone array (4) for voice commands

[explanation video]

3 important Kinect techniques

• Point Cloud Data - Depth points of the IR-camera to re-create a 3d scene
• Blob detection - Recognising a moving shape (body figures)
• Skeleton detection

Demos

kinect How does it work: http://www.youtube.com/watch?feature=player_embedded&v=RT7hGBY5FZU#! How kinect works with infrared: http://www.youtube.com/watch?v=dTKlNGSH9Po&feature=related http://en.wikipedia.org/wiki/Kinect Technical explanation: http://www.ros.org/wiki/kinect_calibration/technical http://donaldclarkplanb.blogspot.com/2011/01/kinect­from­mr­kinect­himself.html gameplay dance central: http://www.youtube.com/watch?v=Y­iKWe­U9bY kinectimals http://www.youtube.com/watch?v=YJnM7FuUHiU&feature=related the gunstringer: http://www.youtube.com/watch?v=Eb58beleiqg pointcloud / particle 3d reconstruction ­ kinectfusion http://www.youtube.com/watch?v=quGhaggn3cQ kinectigrams ­ stereoscopic video: http://www.youtube.com/watch?v=ttrWeG6LOZY interactive kinect particle system: http://vimeo.com/22689237 Moullinex ­ Catalina video clip: http://vimeo.com/19723907 3d facial performance: http://www.youtube.com/watch?v=nYsqNnDA1l4&feature=related combining with projection mapping ?? :D http://www.youtube.com/watch?v=gJ_5sDvAlNY&feature=fvst  Blob Detection Interactive Window: http://www.youtube.com/watch?v=xFgvNMN2DiQ&NR=1 Interactive Mainstage http://vimeo.com/28452629 Gimp Interface (voice recognition + hand detection) http://www.youtube.com/watch?v=vfaNLIowSyk& box2d handtracking http://vimeo.com/17242680 Forest http://achimkern.de/touchdesigner/forest/ hand gesture detection http://www.youtube.com/watch?feature=player_embedded&v=NeHX5jzHFM4 Skeleton Tracking / Motion Capture bhv motion capture http://www.brekel.com/?page_id=155 http://www.evolutie.org/movies/kinect_bhv_sl_test_2.mov Realtime skeleton Unity 3D http://vimeo.com/21330589 Realtime skeleton Animata http://www.youtube.com/watch?v=acOKVi­BNJA Interactive Puppet: http://vimeo.com/16985224 Control the Humanoid Robot by Kinect http://www.youtube.com/watch?v=w8BmgtMKFbY parametric xmas­tree http://www.dyvikdesign.com/site/ spider web http://vimeo.com/20129604 Gesture recognition http://vimeo.com/24086286 National Geographics ­ mall UK http://www.youtube.com/watch?v=TL62txWNFMY&feature=autoplay&list=FLsEO­mDeqS1JOQ Comic kinect http://www.youtube.com/watch?v=9QQW_sPzNNM kinect ultra http://www.youtube.com/watch?v=RUG­Uvq­J­w  spooooof http://www.youtube.com/watch?v=UAlcTnvbBS0 Kinect Hacks http://kinect.dashhacks.com/