User:Francg/expub/specialissue2/dev

Motion Dialogues

Explores the physical movement of humans in specific spaces, and the reaction or series of consequences that this action implies. It aims to generate audio feedback loops, using motion&color detection.

* *Audio Feedback Loop* *

* It only stops / starts again the loop when new movement is detected inside the square’s area.

1- Webcam + Pd: Square Detects color change / motion

2- Pd: It activates oscilators and generates sound / or plays imported audio file

3- Pd: Sends signal to speakers

4- Speakers: They reproduce Pd audio

5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)

6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec

7- Pd: Plays automatically after a few seconds with [tabplay~]

* * Pd procedure report * *

1 - To use motion detection in Pd from our webcam, we need to use the "gem" library.

2- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)

3- Specify the "path" to this folder on Pd preferences.

4- Oops, the webcam is still not detected! :@

5- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"

6- Let's try downloading "Pd - Extended", checking the path, etc.

7- Now it works! webcam is detected in Pd, success.

8- However, the log sends me errors of files that couldn't be loaded. Weird.

9- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.

10- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path. ...but Pd cannot open the audio file! :@

11 - I need to Download XQuarz so my system's library will be automatically updated.

12- Now we can import and listen to audio files! :)

13- Another Issue; the audio file plays far too fast

14- Check out audio settings:
- in preview: (e.g. 16 bits per sample)
- in Audacity: Sample Rate e.g. Format (32-bit float)
- Default setting in Pd: e.g. Sample Rate: 41000

* * * * * * Meeting notes / Feedback * * * * * *

- How can a body be represented into a score?

       -       How to apply Migration Flux data

- "Biovision Hierarchy" = file format - motion detection.

- Femke Snelting reads the Biovision Hierarchy Standard

- Systems of notations and choreography - Johanna's thesis in the wiki

Raspberry Pi *

- Floppy disk: contains a patch from Pd.

- Box: Floppy Drive, camera, mic...

- Server: Documentation such as images, video, prototypes, resources...

- There are two different research paths that could be more interestingly further explored separately;

1 - on one hand, * motion capture * by employing tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...

2 - on the other hand, there is data / information reading * This can be further developed and simplified. * However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.