User:Francg/expub/specialissue2/dev

Motion Dialogues

Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.

* * Audio Feedback Loop * *

* The loop stops / starts again when new movement is detected inside the square’s area.

1- Webcam + Pd: Square Detects color change / motion

2- Pd: It activates oscilators and generates sound / or plays imported audio file

3- Pd: Sends signal to speakers

4- Speakers: They reproduce Pd audio

5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)

6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec

7- Pd: Plays automatically after a few seconds with [tabplay~]

* * Pd procedure report * *

1 - To use motion detection in Pd from our webcam, we need to use the "gem" library.

2- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)

3- Specify the "path" to this folder on Pd preferences.

4- Oops, the webcam is still not detected! :@

5- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"

6- Let's try downloading "Pd - Extended", checking the path, etc.

7- Now it works! webcam is detected in Pd, success.

8- However, the log sends me errors of files that couldn't be loaded. Weird.

9- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.

10- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path. ...but Pd cannot open the audio file! :@

11 - I need to Download XQuarz so my system's library will be automatically updated.

12- Now we can import and listen to audio files! :)

13- Another Issue; the audio file plays far too fast

14- Check out audio settings:
- in preview: (e.g. 16 bits per sample)
- in Audacity: Sample Rate e.g. Format (32-bit float)
- Default setting in Pd: e.g. Sample Rate: 41000

* * Meeting notes / Feedback * *

- How can a body be represented into a score?

- "Biovision Hierarchy" = file format - motion detection.

- Femke Snelting reads the Biovision Hierarchy Standard

- Systems of notations and choreography - Johanna's thesis in the wiki

Raspberry Pi *

- Floppy disk: contains a patch from Pd.

- Box: Floppy Drive, camera, mic...

- Server: Documentation such as images, video, prototypes, resources...

- There are two different research paths that could be more interestingly further explored separately;

1 - on one hand, * motion capture * by employing tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...

2 - on the other hand, there is data / information reading * This can be further developed and simplified. * However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.