User:Francg/expub/specialissue2/dev: Difference between revisions
No edit summary |
No edit summary |
||
Line 5: | Line 5: | ||
<br>* It only stops / starts again the loop when new movement is detected inside the square’s area. | <br>* It only stops / starts again the loop when new movement is detected inside the square’s area. | ||
<br>1- Webcam + Pd: Square Detects color change / motion | <br>1- Webcam + Pd: Square Detects color change / motion | ||
<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file | <br>2- Pd: It activates oscilators and generates sound / or plays imported audio file | ||
<br>3- Pd: Sends signal to speakers | <br>3- Pd: Sends signal to speakers | ||
<br>4- Speakers: They reproduce Pd audio | <br>4- Speakers: They reproduce Pd audio | ||
<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?) | <br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?) | ||
<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec | <br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec | ||
<br>7- Pd: Plays automatically after a few seconds with [tabplay~] | <br>7- Pd: Plays automatically after a few seconds with [tabplay~] | ||
<br> | <br> | ||
Line 59: | Line 66: | ||
- How can a body be represented into a score? | - How can a body be represented into a score? | ||
- How to apply "Migration Flux" data | |||
- "Biovision Hierarchy" = file format - motion detection. | - "Biovision Hierarchy" = file format - motion detection. | ||
Line 64: | Line 73: | ||
- [http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard] | - [http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard] | ||
- Systems of notations and | - Systems of notations and choreography - Johanna's thesis in the wiki | ||
Raspberry Pi * | Raspberry Pi * | ||
- Floppy disk: contains a patch from Pd. | - Floppy disk: contains a patch from Pd. | ||
Line 91: | Line 84: | ||
- Server: Documentation such as images, video, prototypes, resources... | - Server: Documentation such as images, video, prototypes, resources... | ||
<br>- There are two different research paths that could be more interestingly further explored separately; <br><br> | |||
1 - on one hand, * motion capture * by employing tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc... | |||
2 - on the other hand, there is data / information reading | |||
* This can be further developed and simplified. | |||
* However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked. | |||
</div> | </div> |
Revision as of 01:00, 1 March 2017
F E E D B A C K - L O O P
* It only stops / starts again the loop when new movement is detected inside the square’s area.
1- Webcam + Pd: Square Detects color change / motion
2- Pd: It activates oscilators and generates sound / or plays imported audio file
3- Pd: Sends signal to speakers
4- Speakers: They reproduce Pd audio
5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)
6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec
7- Pd: Plays automatically after a few seconds with [tabplay~]
* * Pd procedure report * *
1 - To use motion detection in Pd from our webcam, we need to use the "gem" library.
2- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)
3- Specify the "path" to this folder on Pd preferences.
4- Oops, the webcam is still not detected! :@
5- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"
6- Let's try downloading "Pd - Extended", checking the path, etc.
7- Now it works! webcam is detected in Pd, success.
8- However, the log sends me errors of files that couldn't be loaded. Weird.
9- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.
10- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path.
...but Pd cannot open the audio file! :@
11 - I need to Download XQuarz so my system's library will be automatically updated.
12- Now we can import and listen to audio files! :)
13- Another Issue; the audio file plays far too fast
14- Check out audio settings:
- in preview: (e.g. 16 bits per sample)
- in Audacity: Sample Rate e.g. Format (32-bit float)
- Default setting in Pd: e.g. Sample Rate: 41000
* * * * * *
Meeting notes / Feedback
* * * * * *
- How can a body be represented into a score?
- How to apply "Migration Flux" data
- "Biovision Hierarchy" = file format - motion detection.
- Femke Snelting reads the Biovision Hierarchy Standard
- Systems of notations and choreography - Johanna's thesis in the wiki
Raspberry Pi *
- Floppy disk: contains a patch from Pd.
- Box: Floppy Drive, camera, mic...
- Server: Documentation such as images, video, prototypes, resources...
- There are two different research paths that could be more interestingly further explored separately;
1 - on one hand, * motion capture * by employing tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...
2 - on the other hand, there is data / information reading * This can be further developed and simplified. * However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.