User:Francg/expub/specialissue2/dev: Difference between revisions

From XPUB & Lens-Based wiki
No edit summary
No edit summary
Line 5: Line 5:


<br>* It only stops / starts again the loop when new movement is detected inside the square’s area.
<br>* It only stops / starts again the loop when new movement is detected inside the square’s area.
<br>1- Webcam + Pd: Square Detects color change / motion
<br>1- Webcam + Pd: Square Detects color change / motion
<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file
<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file
<br>3- Pd: Sends signal to speakers
<br>3- Pd: Sends signal to speakers
<br>4- Speakers: They reproduce Pd audio
<br>4- Speakers: They reproduce Pd audio
<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)
<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)
<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec
<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec
<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
<br>
<br>
Line 59: Line 66:


- How can a body be represented into a score?
- How can a body be represented into a score?
-      How to apply "Migration Flux" data


- "Biovision Hierarchy" = file format - motion detection.  
- "Biovision Hierarchy" = file format - motion detection.  
Line 64: Line 73:
-    [http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard]
-    [http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard]


- Systems of notations and coreography - Johanna's thesis in the wiki
- Systems of notations and choreography - Johanna's thesis in the wiki
 
<br>- There are blocks of different technical properties that doesn't really connect to each other, which it seems arbitrary. In order to clarify and strengthen the concept, they need to run sepparately; <br><br>
1 - on one side there is * motion capture * using different tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...
 
* This one could be more interestingly explored separately<br>
 
2 - on the other hand, there is data / information reading
(e.g. countries, number of refugees arrived / dead / ... )
 
* This can be further developed and simplified.
* However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.
 


- - - - - -


Raspberry Pi *
Raspberry Pi *
- How to apply "Migration Flux" data


- Floppy disk: contains a patch from Pd.
- Floppy disk: contains a patch from Pd.
Line 91: Line 84:
- Server: Documentation such as images, video, prototypes, resources...   
- Server: Documentation such as images, video, prototypes, resources...   


<br>- There are two different research paths that could be more interestingly further explored separately; <br><br>
1 - on one hand, * motion capture * by employing tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...
2 - on the other hand, there is data / information reading
* This can be further developed and simplified.
* However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.


</div>
</div>

Revision as of 01:00, 1 March 2017


F E E D B A C K - L O O P


* It only stops / starts again the loop when new movement is detected inside the square’s area.


1- Webcam + Pd: Square Detects color change / motion


2- Pd: It activates oscilators and generates sound / or plays imported audio file


3- Pd: Sends signal to speakers


4- Speakers: They reproduce Pd audio


5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)


6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec


7- Pd: Plays automatically after a few seconds with [tabplay~]



* * Pd procedure report * *



1 - To use motion detection in Pd from our webcam, we need to use the "gem" library.


2- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)


3- Specify the "path" to this folder on Pd preferences.


4- Oops, the webcam is still not detected! :@


5- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"


6- Let's try downloading "Pd - Extended", checking the path, etc.


7- Now it works! webcam is detected in Pd, success.


8- However, the log sends me errors of files that couldn't be loaded. Weird.


9- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.


10- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path. ...but Pd cannot open the audio file! :@


11 - I need to Download XQuarz so my system's library will be automatically updated.


12- Now we can import and listen to audio files! :)


13- Another Issue; the audio file plays far too fast


14- Check out audio settings:
- in preview: (e.g. 16 bits per sample)
- in Audacity: Sample Rate e.g. Format (32-bit float)
- Default setting in Pd: e.g. Sample Rate: 41000




* * * * * * Meeting notes / Feedback * * * * * *


- How can a body be represented into a score?

	-      How to apply "Migration Flux" data

- "Biovision Hierarchy" = file format - motion detection.

- Femke Snelting reads the Biovision Hierarchy Standard

- Systems of notations and choreography - Johanna's thesis in the wiki


Raspberry Pi *

- Floppy disk: contains a patch from Pd.

- Box: Floppy Drive, camera, mic...

- Server: Documentation such as images, video, prototypes, resources...



- There are two different research paths that could be more interestingly further explored separately;

1 - on one hand, * motion capture * by employing tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...

2 - on the other hand, there is data / information reading * This can be further developed and simplified. * However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.