User:Francg/expub/specialissue2/dev: Difference between revisions

From XPUB & Lens-Based wiki
No edit summary
No edit summary
 
(34 intermediate revisions by the same user not shown)
Line 1: Line 1:
<div style="float: left; margin: 0 15px 0 0; width: 550px; ; font-size:90%; line-height: 1.3em; letter-spacing: 0.8px;">
<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>* * Puredata * *
<br>Motion Dialogues</div>
Procedure report:


<div style="float: left; color:black; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.


1 - To use motion detection in Pd from our webcam, we need to use the "gem" library.


2- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)
https://pzwiki.wdka.nl/mw-mediadesign/images/a/a2/Opt-flow-py-3.png


3- Specify the "path" to this folder on Pd preferences.
<br>
<br>
<br>


4- Oops, the webcam is still not detected! :@
<br>


5- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"
- - -
<br>* * Audio Feedback Loop * *


6- Let's try downloading "Pd - Extended", checking the path, etc.


7- Now it works! webcam is detected in Pd, success.
<br>* The loop stops / starts again when new movement is detected inside the square’s area?


8- However, the log sends me errors of files that couldn't be loaded. Weird.
<br>1- Webcam + Pd: Square Detects color change / motion


9- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.
<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file


10- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path.
<br>3- Pd: Sends signal to speakers
...but Pd cannot open the audio file! :@


11 - I need to Download XQuarz so my system's library will be automatically updated.
<br>4- Speakers: They reproduce Pd audio


12- Now we can import and listen to audio files! :)
<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)


13- Another Issue; the audio file plays far too fast
<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec


14- Check out audio file:  
<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
- in preview: (16 bits per sample)
- - -
- in Audacity: Sample Rate Format (32-bit float)
</div>
- Default setting in Pd: Sample Rate: 41000
<br>
<br>


Which settings do work: 24000 Sample Rate


<br><br>
* * *   * * *
Meeting notes / Feedback
* * *   * * *


<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>Feedback Loop = Score?</div>
<br>


 
https://pzwiki.wdka.nl/mw-mediadesign/images/d/df/22diagram2.png
- How can a body be represented into a score?
<br>
 
<br>
- "Biovision Hierarchy" = file format - motion detection.
https://pzwiki.wdka.nl/mw-mediadesign/images/3/36/Loop_diagram.png
 
<br>
-    [http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard]
<br>
 
https://pzwiki.wdka.nl/mw-mediadesign/images/9/99/Motion-option2.png
- Systems of notations and coreography - Johanna's thesis in the wiki
 
<br>- There are blocks of different technical properties that doesn't really connect to each other, which it seems arbitrary. In order to clarify and strengthen the concept, they need to run sepparately; <br><br>
1 - on one side there is * motion capture * using different tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...
 
* This one could be more interestingly explored separately<br>
 
2 - on the other hand, there is data / information reading
(e.g. countries, number of refugees arrived / dead / ... )
 
* This can be further developed and simplified.
* However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.
 
 
- - - - - -
 
Raspberry Pi *
 
- How to apply "Migration Flux" data
 
- Floppy disk: contains a patch from Pd.
 
- Box: Floppy Drive, camera, mic...
 
- Server: Documentation such as images, video, prototypes, resources... 
 
 
 
F E E D B A C K - L O O P <br>
 
<br>* It only stops / starts again the loop when new movement is detected inside the square’s area.
<br>1- Webcam + Pd: Square Detects color change / motion
<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file
<br>3- Pd: Sends signal to speakers
<br>4- Speakers: They reproduce Pd audio
<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)
<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec
<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
 
 
</div>

Latest revision as of 08:06, 7 March 2017


Motion Dialogues


Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.


Opt-flow-py-3.png





- - -
* * Audio Feedback Loop * *



* The loop stops / starts again when new movement is detected inside the square’s area?


1- Webcam + Pd: Square Detects color change / motion


2- Pd: It activates oscilators and generates sound / or plays imported audio file


3- Pd: Sends signal to speakers


4- Speakers: They reproduce Pd audio


5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)


6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec


7- Pd: Plays automatically after a few seconds with [tabplay~] - - -





Feedback Loop = Score?


22diagram2.png

Loop_diagram.png

Motion-option2.png

Retrieved from "https://pzwiki.wdka.nl/mw-mediadesign/index.php?title=User:Francg/expub/specialissue2/dev&oldid=104443"