User:Francg/expub/specialissue2/dev: Difference between revisions

From XPUB & Lens-Based wiki
No edit summary
No edit summary
 
(33 intermediate revisions by the same user not shown)
Line 1: Line 1:
<div style="float: left; margin: 0 15px 0 0; width: 550px; ; font-size:90%; line-height: 1.3em; letter-spacing: 0.8px;">
<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>
<br>Motion Dialogues</div>


F E E D B A C K - L O O P <br>
<div style="float: left; color:black; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.


<br>* It only stops / starts again the loop when new movement is detected inside the square’s area.
<br>1- Webcam + Pd: Square Detects color change / motion
<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file
<br>3- Pd: Sends signal to speakers
<br>4- Speakers: They reproduce Pd audio
<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)
<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec
<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
<br>


https://pzwiki.wdka.nl/mw-mediadesign/images/a/a2/Opt-flow-py-3.png


<br>* * Pd procedure report * *
<br>
<br>
<br>


<br>1 - To use motion detection in Pd from our webcam, we need to use the "gem" library.
<br>


<br>2- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)
- - -
<br>* * Audio Feedback Loop * *


<br>3- Specify the "path" to this folder on Pd preferences.


<br>4- Oops, the webcam is still not detected! :@
<br>* The loop stops / starts again when new movement is detected inside the square’s area?


<br>5- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"
<br>1- Webcam + Pd: Square Detects color change / motion


<br>6- Let's try downloading "Pd - Extended", checking the path, etc.
<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file


<br>7- Now it works! webcam is detected in Pd, success.
<br>3- Pd: Sends signal to speakers


<br>8- However, the log sends me errors of files that couldn't be loaded. Weird.
<br>4- Speakers: They reproduce Pd audio


<br>9- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.
<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)


<br>10- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path.
<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec
...but Pd cannot open the audio file! :@


<br>11 - I need to Download XQuarz so my system's library will be automatically updated.
<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
- - -
</div>
<br>
<br>


<br>12- Now we can import and listen to audio files! :)


<br>13- Another Issue; the audio file plays far too fast


<br>14- Check out audio settings:  
<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>- in preview: (e.g. 16 bits per sample)
<br>Feedback Loop = Score?</div>
<br>- in Audacity: Sample Rate e.g. Format (32-bit float)
<br>
<br>- Default setting in Pd: e.g. Sample Rate: 41000


 
https://pzwiki.wdka.nl/mw-mediadesign/images/d/df/22diagram2.png
<br><br>
<br>
* * *   * * *
<br>
Meeting notes / Feedback
https://pzwiki.wdka.nl/mw-mediadesign/images/3/36/Loop_diagram.png
* * *   * * *
<br>
 
<br>
 
https://pzwiki.wdka.nl/mw-mediadesign/images/9/99/Motion-option2.png
 
- How can a body be represented into a score?
 
- "Biovision Hierarchy" = file format - motion detection.
 
-    [http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard]
 
- Systems of notations and coreography - Johanna's thesis in the wiki
 
<br>- There are blocks of different technical properties that doesn't really connect to each other, which it seems arbitrary. In order to clarify and strengthen the concept, they need to run sepparately; <br><br>
1 - on one side there is * motion capture * using different tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...
 
* This one could be more interestingly explored separately<br>
 
2 - on the other hand, there is data / information reading
(e.g. countries, number of refugees arrived / dead / ... )
 
* This can be further developed and simplified.
* However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.
 
 
- - - - - -
 
Raspberry Pi *
 
- How to apply "Migration Flux" data
 
- Floppy disk: contains a patch from Pd.
 
- Box: Floppy Drive, camera, mic...
 
- Server: Documentation such as images, video, prototypes, resources... 
 
 
</div>

Latest revision as of 08:06, 7 March 2017


Motion Dialogues


Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.


Opt-flow-py-3.png





- - -
* * Audio Feedback Loop * *



* The loop stops / starts again when new movement is detected inside the square’s area?


1- Webcam + Pd: Square Detects color change / motion


2- Pd: It activates oscilators and generates sound / or plays imported audio file


3- Pd: Sends signal to speakers


4- Speakers: They reproduce Pd audio


5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)


6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec


7- Pd: Plays automatically after a few seconds with [tabplay~] - - -





Feedback Loop = Score?


22diagram2.png

Loop_diagram.png

Motion-option2.png

Retrieved from "https://pzwiki.wdka.nl/mw-mediadesign/index.php?title=User:Francg/expub/specialissue2/dev&oldid=104443"